-- Logs begin at Thu 2022-07-14 10:11:07 UTC, end at Thu 2022-07-14 11:14:45 UTC. -- Jul 14 10:38:23.164681 dv-cinder-846146-7-smb systemd[1]: Starting Devstack devstack@keystone.service... Jul 14 10:38:23.172136 dv-cinder-846146-7-smb devstack@keystone.service[86652]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Jul 14 10:38:23.175355 dv-cinder-846146-7-smb devstack@keystone.service[86652]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Jul 14 10:38:23 2022] *** Jul 14 10:38:23.175355 dv-cinder-846146-7-smb devstack@keystone.service[86652]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 14 10:38:23.175355 dv-cinder-846146-7-smb devstack@keystone.service[86652]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 14 10:38:23.175355 dv-cinder-846146-7-smb devstack@keystone.service[86652]: nodename: dv-cinder-846146-7-smb Jul 14 10:38:23.175355 dv-cinder-846146-7-smb devstack@keystone.service[86652]: machine: x86_64 Jul 14 10:38:23.175355 dv-cinder-846146-7-smb devstack@keystone.service[86652]: clock source: unix Jul 14 10:38:23.175355 dv-cinder-846146-7-smb devstack@keystone.service[86652]: pcre jit disabled Jul 14 10:38:23.175355 dv-cinder-846146-7-smb devstack@keystone.service[86652]: detected number of CPU cores: 4 Jul 14 10:38:23.175355 dv-cinder-846146-7-smb devstack@keystone.service[86652]: current working directory: / Jul 14 10:38:23.175355 dv-cinder-846146-7-smb devstack@keystone.service[86652]: detected binary path: /usr/bin/uwsgi-core Jul 14 10:38:23.175355 dv-cinder-846146-7-smb devstack@keystone.service[86652]: your processes number limit is 47680 Jul 14 10:38:23.175355 dv-cinder-846146-7-smb devstack@keystone.service[86652]: your memory page size is 4096 bytes Jul 14 10:38:23.175355 dv-cinder-846146-7-smb devstack@keystone.service[86652]: detected max file descriptor number: 2048 Jul 14 10:38:23.175355 dv-cinder-846146-7-smb devstack@keystone.service[86652]: lock engine: pthread robust mutexes Jul 14 10:38:23.175355 dv-cinder-846146-7-smb devstack@keystone.service[86652]: thunder lock: enabled Jul 14 10:38:23.176142 dv-cinder-846146-7-smb devstack@keystone.service[86652]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Jul 14 10:38:23.176142 dv-cinder-846146-7-smb devstack@keystone.service[86652]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jul 14 10:38:23.219899 dv-cinder-846146-7-smb devstack@keystone.service[86652]: Python main interpreter initialized at 0x55ab22cbf9c0 Jul 14 10:38:23.219899 dv-cinder-846146-7-smb devstack@keystone.service[86652]: python threads support enabled Jul 14 10:38:23.219899 dv-cinder-846146-7-smb devstack@keystone.service[86652]: your server socket listen backlog is limited to 100 connections Jul 14 10:38:23.219899 dv-cinder-846146-7-smb devstack@keystone.service[86652]: your mercy for graceful operations on workers is 90 seconds Jul 14 10:38:23.220244 dv-cinder-846146-7-smb devstack@keystone.service[86652]: mapped 403077 bytes (393 KB) for 2 cores Jul 14 10:38:23.220317 dv-cinder-846146-7-smb devstack@keystone.service[86652]: *** Operational MODE: preforking *** Jul 14 10:38:23.220593 dv-cinder-846146-7-smb devstack@keystone.service[86652]: *** uWSGI is running in multiple interpreter mode *** Jul 14 10:38:23.220593 dv-cinder-846146-7-smb devstack@keystone.service[86652]: spawned uWSGI master process (pid: 86652) Jul 14 10:38:23.220810 dv-cinder-846146-7-smb systemd[1]: Started Devstack devstack@keystone.service. Jul 14 10:38:23.221478 dv-cinder-846146-7-smb devstack@keystone.service[86652]: spawned uWSGI worker 1 (pid: 86655, cores: 1) Jul 14 10:38:23.223603 dv-cinder-846146-7-smb devstack@keystone.service[86652]: spawned uWSGI worker 2 (pid: 86656, cores: 1) Jul 14 10:38:23.223603 dv-cinder-846146-7-smb devstack@keystone.service[86652]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 14 10:38:28.713859 dv-cinder-846146-7-smb devstack@keystone.service[86656]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 14 10:38:28.713859 dv-cinder-846146-7-smb devstack@keystone.service[86656]: from cryptography.utils import int_from_bytes Jul 14 10:38:28.714656 dv-cinder-846146-7-smb devstack@keystone.service[86656]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 14 10:38:28.714656 dv-cinder-846146-7-smb devstack@keystone.service[86656]: from cryptography.utils import int_from_bytes Jul 14 10:38:28.714978 dv-cinder-846146-7-smb devstack@keystone.service[86655]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 14 10:38:28.714978 dv-cinder-846146-7-smb devstack@keystone.service[86655]: from cryptography.utils import int_from_bytes Jul 14 10:38:28.715439 dv-cinder-846146-7-smb devstack@keystone.service[86655]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 14 10:38:28.715439 dv-cinder-846146-7-smb devstack@keystone.service[86655]: from cryptography.utils import int_from_bytes Jul 14 10:38:28.763738 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=86656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 14 10:38:28.763914 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=86656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 14 10:38:28.764066 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=86655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 14 10:38:28.764163 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG uwsgi [-] command line args: [] {{(pid=86656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 14 10:38:28.764269 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=86655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 14 10:38:28.764349 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=86656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 14 10:38:28.764463 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG uwsgi [-] command line args: [] {{(pid=86655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 14 10:38:28.764547 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG uwsgi [-] ================================================================================ {{(pid=86656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 14 10:38:28.764736 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=86655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 14 10:38:28.764847 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG uwsgi [-] admin_token = **** {{(pid=86656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:38:28.764950 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG uwsgi [-] ================================================================================ {{(pid=86655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 14 10:38:28.765036 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG uwsgi [-] config_dir = [] {{(pid=86656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:38:28.765190 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=86656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:38:28.765275 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG uwsgi [-] admin_token = **** {{(pid=86655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:38:28.765372 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG uwsgi [-] config_source = [] {{(pid=86656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:38:28.765454 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG uwsgi [-] config_dir = [] {{(pid=86655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:38:28.765551 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG uwsgi [-] debug = True {{(pid=86656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:38:28.765636 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=86655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:38:28.765747 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=86656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:38:28.766044 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG uwsgi [-] config_source = [] {{(pid=86655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:38:28.766044 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG uwsgi [-] debug = True {{(pid=86655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:38:28.766240 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=86656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:38:28.766346 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=86655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:38:28.766475 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG uwsgi [-] insecure_debug = False {{(pid=86656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:38:28.766572 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=86655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:38:28.766675 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=86656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:38:28.766776 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG uwsgi [-] insecure_debug = False {{(pid=86655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:38:28.766883 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=86656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:38:28.766986 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=86655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:38:28.767095 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG uwsgi [-] list_limit = None {{(pid=86656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:38:28.767190 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=86655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:38:28.767285 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG uwsgi [-] log_config_append = None {{(pid=86656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:38:28.767383 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG uwsgi [-] list_limit = None {{(pid=86655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:38:28.767503 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:38:28.767611 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG uwsgi [-] log_config_append = None {{(pid=86655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:38:28.767712 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG uwsgi [-] log_dir = None {{(pid=86656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:38:28.767807 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:38:28.767907 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG uwsgi [-] log_file = None {{(pid=86656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:38:28.768011 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG uwsgi [-] log_dir = None {{(pid=86655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:38:28.768099 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=86656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:38:28.768217 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG uwsgi [-] log_file = None {{(pid=86655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:38:28.768291 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=86656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:38:28.768404 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=86655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:38:28.768484 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=86656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:38:28.768604 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=86655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:38:28.768690 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:38:28.768764 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=86655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:38:28.768915 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:38:28.768999 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:38:28.769072 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:38:28.769149 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:38:28.769220 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:38:28.769348 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:38:28.769471 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:38:28.769551 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:38:28.769673 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=86656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:38:28.769766 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:38:28.769839 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=86656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:38:28.769953 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=86655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:38:28.770034 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=86656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:38:28.770104 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=86655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:38:28.770233 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=86656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:38:28.770319 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=86655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:38:28.770479 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=86656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:38:28.770657 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=86655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:38:28.771377 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=86655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:38:28.771874 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG uwsgi [-] notification_format = cadf {{(pid=86656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:38:28.771967 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG uwsgi [-] notification_format = cadf {{(pid=86655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:38:28.772051 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=86656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:38:28.772175 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=86655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:38:28.772257 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.16/identity {{(pid=86656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:38:28.772381 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.16/identity {{(pid=86655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:38:28.772469 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG uwsgi [-] publish_errors = False {{(pid=86656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:38:28.772585 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG uwsgi [-] publish_errors = False {{(pid=86655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:38:28.772665 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=86656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:38:28.772741 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=86655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:38:28.772849 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=86656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:38:28.772996 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=86655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:38:28.773074 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=86656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:38:28.773191 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=86655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:38:28.773264 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=86656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:38:28.773414 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=86655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:38:28.773500 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=86656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:38:28.773652 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=86655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:38:28.773729 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG uwsgi [-] standard_threads = False {{(pid=86656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:38:28.773890 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG uwsgi [-] standard_threads = False {{(pid=86655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:38:28.773968 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG uwsgi [-] strict_password_check = False {{(pid=86656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:38:28.774134 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG uwsgi [-] strict_password_check = False {{(pid=86655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:38:28.774212 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=86656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:38:28.774318 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG uwsgi [-] use_eventlog = False {{(pid=86656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:38:28.774401 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=86655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:38:28.774479 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG uwsgi [-] use_journal = False {{(pid=86656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:38:28.774549 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG uwsgi [-] use_eventlog = False {{(pid=86655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:38:28.774659 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG uwsgi [-] use_json = False {{(pid=86656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:38:28.774737 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG uwsgi [-] use_journal = False {{(pid=86655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:38:28.774835 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG uwsgi [-] use_stderr = False {{(pid=86656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:38:28.774911 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG uwsgi [-] use_json = False {{(pid=86655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:38:28.775011 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG uwsgi [-] use_syslog = False {{(pid=86656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:38:28.775102 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG uwsgi [-] use_stderr = False {{(pid=86655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:38:28.775181 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG uwsgi [-] use_syslog = False {{(pid=86655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:38:28.775251 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG uwsgi [-] watch_log_file = False {{(pid=86656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:38:28.775406 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG uwsgi [-] watch_log_file = False {{(pid=86655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:38:28.775482 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=86656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.775663 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=86655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.775748 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=86656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.775905 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=86655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.775981 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=86656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.776169 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=86655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.776287 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=86656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.776400 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=86655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.776522 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=86656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.776651 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=86656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.776759 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=86655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.776912 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=86655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.777017 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=86656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.777154 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=86656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.777265 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=86655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.777392 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=86655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.777495 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=86656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.777639 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=86656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.777742 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=86655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.777888 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=86655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.778003 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=86656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.778108 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=86656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.778202 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=86655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.778358 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.778463 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=86655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.778595 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=86656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.778707 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.778833 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=86655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.778949 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=86656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.779080 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.779182 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=86655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.779320 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.779516 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.779634 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.779753 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.779867 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.779979 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=86656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.780091 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=86655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.780221 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=86656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.780342 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=86656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.780455 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=86655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.780569 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=86655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.780694 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=86656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.780854 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=86655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.780982 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.781097 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=86656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.781208 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.781319 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.781431 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=86655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.781545 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.781673 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.781788 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.781907 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.782471 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=86656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.782548 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.782627 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.782704 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=86655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.782775 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=86656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.782842 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.782910 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=86656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.782986 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=86655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.783062 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=86656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.783132 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=86655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.783200 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=86656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.783267 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=86655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.783335 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=86656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.783410 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=86655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.783517 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=86656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.783595 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=86655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.783754 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=86656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.783831 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=86655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.784001 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=86656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.784086 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=86655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.784235 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=86656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.784311 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=86655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.784472 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=86656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.784548 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=86655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.784714 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=86655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.784893 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=86656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.784971 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=86656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.785039 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=86655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.785187 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=86656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.785270 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=86655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.785420 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=86656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.785504 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=86655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.785652 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=86655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.785727 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=86656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.785886 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=86655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.785970 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=86656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.786127 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=86655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.786250 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=86656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.786747 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=86656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.786842 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=86655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.786915 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=86656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.786983 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=86655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.787052 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=86656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.787131 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=86655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.787203 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=86656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.787271 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=86655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.787339 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=86656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.787407 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=86655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.787506 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=86656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.787591 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=86655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.787738 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=86656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.787845 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=86655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.787980 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.788084 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=86655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.788210 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.788319 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.788504 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.788623 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.788710 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.788889 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.788965 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.789099 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.789182 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=86656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.789254 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.789376 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=86655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.789454 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=86656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.789617 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.789711 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=86655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.789855 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.789934 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=86656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.790088 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=86656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.790178 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=86655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.790323 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=86655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.790409 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=86656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.790575 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=86656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.790660 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=86655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.790809 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=86656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.790902 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=86655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.791064 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=86656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.791153 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=86655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.791282 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=86656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.791368 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=86655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.791535 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=86655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.791652 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=86656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.791768 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=86656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.791861 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=86655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.792034 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=86656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.792138 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=86655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.792287 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=86656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.792384 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=86655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.792504 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=86656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.792589 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=86655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.792753 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=86656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.792861 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=86655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.792999 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=86656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.793082 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=86655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.793246 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=86655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.793365 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG uwsgi [-] cache.enabled = True {{(pid=86656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.793606 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG uwsgi [-] cache.enabled = True {{(pid=86655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.793692 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=86656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.793858 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=86656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.793930 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=86655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.794089 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=86655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.794173 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=86656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.794330 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=86656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.794406 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=86655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.794655 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.794741 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=86655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.794802 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=86656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.794872 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.795031 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=86656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.795104 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=86655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.795268 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=86655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.795334 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=86656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.795509 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=86655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.795575 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=86656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.795767 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=86656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.795844 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=86655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.796011 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=86656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.796077 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=86655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.796252 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=86656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.796317 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=86655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.796492 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=86655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.796567 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=86656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.797260 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=86656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.797355 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=86655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.797428 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=86656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.797487 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=86655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.797788 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=86656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.797935 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=86655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.798038 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=86656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.798124 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=86655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.798199 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=86656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.798271 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=86655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.798330 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=86656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.798387 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=86655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.798467 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=86656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.798544 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=86655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.798616 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=86656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.798691 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=86655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.798758 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=86656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.798758 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=86656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.798887 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=86655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.799011 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=86656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.799090 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=86655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.799251 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=86656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.799328 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=86655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.799504 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=86655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.799590 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=86656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.799758 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=86655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.799850 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=86656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.799994 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=86656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.800072 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=86655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.800228 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG uwsgi [-] auth.external = None {{(pid=86656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.800314 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=86655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.800461 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG uwsgi [-] auth.mapped = None {{(pid=86656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.800545 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=86655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.800718 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG uwsgi [-] auth.external = None {{(pid=86655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.800838 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=86656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.800996 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG uwsgi [-] auth.mapped = None {{(pid=86655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.801114 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=86656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.801229 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG uwsgi [-] auth.password = None {{(pid=86656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.801332 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=86655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.801460 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG uwsgi [-] auth.token = None {{(pid=86656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.801546 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=86655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.801700 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=86656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.801779 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG uwsgi [-] auth.password = None {{(pid=86655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.802021 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG uwsgi [-] catalog.caching = True {{(pid=86656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.802466 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG uwsgi [-] auth.token = None {{(pid=86655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.802607 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=86656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.802689 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=86655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.802809 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=86656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.802926 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG uwsgi [-] catalog.caching = True {{(pid=86655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.803015 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=86656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.803090 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=86655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.803160 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=86656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.803238 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=86655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.803311 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=86656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.803381 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=86655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.803459 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG uwsgi [-] credential.caching = True {{(pid=86656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.803531 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=86655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.803602 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG uwsgi [-] credential.driver = sql {{(pid=86656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.803672 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=86655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.803808 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=86656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.803889 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG uwsgi [-] credential.caching = True {{(pid=86655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.804055 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=86656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.804135 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG uwsgi [-] credential.driver = sql {{(pid=86655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.804292 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=86656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.804370 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=86655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.804534 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=86656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.804665 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=86655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.804751 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=86656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.804888 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=86655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.805061 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=86655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.805140 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=86656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.805306 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=86655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.805385 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=86656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.805550 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=86656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.805629 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=86655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.805805 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=86656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.805884 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=86655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.806050 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=86655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.806128 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=86656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.806308 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=86655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.806389 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=86656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.806578 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=86656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.806656 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=86655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.806824 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=86656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.806902 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=86655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.807079 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=86656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.807159 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=86655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.807315 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG uwsgi [-] federation.caching = True {{(pid=86656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.807392 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=86655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.807555 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=86656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.807632 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=86655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.807798 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG uwsgi [-] federation.caching = True {{(pid=86655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.807876 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG uwsgi [-] federation.driver = sql {{(pid=86656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.808042 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=86655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.808121 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=86656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.808271 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=86656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.808348 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG uwsgi [-] federation.driver = sql {{(pid=86655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.808517 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=86656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.808597 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=86655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.808750 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=86655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.808865 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=86656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.809025 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=86656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.809103 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=86655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.809264 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=86655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.809345 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=86656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.809514 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=86656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.809592 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=86655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.809751 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=86656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.809830 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=86655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.809998 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=86656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.810078 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=86655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.810235 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG uwsgi [-] identity.caching = True {{(pid=86656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.810314 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=86655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.810485 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=86655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.810563 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=86656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.810714 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG uwsgi [-] identity.caching = True {{(pid=86655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.810789 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=86656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.810953 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=86656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.811032 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=86655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.811189 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=86656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.811268 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=86655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.811427 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=86655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.811507 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG uwsgi [-] identity.driver = sql {{(pid=86656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.811656 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=86656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.811733 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=86655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.811895 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=86656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.811982 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG uwsgi [-] identity.driver = sql {{(pid=86655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.812127 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=86655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.812205 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=86656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.812370 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=86655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.812448 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=86656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.812599 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=86656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.812684 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=86655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.812857 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=86656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.812942 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=86655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.813092 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=86656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.813171 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=86655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.813334 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=86655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.813679 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=86656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.813831 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=86655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.813911 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=86656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.814074 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=86656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.814153 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=86655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.814323 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=86655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.814409 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=86656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.814566 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=86656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.814644 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=86655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.814831 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=86655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.814933 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=86656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.815071 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=86656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.815168 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=86655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.815308 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=86656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.815396 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=86655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.815541 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=86656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.815628 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=86655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.815779 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=86656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.815875 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=86655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.816009 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=86656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.816095 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=86655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.816243 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=86656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.816329 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=86655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.816474 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=86655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.816573 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=86656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.816712 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=86655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.816834 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=86656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.816983 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=86655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.817070 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=86656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.817213 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=86656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.817311 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=86655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.817967 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=86656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.818057 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=86655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.818220 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=86655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.818296 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=86656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.818450 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=86656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.818562 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=86655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.818698 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=86656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.818799 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=86655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.818933 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=86655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.819012 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=86656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.819162 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=86656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.819256 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=86655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.819402 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=86656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.819481 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=86655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.819633 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG uwsgi [-] ldap.password = **** {{(pid=86656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.819711 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=86655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.819871 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=86656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.819958 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=86655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.820107 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG uwsgi [-] ldap.password = **** {{(pid=86655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.820185 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=86656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.820349 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=86655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.820429 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=86656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.820589 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=86656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.820679 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=86655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.820849 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=86656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.820933 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=86655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.821091 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=86655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.821169 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=86656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.821334 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=86655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.821428 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=86656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.821565 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=86656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.821644 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=86655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.821798 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=86656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.821877 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=86655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.822045 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=86655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.822132 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=86656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.822280 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=86655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.822359 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=86656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.822514 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=86656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.822591 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=86655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.822751 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=86656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.822838 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=86655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.822988 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=86656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.823073 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=86655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.823218 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG uwsgi [-] ldap.user = None {{(pid=86656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.823297 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=86655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.823456 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=86655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.823542 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=86656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.823691 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG uwsgi [-] ldap.user = None {{(pid=86655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.823777 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=86656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.823931 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=86656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.824009 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=86655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.824177 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=86656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.824264 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=86655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.824410 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=86655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.824488 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=86656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.824659 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=86655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.824738 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=86656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.824917 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=86656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.825149 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=86656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.825351 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=86655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.825431 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=86656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.825607 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=86656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.825685 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=86655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.825848 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=86655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.825927 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=86656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.826077 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=86656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.826154 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=86655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.826322 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=86655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.826400 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=86656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.826561 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=86655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.826642 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=86656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.826804 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=86655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.826884 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=86656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.827037 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=86655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.827123 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=86656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.827280 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=86656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.827359 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=86655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.827509 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=86656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.827587 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=86655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.827754 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=86656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.827832 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=86655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.827992 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=86656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.828071 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=86655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.828227 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=86656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.828305 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=86655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.828458 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=86655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.828535 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=86656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.828691 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=86656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.828832 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=86655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.828960 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=86656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.829040 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=86655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.829199 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=86655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.829276 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=86656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.829432 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=86656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.829512 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=86655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.829668 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=86655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.829746 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG uwsgi [-] policy.driver = sql {{(pid=86656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.829901 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=86656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.829979 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=86655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.830145 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=86656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.830225 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=86655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.830380 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=86656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.830459 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=86655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.830615 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG uwsgi [-] receipt.caching = True {{(pid=86656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.830698 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG uwsgi [-] policy.driver = sql {{(pid=86655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.830851 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=86655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.830930 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=86656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.831093 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=86656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.831170 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=86655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.831328 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=86655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.831405 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=86656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.831558 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=86656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.831636 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG uwsgi [-] receipt.caching = True {{(pid=86655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.831794 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=86655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.831872 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=86656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.832030 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG uwsgi [-] resource.caching = True {{(pid=86656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.832107 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=86655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.832271 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=86655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.832350 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=86656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.832505 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=86655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.832584 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG uwsgi [-] resource.driver = sql {{(pid=86656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.832749 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=86656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.832854 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=86655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.833020 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG uwsgi [-] resource.caching = True {{(pid=86655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.834152 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=86656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.834152 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=86656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.834359 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=86655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.834436 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG uwsgi [-] revoke.caching = True {{(pid=86656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.834508 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG uwsgi [-] resource.driver = sql {{(pid=86655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.834631 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=86656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.834713 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=86655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.834786 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=86656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.834856 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=86655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.834926 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG uwsgi [-] role.cache_time = None {{(pid=86656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.834996 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=86655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.835150 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG uwsgi [-] role.caching = True {{(pid=86656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.835276 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG uwsgi [-] revoke.caching = True {{(pid=86655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.835359 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG uwsgi [-] role.driver = sql {{(pid=86656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.835431 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=86655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.835502 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG uwsgi [-] role.list_limit = None {{(pid=86656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.835572 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=86655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.835699 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=86656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.835779 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG uwsgi [-] role.cache_time = None {{(pid=86655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.835956 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=86656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.836034 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG uwsgi [-] role.caching = True {{(pid=86655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.836203 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=86656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.836282 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG uwsgi [-] role.driver = sql {{(pid=86655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.836438 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG uwsgi [-] role.list_limit = None {{(pid=86655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.836557 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=86656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.836687 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=86656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.836828 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=86655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.836974 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=86656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.837054 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=86655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.837233 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=86656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.837333 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=86655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.837466 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=86656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.837550 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=86655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.837698 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=86656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.837785 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=86655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.837944 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=86656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.838023 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=86655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.838191 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=86656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.838271 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=86655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.838438 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=86656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.838524 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=86655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.838671 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=86655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.838749 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=86656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.838922 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=86655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.839090 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=86656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.839170 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=86655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.839328 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=86656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.839407 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=86655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.839577 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=86656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.839657 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=86655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.839826 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=86656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.840044 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=86655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.840131 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=86656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.840284 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=86655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.840363 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=86656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.840529 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=86656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.840607 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=86655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.840793 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=86655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.840901 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=86656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.841054 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=86655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.841140 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=86656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.841292 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=86656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.841371 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=86655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.841525 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=86656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.841612 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=86655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.841757 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=86656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.841837 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=86655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.841988 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=86656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.842067 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=86655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.842240 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=86656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.842327 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=86655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.842472 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=86655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.842551 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=86656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.842706 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=86655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.842785 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=86656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.842941 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=86655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.843028 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=86656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.843178 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=86656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.843256 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=86655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.843410 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG uwsgi [-] token.cache_time = None {{(pid=86656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.843489 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=86655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.843645 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG uwsgi [-] token.caching = True {{(pid=86656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.843725 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=86655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.843883 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=86656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.843962 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=86655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.844127 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=86655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.844205 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG uwsgi [-] token.provider = fernet {{(pid=86656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.844360 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=86656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.844440 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG uwsgi [-] token.cache_time = None {{(pid=86655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.844596 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG uwsgi [-] token.caching = True {{(pid=86655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.844674 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=86656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.844864 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=86655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.844948 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=86656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.845099 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=86656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.845179 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG uwsgi [-] token.provider = fernet {{(pid=86655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.845343 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=86656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.845422 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=86655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.845586 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=86656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.845729 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=86655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.845836 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=86655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.845916 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG uwsgi [-] trust.driver = sql {{(pid=86656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.846075 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=86656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.846153 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=86655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.846317 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=86656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.846396 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=86655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.846560 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=86655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.846640 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=86656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.846808 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=86656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.846886 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG uwsgi [-] trust.driver = sql {{(pid=86655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.847055 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=86655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.847134 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=86656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.847284 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=86656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.847364 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=86655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.847527 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=86656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.847606 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=86655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.847776 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=86655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.847854 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=86656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.848035 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=86655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.848115 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG uwsgi [-] database.connection = **** {{(pid=86656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.848272 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=86655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.848360 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=86656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.848518 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=86655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.848597 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=86656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.848809 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=86656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.849350 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=86655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.849450 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=86656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.849527 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG uwsgi [-] database.connection = **** {{(pid=86655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.849608 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=86656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.849688 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=86655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.849688 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=86655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.849819 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=86656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.849921 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=86655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.850010 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=86656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.850168 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=86655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.850248 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=86656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.850408 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=86655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.850487 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=86656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.850650 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=86655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.850737 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=86656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.850889 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=86655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.850970 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=86656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.851129 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=86655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.851209 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=86656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.851380 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=86655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.851468 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=86656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.851616 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=86656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.851694 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=86655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.851863 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=86655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.851941 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=86656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.852091 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=86656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.852177 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=86655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.852333 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=86656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.852412 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=86655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.852569 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=86656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.852648 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=86655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.852740 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=86656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 14 10:38:28.852855 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=86655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.853062 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=86655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.853305 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=86655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.853544 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=86655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:38:28.853717 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=86655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 14 10:38:28.883876 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=86656) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 10:38:28.884100 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=86656) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 10:38:28.884337 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=86656) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 10:38:28.886175 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=86655) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 10:38:28.886414 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=86655) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 10:38:28.886644 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=86655) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 10:38:28.892780 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=86656) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 10:38:28.895165 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=86655) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 10:38:28.921362 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=86656) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 10:38:28.921591 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=86656) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 10:38:28.921945 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=86655) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 10:38:28.922180 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=86655) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 10:38:29.066889 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=86655) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 10:38:29.067263 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=86656) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 10:38:29.116517 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=86655) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 10:38:29.116750 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=86655) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 10:38:29.116879 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=86656) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 10:38:29.117009 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=86656) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 10:38:29.181740 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=86655) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 10:38:29.181968 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=86656) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 10:38:29.182072 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=86655) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 10:38:29.182192 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=86655) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 10:38:29.182286 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=86656) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 10:38:29.182414 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=86655) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 10:38:29.182495 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=86656) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 10:38:29.182633 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=86656) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 10:38:29.182712 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=86655) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 10:38:29.182849 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=86655) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 10:38:29.182929 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=86656) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 10:38:29.183060 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=86656) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 10:38:29.208001 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=86656) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 10:38:29.208907 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=86656) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 10:38:29.209020 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=86655) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 10:38:29.209186 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=86655) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 10:38:29.209318 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=86656) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 10:38:29.209422 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=86655) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 10:38:29.209499 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=86656) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 10:38:29.209621 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=86655) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 10:38:29.209706 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=86656) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 10:38:29.209835 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=86656) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 10:38:29.209916 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=86655) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 10:38:29.210050 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=86656) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 10:38:29.210131 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=86655) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 10:38:29.210265 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=86655) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 10:38:29.221060 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=86656) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 10:38:29.221333 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=86655) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 10:38:29.233830 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=86656) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 10:38:29.234076 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=86656) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 10:38:29.234188 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=86655) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 10:38:29.234268 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=86656) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 10:38:29.234403 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=86655) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 10:38:29.234486 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=86656) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 10:38:29.234629 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=86655) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 10:38:29.234720 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=86656) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 10:38:29.234850 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=86655) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 10:38:29.234934 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=86656) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 10:38:29.235066 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=86655) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 10:38:29.235149 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=86656) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 10:38:29.235280 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=86655) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 10:38:29.235495 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=86655) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 10:38:29.252882 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=86656) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 10:38:29.253097 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=86656) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 14 10:38:29.253207 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=86655) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 10:38:29.253424 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=86655) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 14 10:38:29.253939 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=86656) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 10:38:29.254023 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=86655) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 10:38:29.254147 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=86656) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 14 10:38:29.254229 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=86655) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 14 10:38:29.254417 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=86656) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 10:38:29.254499 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=86655) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 10:38:29.254676 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=86655) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 10:38:29.254758 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=86656) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 10:38:29.254946 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=86656) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 10:38:29.255084 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=86655) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 10:38:29.255295 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=86655) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 10:38:29.255384 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=86656) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 10:38:29.266104 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=86655) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 10:38:29.266373 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=86656) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 10:38:29.266454 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=86655) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 10:38:29.266636 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=86655) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 10:38:29.266716 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=86656) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 10:38:29.266900 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=86656) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 10:38:29.266980 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=86655) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 10:38:29.267178 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=86656) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 10:38:29.275717 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=86655) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 10:38:29.276233 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=86656) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 10:38:29.279026 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=86655) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 10:38:29.279307 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=86655) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 10:38:29.279530 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=86656) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 10:38:29.279613 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=86655) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 10:38:29.279807 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=86656) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 10:38:29.279900 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=86655) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 10:38:29.280087 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=86656) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 10:38:29.280168 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=86655) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 10:38:29.280366 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=86656) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 10:38:29.280447 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=86655) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 10:38:29.280630 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=86655) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 10:38:29.280711 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=86656) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 10:38:29.280913 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=86656) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 10:38:29.280995 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=86655) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 10:38:29.281180 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=86656) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 10:38:29.281260 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=86655) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 10:38:29.281448 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=86655) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 10:38:29.281529 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=86656) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 10:38:29.281715 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=86656) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 10:38:29.281794 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=86655) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 10:38:29.281984 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=86656) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 10:38:29.282250 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=86656) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 10:38:29.308992 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=86655) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 10:38:29.309229 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=86656) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 10:38:29.310610 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=86655) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 10:38:29.310837 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=86656) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 10:38:29.310933 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=86655) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 10:38:29.311116 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=86656) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 10:38:29.316383 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=86655) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 10:38:29.316607 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=86656) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 10:38:29.316689 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=86655) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 10:38:29.316954 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=86656) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 10:38:29.317052 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=86655) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 10:38:29.317193 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=86656) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 10:38:29.324495 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=86655) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 10:38:29.324593 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=86656) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 10:38:29.324790 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=86655) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 10:38:29.324888 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=86656) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 10:38:29.329297 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=86655) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 10:38:29.329382 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=86656) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 10:38:29.329585 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=86655) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 10:38:29.329668 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=86656) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 10:38:29.329868 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=86655) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 10:38:29.329952 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=86656) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 10:38:29.330147 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=86656) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 10:38:29.330227 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=86655) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 10:38:29.330421 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=86655) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 10:38:29.330501 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=86656) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 10:38:29.330695 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=86656) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 10:38:29.330776 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=86655) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 10:38:29.330964 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=86656) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 10:38:29.331046 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=86655) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 10:38:29.331229 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=86656) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 10:38:29.331327 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=86655) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 10:38:29.350323 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=86656) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 10:38:29.350598 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=86656) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 10:38:29.350681 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=86655) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 10:38:29.350931 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=86655) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 10:38:29.355462 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=86656) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 10:38:29.355558 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=86655) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 10:38:29.359148 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=86656) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 10:38:29.359233 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=86655) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 10:38:29.359445 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=86656) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 10:38:29.359539 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=86655) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 10:38:29.364632 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=86655) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 10:38:29.364714 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=86656) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 10:38:29.368275 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=86655) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 10:38:29.368358 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=86656) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 10:38:29.371945 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=86655) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 10:38:29.372041 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=86656) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 10:38:29.372250 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=86656) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 10:38:29.372330 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=86655) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 10:38:29.372541 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=86656) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 10:38:29.372622 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=86655) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 10:38:29.372847 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=86655) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 10:38:29.372931 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=86656) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 10:38:29.373140 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=86656) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 10:38:29.373221 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=86655) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 10:38:29.373416 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=86655) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 10:38:29.373508 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=86656) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 10:38:29.392956 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=86655) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 10:38:29.393050 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=86656) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 10:38:29.393240 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=86655) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 10:38:29.393321 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=86656) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 10:38:29.393508 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=86655) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 10:38:29.393589 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=86656) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 10:38:29.393768 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=86656) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 10:38:29.393847 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=86655) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 10:38:29.401772 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=86656) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 10:38:29.401942 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=86655) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 10:38:29.403474 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=86656) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 10:38:29.403596 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=86655) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 10:38:29.403751 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=86656) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 10:38:29.403832 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=86655) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 10:38:29.406949 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=86656) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 10:38:29.407046 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=86655) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 10:38:29.407230 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=86655) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 10:38:29.407311 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=86656) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 10:38:29.407510 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=86656) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 10:38:29.407598 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=86655) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 10:38:29.407788 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=86655) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 10:38:29.407878 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=86656) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 10:38:29.408073 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=86656) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 10:38:29.408154 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=86655) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 10:38:29.421832 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=86656) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 10:38:29.421947 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=86655) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 10:38:29.422110 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=86656) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 10:38:29.422200 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=86655) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 10:38:29.422387 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=86656) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 10:38:29.422470 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=86655) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 10:38:29.422678 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=86655) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 10:38:29.422760 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=86656) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 10:38:29.422956 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=86656) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 10:38:29.423044 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=86655) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 10:38:29.423239 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=86656) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 10:38:29.423330 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=86655) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 10:38:29.423513 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=86655) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 10:38:29.423594 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=86656) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 10:38:29.443476 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=86655) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 10:38:29.443579 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=86656) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 10:38:29.446757 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=86656) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 10:38:29.446850 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=86655) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 10:38:29.450097 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=86656) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 10:38:29.450184 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=86655) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 10:38:29.451683 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=86656) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 10:38:29.451937 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=86655) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 10:38:29.453466 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=86656) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 10:38:29.453748 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=86656) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 10:38:29.453918 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=86655) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 10:38:29.454050 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=86656) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 10:38:29.454259 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=86655) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 10:38:29.454554 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=86655) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 10:38:29.462519 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=86655) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 10:38:29.462918 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=86656) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 10:38:29.464294 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=86655) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 10:38:29.465801 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=86656) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 10:38:29.467547 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=86655) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 10:38:29.467839 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=86655) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 10:38:29.468124 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=86655) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 10:38:29.468403 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=86655) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 10:38:29.469063 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=86656) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 10:38:29.469354 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=86656) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 10:38:29.469639 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=86656) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 10:38:29.469923 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=86656) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 10:38:29.477841 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=86655) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 10:38:29.478128 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=86655) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 10:38:29.478408 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=86655) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 10:38:29.479128 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=86656) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 10:38:29.479411 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=86656) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 10:38:29.479687 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=86656) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 10:38:29.486292 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=86655) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 10:38:29.486577 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=86655) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 10:38:29.486864 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=86655) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 10:38:29.487144 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=86655) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 10:38:29.487417 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=86655) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 10:38:29.487541 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=86656) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 10:38:29.487706 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=86655) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 10:38:29.487822 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=86656) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 10:38:29.487983 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=86655) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 10:38:29.488104 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=86656) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 10:38:29.488256 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=86655) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 10:38:29.488380 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=86656) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 10:38:29.488637 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=86655) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 10:38:29.488728 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=86656) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 10:38:29.488942 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=86655) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 10:38:29.489024 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=86656) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 10:38:29.489215 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=86656) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 10:38:29.489345 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=86655) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 10:38:29.489515 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=86656) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 10:38:29.489666 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=86655) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 10:38:29.489889 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=86656) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 10:38:29.490032 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=86655) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 10:38:29.490183 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=86656) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 10:38:29.490314 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=86655) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 10:38:29.490441 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=86656) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 10:38:29.490682 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=86656) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 10:38:29.490948 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=86656) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 10:38:29.491216 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=86656) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 10:38:29.528964 dv-cinder-846146-7-smb devstack@keystone.service[86655]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55ab22cbf9c0 pid: 86655 (default app) Jul 14 10:38:29.529835 dv-cinder-846146-7-smb devstack@keystone.service[86656]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55ab22cbf9c0 pid: 86656 (default app) Jul 14 10:38:29.532354 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91548c7-a7a2-4501-9004-56c9dd1b987d None None] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:38:29.532652 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91548c7-a7a2-4501-9004-56c9dd1b987d None None] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:38:29.532973 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91548c7-a7a2-4501-9004-56c9dd1b987d None None] PATH_INFO: `/v3` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:38:29.537397 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 1/1] 10.222.0.16 () {50 vars in 791 bytes} [Thu Jul 14 10:38:29 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:38:37.174624 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4cf79c-cb42-4ee1-8419-4b97c133c2c2 None None] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:38:37.175182 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4cf79c-cb42-4ee1-8419-4b97c133c2c2 None None] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:38:37.175182 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4cf79c-cb42-4ee1-8419-4b97c133c2c2 None None] PATH_INFO: `/` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:38:37.179517 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 1/2] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jul 14 10:38:37 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 14 10:38:37.184671 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e9bbaa-d7a1-4583-816e-8c9d7d0e2e90 None None] REQUEST_METHOD: `POST` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:38:37.185130 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e9bbaa-d7a1-4583-816e-8c9d7d0e2e90 None None] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:38:37.185264 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e9bbaa-d7a1-4583-816e-8c9d7d0e2e90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:38:37.254420 dv-cinder-846146-7-smb devstack@keystone.service[86655]: INFO dbcounter [None req-e7e9bbaa-d7a1-4583-816e-8c9d7d0e2e90 None None] Registered counter for database keystone Jul 14 10:38:37.275918 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG oslo_db.sqlalchemy.engines [None req-e7e9bbaa-d7a1-4583-816e-8c9d7d0e2e90 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86655) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 14 10:38:37.282143 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writer thread running {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 14 10:38:37.457631 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG passlib.handlers.bcrypt [None req-e7e9bbaa-d7a1-4583-816e-8c9d7d0e2e90 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=86655) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jul 14 10:38:37.458009 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG passlib.handlers.bcrypt [None req-e7e9bbaa-d7a1-4583-816e-8c9d7d0e2e90 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=86655) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jul 14 10:38:37.513160 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.auth.core [None req-e7e9bbaa-d7a1-4583-816e-8c9d7d0e2e90 None None] MFA Rules not processed for user `ae4bcdd8106d4bebbdcae96be33505bc`. Rule list: `[]` (Enabled: `True`). {{(pid=86655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:38:37.514771 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-e7e9bbaa-d7a1-4583-816e-8c9d7d0e2e90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:38:37.638016 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 2/3] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jul 14 10:38:37 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 454 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jul 14 10:38:37.822225 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4cf79c-cb42-4ee1-8419-4b97c133c2c2 None None] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:38:37.893511 dv-cinder-846146-7-smb devstack@keystone.service[86656]: INFO dbcounter [None req-db4cf79c-cb42-4ee1-8419-4b97c133c2c2 None None] Registered counter for database keystone Jul 14 10:38:37.912987 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG oslo_db.sqlalchemy.engines [None req-db4cf79c-cb42-4ee1-8419-4b97c133c2c2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86656) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 14 10:38:37.919176 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writer thread running {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 14 10:38:38.039880 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4cf79c-cb42-4ee1-8419-4b97c133c2c2 None None] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:38:38.044400 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517f0b1e-7bbc-4572-8c55-bdd6476abe8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:38:38.045104 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517f0b1e-7bbc-4572-8c55-bdd6476abe8e admin admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:38:38.045395 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517f0b1e-7bbc-4572-8c55-bdd6476abe8e admin admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:38:38.045678 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517f0b1e-7bbc-4572-8c55-bdd6476abe8e admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:38:38.054412 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517f0b1e-7bbc-4572-8c55-bdd6476abe8e admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:38:38.106565 dv-cinder-846146-7-smb devstack@keystone.service[86656]: WARNING keystone.common.rbac_enforcer.enforcer [None req-517f0b1e-7bbc-4572-8c55-bdd6476abe8e admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jul 14 10:38:38.106910 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517f0b1e-7bbc-4572-8c55-bdd6476abe8e admin admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:38:38.117231 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 2/4] 10.222.0.16 () {58 vars in 1324 bytes} [Thu Jul 14 10:38:37 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 14 10:38:38.123275 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e9bbaa-d7a1-4583-816e-8c9d7d0e2e90 None None] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:38:38.138541 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e9bbaa-d7a1-4583-816e-8c9d7d0e2e90 None None] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:38:38.142873 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34810a68-c73f-40ef-82f9-80513bb7381b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:38:38.143993 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34810a68-c73f-40ef-82f9-80513bb7381b admin admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:38:38.144279 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34810a68-c73f-40ef-82f9-80513bb7381b admin admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:38:38.144557 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34810a68-c73f-40ef-82f9-80513bb7381b admin admin] PATH_INFO: `/v3/projects/7a2b7c1edcba4e118452f92cb83ff4b2` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:38:38.148641 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34810a68-c73f-40ef-82f9-80513bb7381b admin admin] RBAC: Authorizing `identity:get_project(project_id=7a2b7c1edcba4e118452f92cb83ff4b2)` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:38:38.200476 dv-cinder-846146-7-smb devstack@keystone.service[86655]: WARNING keystone.common.rbac_enforcer.enforcer [None req-34810a68-c73f-40ef-82f9-80513bb7381b admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jul 14 10:38:38.201060 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34810a68-c73f-40ef-82f9-80513bb7381b admin admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:38:38.205462 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 3/5] 10.222.0.16 () {56 vars in 1207 bytes} [Thu Jul 14 10:38:38 2022] GET /identity/v3/projects/7a2b7c1edcba4e118452f92cb83ff4b2 => generated 344 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:38:40.198247 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15643060-cba4-470d-b0c3-f7914cd5f5dc None None] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:38:40.198781 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15643060-cba4-470d-b0c3-f7914cd5f5dc None None] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:38:40.198781 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15643060-cba4-470d-b0c3-f7914cd5f5dc None None] PATH_INFO: `/` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:38:40.202924 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 3/6] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jul 14 10:38:40 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:38:40.208263 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a519a9-5b34-4263-b5c2-b91b22e4d33e None None] REQUEST_METHOD: `POST` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:38:40.209199 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a519a9-5b34-4263-b5c2-b91b22e4d33e None None] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:38:40.209462 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a519a9-5b34-4263-b5c2-b91b22e4d33e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:38:40.227997 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.auth.core [None req-86a519a9-5b34-4263-b5c2-b91b22e4d33e None None] MFA Rules not processed for user `ae4bcdd8106d4bebbdcae96be33505bc`. Rule list: `[]` (Enabled: `True`). {{(pid=86655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:38:40.229541 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-86a519a9-5b34-4263-b5c2-b91b22e4d33e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:38:40.237313 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 4/7] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jul 14 10:38:40 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jul 14 10:38:40.259575 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15643060-cba4-470d-b0c3-f7914cd5f5dc None None] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:38:40.271610 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15643060-cba4-470d-b0c3-f7914cd5f5dc None None] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:38:40.275786 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878ee2fa-70a4-4cf6-a63d-cf9c5a00d5dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:38:40.276408 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878ee2fa-70a4-4cf6-a63d-cf9c5a00d5dc admin admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:38:40.276692 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878ee2fa-70a4-4cf6-a63d-cf9c5a00d5dc admin admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:38:40.276992 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878ee2fa-70a4-4cf6-a63d-cf9c5a00d5dc admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:38:40.284523 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878ee2fa-70a4-4cf6-a63d-cf9c5a00d5dc admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:38:40.286406 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878ee2fa-70a4-4cf6-a63d-cf9c5a00d5dc admin admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:38:40.294993 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 4/8] 10.222.0.16 () {58 vars in 1324 bytes} [Thu Jul 14 10:38:40 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 14 10:38:40.299954 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a519a9-5b34-4263-b5c2-b91b22e4d33e None None] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:38:40.309533 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a519a9-5b34-4263-b5c2-b91b22e4d33e None None] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:38:40.314072 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0c0ccc-1dd7-490a-8d9c-bae27d546b53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:38:40.314923 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0c0ccc-1dd7-490a-8d9c-bae27d546b53 admin admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:38:40.315205 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0c0ccc-1dd7-490a-8d9c-bae27d546b53 admin admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:38:40.315479 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0c0ccc-1dd7-490a-8d9c-bae27d546b53 admin admin] PATH_INFO: `/v3/users/ae4bcdd8106d4bebbdcae96be33505bc` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:38:40.317489 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0c0ccc-1dd7-490a-8d9c-bae27d546b53 admin admin] RBAC: Authorizing `identity:get_user(user_id=ae4bcdd8106d4bebbdcae96be33505bc)` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:38:40.319403 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0c0ccc-1dd7-490a-8d9c-bae27d546b53 admin admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:38:40.320986 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 5/9] 10.222.0.16 () {56 vars in 1198 bytes} [Thu Jul 14 10:38:40 2022] GET /identity/v3/users/ae4bcdd8106d4bebbdcae96be33505bc => generated 247 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:38:42.395214 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7d92c5-e6ae-4a4f-9174-1cd3f5a52a39 None None] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:38:42.395753 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7d92c5-e6ae-4a4f-9174-1cd3f5a52a39 None None] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:38:42.395925 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7d92c5-e6ae-4a4f-9174-1cd3f5a52a39 None None] PATH_INFO: `/` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:38:42.397326 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 5/10] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jul 14 10:38:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 14 10:38:42.402339 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a21dba-745f-4652-b56a-7b075eebc41e None None] REQUEST_METHOD: `POST` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:38:42.402725 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a21dba-745f-4652-b56a-7b075eebc41e None None] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:38:42.403008 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a21dba-745f-4652-b56a-7b075eebc41e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:38:42.419957 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.auth.core [None req-d7a21dba-745f-4652-b56a-7b075eebc41e None None] MFA Rules not processed for user `ae4bcdd8106d4bebbdcae96be33505bc`. Rule list: `[]` (Enabled: `True`). {{(pid=86655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:38:42.421150 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-d7a21dba-745f-4652-b56a-7b075eebc41e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:38:42.431056 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37b9f9a-9f0e-4e5c-9d50-e67d1d0557cd None None] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:38:42.431422 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37b9f9a-9f0e-4e5c-9d50-e67d1d0557cd None None] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:38:42.431770 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37b9f9a-9f0e-4e5c-9d50-e67d1d0557cd None None] PATH_INFO: `/` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:38:42.433219 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 6/11] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jul 14 10:38:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 14 10:38:42.438354 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bea607a-6fc8-4e72-956c-363b4082e7d2 None None] REQUEST_METHOD: `POST` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:38:42.438645 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bea607a-6fc8-4e72-956c-363b4082e7d2 None None] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:38:42.438925 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bea607a-6fc8-4e72-956c-363b4082e7d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:38:42.479479 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG passlib.handlers.bcrypt [None req-2bea607a-6fc8-4e72-956c-363b4082e7d2 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=86656) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jul 14 10:38:42.479892 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG passlib.handlers.bcrypt [None req-2bea607a-6fc8-4e72-956c-363b4082e7d2 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=86656) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jul 14 10:38:42.504748 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 6/12] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jul 14 10:38:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 10:38:42.525256 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.auth.core [None req-2bea607a-6fc8-4e72-956c-363b4082e7d2 None None] MFA Rules not processed for user `ae4bcdd8106d4bebbdcae96be33505bc`. Rule list: `[]` (Enabled: `True`). {{(pid=86656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:38:42.526849 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-2bea607a-6fc8-4e72-956c-363b4082e7d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:38:42.527853 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a21dba-745f-4652-b56a-7b075eebc41e None None] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:38:42.551654 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=100 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:38:42.627166 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 7/13] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jul 14 10:38:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 14 10:38:42.631284 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a21dba-745f-4652-b56a-7b075eebc41e None None] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:38:42.649706 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bea607a-6fc8-4e72-956c-363b4082e7d2 None None] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:38:42.664341 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1325ef39-7ab0-43cc-84c9-7bfd98b6e0a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:38:42.665178 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1325ef39-7ab0-43cc-84c9-7bfd98b6e0a4 None admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:38:42.665465 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1325ef39-7ab0-43cc-84c9-7bfd98b6e0a4 None admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:38:42.665743 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1325ef39-7ab0-43cc-84c9-7bfd98b6e0a4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:38:42.677395 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1325ef39-7ab0-43cc-84c9-7bfd98b6e0a4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 10:38:42.688803 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application [None req-1325ef39-7ab0-43cc-84c9-7bfd98b6e0a4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 10:38:42.688803 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:38:42.688803 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:38:42.688803 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:38:42.688803 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:38:42.688803 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:38:42.688803 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:38:42.688803 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:38:42.688803 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:38:42.688803 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:38:42.688803 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:38:42.688803 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:38:42.688803 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 10:38:42.688803 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 10:38:42.688803 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 10:38:42.688803 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 10:38:42.689841 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 10:38:42.689841 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 10:38:42.689841 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 10:38:42.689841 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 10:38:42.689841 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:38:42.689841 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:38:42.689841 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:38:42.689841 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:38:42.689841 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:38:42.689841 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:38:42.689841 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:38:42.689841 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application with Lock( Jul 14 10:38:42.689841 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:38:42.689841 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:38:42.689841 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:38:42.689841 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:38:42.690854 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:38:42.690854 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:38:42.690854 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:38:42.690854 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:38:42.690854 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 10:38:42.690854 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 10:38:42.690854 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 10:38:42.690854 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 10:38:42.690854 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 10:38:42.690854 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 10:38:42.690854 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 10:38:42.690854 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application Jul 14 10:38:42.690854 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 7/14] 10.222.0.16 () {56 vars in 1096 bytes} [Thu Jul 14 10:38:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 10:38:42.696316 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1325ef39-7ab0-43cc-84c9-7bfd98b6e0a4 None admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:38:42.753194 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bea607a-6fc8-4e72-956c-363b4082e7d2 None None] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:38:42.755995 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=100 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:38:42.777132 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=100 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:38:42.792535 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f269714-3604-459e-a7d5-c35847599f6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:38:42.793504 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f269714-3604-459e-a7d5-c35847599f6b None admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:38:42.793792 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f269714-3604-459e-a7d5-c35847599f6b None admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:38:42.794067 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f269714-3604-459e-a7d5-c35847599f6b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:38:42.797782 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1325ef39-7ab0-43cc-84c9-7bfd98b6e0a4 None admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:38:42.835786 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8a9af6-f99d-47cb-859f-e79eb9410beb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:38:42.836495 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8a9af6-f99d-47cb-859f-e79eb9410beb None admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:38:42.836841 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8a9af6-f99d-47cb-859f-e79eb9410beb None admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:38:42.837153 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8a9af6-f99d-47cb-859f-e79eb9410beb None admin] PATH_INFO: `/v3/roles` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:38:42.837939 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8a9af6-f99d-47cb-859f-e79eb9410beb None admin] RBAC: Adding query filter params (name=admin) {{(pid=86655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:38:42.838263 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8a9af6-f99d-47cb-859f-e79eb9410beb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:38:42.839674 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8a9af6-f99d-47cb-859f-e79eb9410beb None admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:38:42.852177 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 8/15] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Jul 14 10:38:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:38:42.857602 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8a9af6-f99d-47cb-859f-e79eb9410beb None admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:38:42.871000 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f269714-3604-459e-a7d5-c35847599f6b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:38:42.872532 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f269714-3604-459e-a7d5-c35847599f6b None admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:38:42.955443 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8a9af6-f99d-47cb-859f-e79eb9410beb None admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:38:42.971415 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 8/16] 10.222.0.16 () {58 vars in 1282 bytes} [Thu Jul 14 10:38:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 14 10:38:42.977289 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f269714-3604-459e-a7d5-c35847599f6b None admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:38:42.980054 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=100 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:38:42.990679 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1286610-d88f-4919-9905-67687a76ede8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:38:42.991595 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1286610-d88f-4919-9905-67687a76ede8 None admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:38:42.991885 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1286610-d88f-4919-9905-67687a76ede8 None admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:38:42.992162 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1286610-d88f-4919-9905-67687a76ede8 None admin] PATH_INFO: `/v3/users/ae4bcdd8106d4bebbdcae96be33505bc` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:38:42.993427 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1286610-d88f-4919-9905-67687a76ede8 None admin] RBAC: Authorizing `identity:get_user(user_id=ae4bcdd8106d4bebbdcae96be33505bc)` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:38:42.994894 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1286610-d88f-4919-9905-67687a76ede8 None admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:38:42.996528 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 9/17] 10.222.0.16 () {56 vars in 1177 bytes} [Thu Jul 14 10:38:42 2022] GET /identity/v3/users/ae4bcdd8106d4bebbdcae96be33505bc => generated 247 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 10:38:43.001705 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1286610-d88f-4919-9905-67687a76ede8 None admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:38:43.016283 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=100 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:38:43.075130 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f269714-3604-459e-a7d5-c35847599f6b None admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:38:43.100207 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1286610-d88f-4919-9905-67687a76ede8 None admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:38:43.109853 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25d7080-377c-4d50-b3de-488aa786070b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:38:43.110656 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25d7080-377c-4d50-b3de-488aa786070b None admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:38:43.110944 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25d7080-377c-4d50-b3de-488aa786070b None admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:38:43.111220 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25d7080-377c-4d50-b3de-488aa786070b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:38:43.129886 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25d7080-377c-4d50-b3de-488aa786070b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:38:43.131355 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25d7080-377c-4d50-b3de-488aa786070b None admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:38:43.135509 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8f21c1-f600-4c2b-a517-5c3cdd79d0c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:38:43.136311 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8f21c1-f600-4c2b-a517-5c3cdd79d0c4 None admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:38:43.136600 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8f21c1-f600-4c2b-a517-5c3cdd79d0c4 None admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:38:43.136919 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8f21c1-f600-4c2b-a517-5c3cdd79d0c4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:38:43.138107 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8f21c1-f600-4c2b-a517-5c3cdd79d0c4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:38:43.139540 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8f21c1-f600-4c2b-a517-5c3cdd79d0c4 None admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:38:43.141172 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 10/18] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Jul 14 10:38:43 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 10:38:43.146974 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8f21c1-f600-4c2b-a517-5c3cdd79d0c4 None admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:38:43.151647 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application [None req-a25d7080-377c-4d50-b3de-488aa786070b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 10:38:43.151647 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:38:43.151647 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:38:43.151647 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:38:43.151647 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:38:43.151647 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:38:43.151647 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:38:43.151647 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:38:43.151647 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:38:43.151647 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:38:43.151647 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:38:43.151647 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:38:43.151647 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 10:38:43.151647 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 10:38:43.151647 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 10:38:43.152438 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 10:38:43.152438 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:38:43.152438 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:38:43.152438 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:38:43.152438 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:38:43.152438 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:38:43.152438 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:38:43.152438 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:38:43.152438 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application with Lock( Jul 14 10:38:43.152438 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:38:43.152438 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:38:43.152438 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:38:43.152438 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:38:43.152438 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:38:43.152438 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:38:43.152438 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:38:43.152438 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:38:43.153260 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 10:38:43.153260 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 10:38:43.153260 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 10:38:43.153260 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application Jul 14 10:38:43.153260 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 9/19] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Jul 14 10:38:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 10:38:43.158400 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25d7080-377c-4d50-b3de-488aa786070b None admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:38:43.215598 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=100 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:38:43.227878 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=100 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:38:43.247648 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8f21c1-f600-4c2b-a517-5c3cdd79d0c4 None admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:38:43.261798 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25d7080-377c-4d50-b3de-488aa786070b None admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:38:43.280405 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190f9f3b-e2c5-48a0-8a0e-df68caed780e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:38:43.281089 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190f9f3b-e2c5-48a0-8a0e-df68caed780e None admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:38:43.281375 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190f9f3b-e2c5-48a0-8a0e-df68caed780e None admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:38:43.281655 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190f9f3b-e2c5-48a0-8a0e-df68caed780e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:38:43.282488 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190f9f3b-e2c5-48a0-8a0e-df68caed780e None admin] RBAC: Adding query filter params (role.id=153539819e5542df99269d2913bbecfb, scope.domain.id=default, user.id=ae4bcdd8106d4bebbdcae96be33505bc) {{(pid=86655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:38:43.282801 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190f9f3b-e2c5-48a0-8a0e-df68caed780e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:38:43.284221 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190f9f3b-e2c5-48a0-8a0e-df68caed780e None admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:38:43.291370 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 11/20] 10.222.0.16 () {56 vars in 1322 bytes} [Thu Jul 14 10:38:43 2022] GET /identity/v3/role_assignments?user.id=ae4bcdd8106d4bebbdcae96be33505bc&scope.domain.id=default&role.id=153539819e5542df99269d2913bbecfb => generated 233 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 10:38:43.296362 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c8057b-37a5-4fa4-b218-606de325fe37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:38:43.297086 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c8057b-37a5-4fa4-b218-606de325fe37 None admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:38:43.297379 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c8057b-37a5-4fa4-b218-606de325fe37 None admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:38:43.297660 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c8057b-37a5-4fa4-b218-606de325fe37 None admin] PATH_INFO: `/v3/domains` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:38:43.298416 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c8057b-37a5-4fa4-b218-606de325fe37 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:38:43.298729 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c8057b-37a5-4fa4-b218-606de325fe37 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:38:43.300181 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c8057b-37a5-4fa4-b218-606de325fe37 None admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:38:43.320625 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 10/21] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Jul 14 10:38:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 10:38:45.634692 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0eb5da9-ab11-410d-9bcf-f424f46bb1bd None None] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:38:45.635715 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0eb5da9-ab11-410d-9bcf-f424f46bb1bd None None] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:38:45.636194 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0eb5da9-ab11-410d-9bcf-f424f46bb1bd None None] PATH_INFO: `/` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:38:45.637831 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 12/22] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jul 14 10:38:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:38:45.643371 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63465d7-b24b-4f3a-89bb-1db73f39d666 None None] REQUEST_METHOD: `POST` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:38:45.644206 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63465d7-b24b-4f3a-89bb-1db73f39d666 None None] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:38:45.644755 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63465d7-b24b-4f3a-89bb-1db73f39d666 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:38:45.678469 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.auth.core [None req-a63465d7-b24b-4f3a-89bb-1db73f39d666 None None] MFA Rules not processed for user `ae4bcdd8106d4bebbdcae96be33505bc`. Rule list: `[]` (Enabled: `True`). {{(pid=86656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:38:45.680037 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-a63465d7-b24b-4f3a-89bb-1db73f39d666 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:38:45.767517 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 11/23] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jul 14 10:38:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Jul 14 10:38:45.806773 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0eb5da9-ab11-410d-9bcf-f424f46bb1bd None None] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:38:45.953437 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0eb5da9-ab11-410d-9bcf-f424f46bb1bd None None] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:38:45.968642 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17de62d5-9171-4481-a0d6-0ddf6936d87a None None] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:38:45.969248 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17de62d5-9171-4481-a0d6-0ddf6936d87a None None] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:38:45.969717 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17de62d5-9171-4481-a0d6-0ddf6936d87a None None] PATH_INFO: `/` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:38:45.971267 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 12/24] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jul 14 10:38:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 14 10:38:45.976472 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d292073-322c-407c-9b8b-ba2bed00946a None None] REQUEST_METHOD: `POST` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:38:45.977053 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d292073-322c-407c-9b8b-ba2bed00946a None None] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:38:45.977525 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d292073-322c-407c-9b8b-ba2bed00946a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:38:46.008263 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.auth.core [None req-6d292073-322c-407c-9b8b-ba2bed00946a None None] MFA Rules not processed for user `ae4bcdd8106d4bebbdcae96be33505bc`. Rule list: `[]` (Enabled: `True`). {{(pid=86656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:38:46.010906 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-6d292073-322c-407c-9b8b-ba2bed00946a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:38:46.039881 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50bf5a6-30f1-41dc-85a3-ff61658707dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:38:46.041270 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50bf5a6-30f1-41dc-85a3-ff61658707dc None admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:38:46.041909 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50bf5a6-30f1-41dc-85a3-ff61658707dc None admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:38:46.042376 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50bf5a6-30f1-41dc-85a3-ff61658707dc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:38:46.069387 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50bf5a6-30f1-41dc-85a3-ff61658707dc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 10:38:46.073749 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=100 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:38:46.081216 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application [None req-b50bf5a6-30f1-41dc-85a3-ff61658707dc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 10:38:46.081216 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:38:46.081216 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:38:46.081216 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:38:46.081216 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:38:46.081216 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:38:46.081216 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:38:46.081216 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:38:46.081216 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:38:46.081216 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:38:46.081216 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:38:46.081216 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:38:46.081216 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 10:38:46.081216 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 10:38:46.081216 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 10:38:46.081216 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 10:38:46.082091 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 10:38:46.082091 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 10:38:46.082091 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 10:38:46.082091 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 10:38:46.082091 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:38:46.082091 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:38:46.082091 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:38:46.082091 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:38:46.082091 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:38:46.082091 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:38:46.082091 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:38:46.082091 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application with Lock( Jul 14 10:38:46.082091 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:38:46.082091 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:38:46.082091 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:38:46.082091 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:38:46.083153 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:38:46.083153 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:38:46.083153 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:38:46.083153 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:38:46.083153 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 10:38:46.083153 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 10:38:46.083153 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 10:38:46.083153 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 10:38:46.083153 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 10:38:46.083153 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 10:38:46.083153 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 10:38:46.083153 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application Jul 14 10:38:46.083153 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 13/25] 10.222.0.16 () {56 vars in 1096 bytes} [Thu Jul 14 10:38:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:38:46.084277 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d868a3-83e6-408d-b7ef-4ea667a98cae None None] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:38:46.084431 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d868a3-83e6-408d-b7ef-4ea667a98cae None None] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:38:46.084699 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d868a3-83e6-408d-b7ef-4ea667a98cae None None] PATH_INFO: `/` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:38:46.086631 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 14/26] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jul 14 10:38:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:38:46.091465 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d868a3-83e6-408d-b7ef-4ea667a98cae None None] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:38:46.099329 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=100 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:38:46.134210 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 13/27] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jul 14 10:38:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 14 10:38:46.135616 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419faf22-7071-43dd-bf95-848e82b315ac None None] REQUEST_METHOD: `POST` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:38:46.135916 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419faf22-7071-43dd-bf95-848e82b315ac None None] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:38:46.136201 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419faf22-7071-43dd-bf95-848e82b315ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:38:46.168967 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.auth.core [None req-419faf22-7071-43dd-bf95-848e82b315ac None None] MFA Rules not processed for user `ae4bcdd8106d4bebbdcae96be33505bc`. Rule list: `[]` (Enabled: `True`). {{(pid=86656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:38:46.170219 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-419faf22-7071-43dd-bf95-848e82b315ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:38:46.208604 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d868a3-83e6-408d-b7ef-4ea667a98cae None None] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:38:46.244868 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000da846-fdea-4d36-84df-2ba0b8591be9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:38:46.245558 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000da846-fdea-4d36-84df-2ba0b8591be9 None admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:38:46.245848 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000da846-fdea-4d36-84df-2ba0b8591be9 None admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:38:46.246127 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000da846-fdea-4d36-84df-2ba0b8591be9 None admin] PATH_INFO: `/v3/roles` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:38:46.246896 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000da846-fdea-4d36-84df-2ba0b8591be9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:38:46.247205 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000da846-fdea-4d36-84df-2ba0b8591be9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:38:46.248697 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000da846-fdea-4d36-84df-2ba0b8591be9 None admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:38:46.258305 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 15/28] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Jul 14 10:38:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:38:46.259218 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000da846-fdea-4d36-84df-2ba0b8591be9 None admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:38:46.296490 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 14/29] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jul 14 10:38:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 10:38:46.297879 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419faf22-7071-43dd-bf95-848e82b315ac None None] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:38:46.329539 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=100 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:38:46.368572 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000da846-fdea-4d36-84df-2ba0b8591be9 None admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:38:46.402839 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419faf22-7071-43dd-bf95-848e82b315ac None None] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:38:46.404789 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009a0e2e-58f4-483f-ae41-59ca3e9e248a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:38:46.405775 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009a0e2e-58f4-483f-ae41-59ca3e9e248a None admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:38:46.406193 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009a0e2e-58f4-483f-ae41-59ca3e9e248a None admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:38:46.406623 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009a0e2e-58f4-483f-ae41-59ca3e9e248a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:38:46.413128 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=100 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:38:46.418389 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009a0e2e-58f4-483f-ae41-59ca3e9e248a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:38:46.420047 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009a0e2e-58f4-483f-ae41-59ca3e9e248a None admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:38:46.439992 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application [None req-009a0e2e-58f4-483f-ae41-59ca3e9e248a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 10:38:46.439992 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:38:46.439992 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:38:46.439992 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:38:46.439992 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:38:46.439992 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:38:46.439992 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:38:46.439992 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:38:46.439992 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:38:46.439992 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:38:46.439992 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:38:46.439992 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:38:46.439992 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 10:38:46.439992 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 10:38:46.439992 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 10:38:46.440829 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 10:38:46.440829 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:38:46.440829 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:38:46.440829 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:38:46.440829 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:38:46.440829 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:38:46.440829 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:38:46.440829 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:38:46.440829 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application with Lock( Jul 14 10:38:46.440829 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:38:46.440829 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:38:46.440829 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:38:46.440829 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:38:46.440829 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:38:46.440829 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:38:46.440829 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:38:46.440829 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:38:46.441867 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 10:38:46.441867 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 10:38:46.441867 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 10:38:46.441867 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application Jul 14 10:38:46.441867 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 16/30] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Jul 14 10:38:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:38:46.443037 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ea4a8a-5e3f-4d72-9952-0946120b82cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:38:46.443233 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41841596-7a91-4a44-a79a-09d74b911aa5 None None] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:38:46.443494 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41841596-7a91-4a44-a79a-09d74b911aa5 None None] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:38:46.443775 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41841596-7a91-4a44-a79a-09d74b911aa5 None None] PATH_INFO: `/` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:38:46.444741 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ea4a8a-5e3f-4d72-9952-0946120b82cb None admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:38:46.445133 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 17/31] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jul 14 10:38:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:38:46.449225 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ea4a8a-5e3f-4d72-9952-0946120b82cb None admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:38:46.449337 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41841596-7a91-4a44-a79a-09d74b911aa5 None None] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:38:46.449409 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ea4a8a-5e3f-4d72-9952-0946120b82cb None admin] PATH_INFO: `/v3/users/ae4bcdd8106d4bebbdcae96be33505bc` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:38:46.453938 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ea4a8a-5e3f-4d72-9952-0946120b82cb None admin] RBAC: Authorizing `identity:get_user(user_id=ae4bcdd8106d4bebbdcae96be33505bc)` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:38:46.455422 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ea4a8a-5e3f-4d72-9952-0946120b82cb None admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:38:46.457671 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 15/32] 10.222.0.16 () {56 vars in 1177 bytes} [Thu Jul 14 10:38:46 2022] GET /identity/v3/users/ae4bcdd8106d4bebbdcae96be33505bc => generated 247 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:38:46.458536 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ea4a8a-5e3f-4d72-9952-0946120b82cb None admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:38:46.571623 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ea4a8a-5e3f-4d72-9952-0946120b82cb None admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:38:46.586195 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41841596-7a91-4a44-a79a-09d74b911aa5 None None] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:38:46.607911 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f608970-5c68-4df0-8ba7-c70a4c7c7b64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:38:46.608891 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f608970-5c68-4df0-8ba7-c70a4c7c7b64 None admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:38:46.609369 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f608970-5c68-4df0-8ba7-c70a4c7c7b64 None admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:38:46.609839 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f608970-5c68-4df0-8ba7-c70a4c7c7b64 None admin] PATH_INFO: `/v3/domains` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:38:46.610757 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f608970-5c68-4df0-8ba7-c70a4c7c7b64 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:38:46.611287 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f608970-5c68-4df0-8ba7-c70a4c7c7b64 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:38:46.612955 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f608970-5c68-4df0-8ba7-c70a4c7c7b64 None admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:38:46.613173 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=100 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:38:46.626021 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 16/33] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Jul 14 10:38:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:38:46.627710 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c66ab0d-c6c5-49eb-a10b-ae4a80a3f4d5 None None] REQUEST_METHOD: `POST` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:38:46.628197 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c66ab0d-c6c5-49eb-a10b-ae4a80a3f4d5 None None] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:38:46.628678 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c66ab0d-c6c5-49eb-a10b-ae4a80a3f4d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:38:46.630670 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3de131-3cbd-4f7e-b9b7-4592905d3fcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:38:46.631418 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3de131-3cbd-4f7e-b9b7-4592905d3fcc None admin] REQUEST_METHOD: `POST` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:38:46.631722 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3de131-3cbd-4f7e-b9b7-4592905d3fcc None admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:38:46.632108 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3de131-3cbd-4f7e-b9b7-4592905d3fcc None admin] PATH_INFO: `/v3/roles` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:38:46.633028 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3de131-3cbd-4f7e-b9b7-4592905d3fcc None admin] RBAC: Authorizing `identity:create_role()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:38:46.634600 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3de131-3cbd-4f7e-b9b7-4592905d3fcc None admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:38:46.651239 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.auth.core [None req-3c66ab0d-c6c5-49eb-a10b-ae4a80a3f4d5 None None] MFA Rules not processed for user `ae4bcdd8106d4bebbdcae96be33505bc`. Rule list: `[]` (Enabled: `True`). {{(pid=86656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:38:46.653330 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-3c66ab0d-c6c5-49eb-a10b-ae4a80a3f4d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:38:46.684824 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=100 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:38:46.734450 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 17/34] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jul 14 10:38:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 10:38:46.734450 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c66ab0d-c6c5-49eb-a10b-ae4a80a3f4d5 None None] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:38:46.805138 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 18/35] 10.222.0.16 () {60 vars in 1131 bytes} [Thu Jul 14 10:38:46 2022] POST /identity/v3/roles => generated 219 bytes in 359 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:38:46.806231 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3de131-3cbd-4f7e-b9b7-4592905d3fcc None admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:38:46.886685 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c66ab0d-c6c5-49eb-a10b-ae4a80a3f4d5 None None] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:38:46.958321 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ddd3d6f-9629-482f-a990-6f304b750500 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:38:46.959141 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddd3d6f-9629-482f-a990-6f304b750500 None admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:38:46.959429 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddd3d6f-9629-482f-a990-6f304b750500 None admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:38:46.959711 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddd3d6f-9629-482f-a990-6f304b750500 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:38:46.961831 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ddd3d6f-9629-482f-a990-6f304b750500 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:38:46.964383 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ddd3d6f-9629-482f-a990-6f304b750500 None admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:38:46.969214 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 18/36] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Jul 14 10:38:46 2022] GET /identity/v3/domains/default => generated 199 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:38:46.970014 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ddd3d6f-9629-482f-a990-6f304b750500 None admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:38:46.998249 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3de131-3cbd-4f7e-b9b7-4592905d3fcc None admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:38:47.036759 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=100 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:38:47.055487 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080fef00-354b-4ec2-a57c-82c47c0e85a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:38:47.056161 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080fef00-354b-4ec2-a57c-82c47c0e85a4 None admin] REQUEST_METHOD: `POST` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:38:47.056448 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080fef00-354b-4ec2-a57c-82c47c0e85a4 None admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:38:47.056726 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080fef00-354b-4ec2-a57c-82c47c0e85a4 None admin] PATH_INFO: `/v3/projects` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:38:47.057595 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080fef00-354b-4ec2-a57c-82c47c0e85a4 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:38:47.059299 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080fef00-354b-4ec2-a57c-82c47c0e85a4 None admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:38:47.102902 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 19/37] 10.222.0.16 () {60 vars in 1141 bytes} [Thu Jul 14 10:38:46 2022] POST /identity/v3/projects => generated 301 bytes in 297 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:38:47.104208 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080fef00-354b-4ec2-a57c-82c47c0e85a4 None admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:38:47.139146 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ddd3d6f-9629-482f-a990-6f304b750500 None admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:38:47.152416 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:38:47.188832 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315f9c8a-977c-4a6f-b2d8-5065cec91761 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:38:47.189932 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315f9c8a-977c-4a6f-b2d8-5065cec91761 None admin] REQUEST_METHOD: `POST` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:38:47.190512 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315f9c8a-977c-4a6f-b2d8-5065cec91761 None admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:38:47.191145 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315f9c8a-977c-4a6f-b2d8-5065cec91761 None admin] PATH_INFO: `/v3/roles` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:38:47.192905 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315f9c8a-977c-4a6f-b2d8-5065cec91761 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:38:47.194562 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315f9c8a-977c-4a6f-b2d8-5065cec91761 None admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:38:47.249208 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080fef00-354b-4ec2-a57c-82c47c0e85a4 None admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:38:47.291716 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043a1b7c-b0e0-46b5-ba8d-7fbce97b6ecb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:38:47.292719 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043a1b7c-b0e0-46b5-ba8d-7fbce97b6ecb None admin] REQUEST_METHOD: `PUT` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:38:47.293082 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043a1b7c-b0e0-46b5-ba8d-7fbce97b6ecb None admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:38:47.293305 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043a1b7c-b0e0-46b5-ba8d-7fbce97b6ecb None admin] PATH_INFO: `/v3/domains/default/users/ae4bcdd8106d4bebbdcae96be33505bc/roles/153539819e5542df99269d2913bbecfb` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:38:47.295519 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043a1b7c-b0e0-46b5-ba8d-7fbce97b6ecb None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=ae4bcdd8106d4bebbdcae96be33505bc, role_id=153539819e5542df99269d2913bbecfb)` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:38:47.297024 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043a1b7c-b0e0-46b5-ba8d-7fbce97b6ecb None admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:38:47.317775 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 20/38] 10.222.0.16 () {58 vars in 1361 bytes} [Thu Jul 14 10:38:47 2022] PUT /identity/v3/domains/default/users/ae4bcdd8106d4bebbdcae96be33505bc/roles/153539819e5542df99269d2913bbecfb => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:38:47.319068 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e676da3-2cb4-490a-a971-4b20f43f56f8 None None] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:38:47.319934 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e676da3-2cb4-490a-a971-4b20f43f56f8 None None] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:38:47.320226 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e676da3-2cb4-490a-a971-4b20f43f56f8 None None] PATH_INFO: `/` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:38:47.324968 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 21/39] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jul 14 10:38:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:38:47.328206 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d671c1-5004-4bc7-bec2-9d7a2022286c None None] REQUEST_METHOD: `POST` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:38:47.328495 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d671c1-5004-4bc7-bec2-9d7a2022286c None None] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:38:47.328799 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d671c1-5004-4bc7-bec2-9d7a2022286c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:38:47.348825 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 19/40] 10.222.0.16 () {60 vars in 1131 bytes} [Thu Jul 14 10:38:46 2022] POST /identity/v3/roles => generated 225 bytes in 374 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:38:47.350008 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.auth.core [None req-b4d671c1-5004-4bc7-bec2-9d7a2022286c None None] MFA Rules not processed for user `ae4bcdd8106d4bebbdcae96be33505bc`. Rule list: `[]` (Enabled: `True`). {{(pid=86655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:38:47.351815 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-b4d671c1-5004-4bc7-bec2-9d7a2022286c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:38:47.381709 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1cc15b-60ed-431e-9f54-7fb01228d8a1 None None] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:38:47.382067 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1cc15b-60ed-431e-9f54-7fb01228d8a1 None None] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:38:47.382358 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1cc15b-60ed-431e-9f54-7fb01228d8a1 None None] PATH_INFO: `/` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:38:47.384060 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 20/41] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jul 14 10:38:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:38:47.390326 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86aaa3a5-be05-4313-9135-920a8cb3e6d9 None None] REQUEST_METHOD: `POST` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:38:47.390595 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86aaa3a5-be05-4313-9135-920a8cb3e6d9 None None] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:38:47.390829 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86aaa3a5-be05-4313-9135-920a8cb3e6d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:38:47.412728 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.auth.core [None req-86aaa3a5-be05-4313-9135-920a8cb3e6d9 None None] MFA Rules not processed for user `ae4bcdd8106d4bebbdcae96be33505bc`. Rule list: `[]` (Enabled: `True`). {{(pid=86656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:38:47.414439 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-86aaa3a5-be05-4313-9135-920a8cb3e6d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:38:47.459240 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 22/42] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jul 14 10:38:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 14 10:38:47.493791 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d671c1-5004-4bc7-bec2-9d7a2022286c None None] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:38:47.520496 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:38:47.537246 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 21/43] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jul 14 10:38:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 14 10:38:47.561862 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86aaa3a5-be05-4313-9135-920a8cb3e6d9 None None] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:38:47.589367 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:38:47.632523 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d671c1-5004-4bc7-bec2-9d7a2022286c None None] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:38:47.679338 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86aaa3a5-be05-4313-9135-920a8cb3e6d9 None None] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:38:47.718476 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a480df-f832-4241-b953-60cf0bb7cd69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:38:47.719300 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a480df-f832-4241-b953-60cf0bb7cd69 None admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:38:47.719593 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a480df-f832-4241-b953-60cf0bb7cd69 None admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:38:47.719878 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a480df-f832-4241-b953-60cf0bb7cd69 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:38:47.721187 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a480df-f832-4241-b953-60cf0bb7cd69 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:38:47.722948 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a480df-f832-4241-b953-60cf0bb7cd69 None admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:38:47.724905 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 22/44] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Jul 14 10:38:47 2022] GET /identity/v3/domains/default => generated 199 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 10:38:47.730544 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a480df-f832-4241-b953-60cf0bb7cd69 None admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:38:47.784253 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80dbf3ca-6fc0-46d6-af13-822b5e13aff5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:38:47.784976 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80dbf3ca-6fc0-46d6-af13-822b5e13aff5 None admin] REQUEST_METHOD: `POST` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:38:47.785459 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80dbf3ca-6fc0-46d6-af13-822b5e13aff5 None admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:38:47.785747 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80dbf3ca-6fc0-46d6-af13-822b5e13aff5 None admin] PATH_INFO: `/v3/roles` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:38:47.786537 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80dbf3ca-6fc0-46d6-af13-822b5e13aff5 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:38:47.787943 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80dbf3ca-6fc0-46d6-af13-822b5e13aff5 None admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:38:47.803196 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 23/45] 10.222.0.16 () {60 vars in 1131 bytes} [Thu Jul 14 10:38:47 2022] POST /identity/v3/roles => generated 223 bytes in 310 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:38:47.848922 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=100 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:38:47.861488 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a480df-f832-4241-b953-60cf0bb7cd69 None admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:38:47.900660 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0749f6da-750e-412c-ad88-7a2f608a2190 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:38:47.901431 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0749f6da-750e-412c-ad88-7a2f608a2190 None admin] REQUEST_METHOD: `POST` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:38:47.901724 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0749f6da-750e-412c-ad88-7a2f608a2190 None admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:38:47.902008 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0749f6da-750e-412c-ad88-7a2f608a2190 None admin] PATH_INFO: `/v3/projects` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:38:47.902744 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0749f6da-750e-412c-ad88-7a2f608a2190 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:38:47.904268 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0749f6da-750e-412c-ad88-7a2f608a2190 None admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:38:47.933925 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 23/46] 10.222.0.16 () {60 vars in 1141 bytes} [Thu Jul 14 10:38:47 2022] POST /identity/v3/projects => generated 312 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 10:38:49.419596 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839f1ac8-d765-490a-9d36-90e3dfd6958a None None] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:38:49.420113 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839f1ac8-d765-490a-9d36-90e3dfd6958a None None] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:38:49.420194 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839f1ac8-d765-490a-9d36-90e3dfd6958a None None] PATH_INFO: `/` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:38:49.421570 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 24/47] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jul 14 10:38:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:38:49.427363 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73f9ed4-4e20-495f-b925-d85ff836122a None None] REQUEST_METHOD: `POST` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:38:49.427767 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73f9ed4-4e20-495f-b925-d85ff836122a None None] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:38:49.427927 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73f9ed4-4e20-495f-b925-d85ff836122a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:38:49.549720 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.auth.core [None req-e73f9ed4-4e20-495f-b925-d85ff836122a None None] MFA Rules not processed for user `ae4bcdd8106d4bebbdcae96be33505bc`. Rule list: `[]` (Enabled: `True`). {{(pid=86656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:38:49.551600 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-e73f9ed4-4e20-495f-b925-d85ff836122a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:38:49.620227 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 24/48] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jul 14 10:38:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 14 10:38:49.643517 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839f1ac8-d765-490a-9d36-90e3dfd6958a None None] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:38:49.724380 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:38:49.744720 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839f1ac8-d765-490a-9d36-90e3dfd6958a None None] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:38:49.777694 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa92246c-888b-4771-ac0f-f785f73ff1a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:38:49.778500 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa92246c-888b-4771-ac0f-f785f73ff1a2 None admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:38:49.778791 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa92246c-888b-4771-ac0f-f785f73ff1a2 None admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:38:49.779072 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa92246c-888b-4771-ac0f-f785f73ff1a2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:38:49.790288 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa92246c-888b-4771-ac0f-f785f73ff1a2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 10:38:49.797960 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application [None req-aa92246c-888b-4771-ac0f-f785f73ff1a2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 10:38:49.797960 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:38:49.797960 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:38:49.797960 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:38:49.797960 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:38:49.797960 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:38:49.797960 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:38:49.797960 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:38:49.797960 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:38:49.797960 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:38:49.797960 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:38:49.797960 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:38:49.797960 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 10:38:49.797960 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 10:38:49.797960 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 10:38:49.797960 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 10:38:49.798949 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 10:38:49.798949 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 10:38:49.798949 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 10:38:49.798949 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 10:38:49.798949 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:38:49.798949 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:38:49.798949 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:38:49.798949 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:38:49.798949 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:38:49.798949 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:38:49.798949 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:38:49.798949 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application with Lock( Jul 14 10:38:49.798949 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:38:49.798949 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:38:49.798949 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:38:49.798949 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:38:49.799928 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:38:49.799928 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:38:49.799928 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:38:49.799928 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:38:49.799928 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 10:38:49.799928 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 10:38:49.799928 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 10:38:49.799928 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 10:38:49.799928 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 10:38:49.799928 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 10:38:49.799928 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 10:38:49.799928 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application Jul 14 10:38:49.799928 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 25/49] 10.222.0.16 () {56 vars in 1096 bytes} [Thu Jul 14 10:38:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:38:49.807506 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73f9ed4-4e20-495f-b925-d85ff836122a None None] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:38:49.875907 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:38:49.911333 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73f9ed4-4e20-495f-b925-d85ff836122a None None] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:38:49.946685 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a002a4b-154b-435c-ba11-72ccea2cfd47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:38:49.947367 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a002a4b-154b-435c-ba11-72ccea2cfd47 None admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:38:49.947659 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a002a4b-154b-435c-ba11-72ccea2cfd47 None admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:38:49.947942 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a002a4b-154b-435c-ba11-72ccea2cfd47 None admin] PATH_INFO: `/v3/roles` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:38:49.948698 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a002a4b-154b-435c-ba11-72ccea2cfd47 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:38:49.949037 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a002a4b-154b-435c-ba11-72ccea2cfd47 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:38:49.950435 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a002a4b-154b-435c-ba11-72ccea2cfd47 None admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:38:49.963121 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 25/50] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Jul 14 10:38:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:38:49.968581 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa92246c-888b-4771-ac0f-f785f73ff1a2 None admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:38:49.989854 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a964a5a-5d8c-4f9f-b9dd-2e0b56660eee None None] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:38:49.990073 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a964a5a-5d8c-4f9f-b9dd-2e0b56660eee None None] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:38:49.990361 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a964a5a-5d8c-4f9f-b9dd-2e0b56660eee None None] PATH_INFO: `/` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:38:49.991761 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 26/51] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jul 14 10:38:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 14 10:38:49.996536 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ab592f-76fc-48ad-8f2f-6df65e7ad4b8 None None] REQUEST_METHOD: `POST` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:38:49.996856 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ab592f-76fc-48ad-8f2f-6df65e7ad4b8 None None] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:38:49.997140 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ab592f-76fc-48ad-8f2f-6df65e7ad4b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:38:50.014288 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.auth.core [None req-f3ab592f-76fc-48ad-8f2f-6df65e7ad4b8 None None] MFA Rules not processed for user `ae4bcdd8106d4bebbdcae96be33505bc`. Rule list: `[]` (Enabled: `True`). {{(pid=86656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:38:50.015501 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-f3ab592f-76fc-48ad-8f2f-6df65e7ad4b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:38:50.070530 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa92246c-888b-4771-ac0f-f785f73ff1a2 None admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:38:50.081453 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 27/52] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jul 14 10:38:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 14 10:38:50.102521 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc5ffdf-d82f-458a-a151-84f5d4c1127f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:38:50.103401 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc5ffdf-d82f-458a-a151-84f5d4c1127f None admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:38:50.103689 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc5ffdf-d82f-458a-a151-84f5d4c1127f None admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:38:50.103965 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc5ffdf-d82f-458a-a151-84f5d4c1127f None admin] PATH_INFO: `/v3/users/ae4bcdd8106d4bebbdcae96be33505bc` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:38:50.104150 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ab592f-76fc-48ad-8f2f-6df65e7ad4b8 None None] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:38:50.105193 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc5ffdf-d82f-458a-a151-84f5d4c1127f None admin] RBAC: Authorizing `identity:get_user(user_id=ae4bcdd8106d4bebbdcae96be33505bc)` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:38:50.106672 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc5ffdf-d82f-458a-a151-84f5d4c1127f None admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:38:50.108455 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 26/53] 10.222.0.16 () {56 vars in 1177 bytes} [Thu Jul 14 10:38:49 2022] GET /identity/v3/users/ae4bcdd8106d4bebbdcae96be33505bc => generated 247 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 10:38:50.114225 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc5ffdf-d82f-458a-a151-84f5d4c1127f None admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:38:50.125202 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=100 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:38:50.165011 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=100 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:38:50.204181 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ab592f-76fc-48ad-8f2f-6df65e7ad4b8 None None] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:38:50.215271 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc5ffdf-d82f-458a-a151-84f5d4c1127f None admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:38:50.241351 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6655d9cf-d658-4666-9250-2ecccd38e947 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:38:50.242577 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6655d9cf-d658-4666-9250-2ecccd38e947 None admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:38:50.242875 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6655d9cf-d658-4666-9250-2ecccd38e947 None admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:38:50.243167 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6655d9cf-d658-4666-9250-2ecccd38e947 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:38:50.244398 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6655d9cf-d658-4666-9250-2ecccd38e947 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:38:50.246464 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6655d9cf-d658-4666-9250-2ecccd38e947 None admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:38:50.248752 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 28/54] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Jul 14 10:38:50 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 10:38:50.250023 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df07e667-8591-4504-957d-b21f947c6e61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:38:50.250836 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df07e667-8591-4504-957d-b21f947c6e61 None admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:38:50.251125 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df07e667-8591-4504-957d-b21f947c6e61 None admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:38:50.251407 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df07e667-8591-4504-957d-b21f947c6e61 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:38:50.252597 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df07e667-8591-4504-957d-b21f947c6e61 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:38:50.254421 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df07e667-8591-4504-957d-b21f947c6e61 None admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:38:50.254661 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6655d9cf-d658-4666-9250-2ecccd38e947 None admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:38:50.260585 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 27/55] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Jul 14 10:38:50 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 10:38:50.261546 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df07e667-8591-4504-957d-b21f947c6e61 None admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:38:50.340428 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=100 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:38:50.357544 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6655d9cf-d658-4666-9250-2ecccd38e947 None admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:38:50.362990 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df07e667-8591-4504-957d-b21f947c6e61 None admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:38:50.386653 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=100 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:38:50.391967 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180c2915-a6f4-42ad-b8d5-3819d2011b61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:38:50.392628 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180c2915-a6f4-42ad-b8d5-3819d2011b61 None admin] REQUEST_METHOD: `POST` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:38:50.392954 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180c2915-a6f4-42ad-b8d5-3819d2011b61 None admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:38:50.393233 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180c2915-a6f4-42ad-b8d5-3819d2011b61 None admin] PATH_INFO: `/v3/projects` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:38:50.393945 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180c2915-a6f4-42ad-b8d5-3819d2011b61 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:38:50.396189 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180c2915-a6f4-42ad-b8d5-3819d2011b61 None admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:38:50.396839 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfc3fbc-d8e3-494d-b5f2-116d41c35e23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:38:50.397506 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfc3fbc-d8e3-494d-b5f2-116d41c35e23 None admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:38:50.397798 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfc3fbc-d8e3-494d-b5f2-116d41c35e23 None admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:38:50.398081 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfc3fbc-d8e3-494d-b5f2-116d41c35e23 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:38:50.398923 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cfc3fbc-d8e3-494d-b5f2-116d41c35e23 None admin] RBAC: Adding query filter params (role.id=153539819e5542df99269d2913bbecfb, scope.domain.id=default, user.id=ae4bcdd8106d4bebbdcae96be33505bc) {{(pid=86655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:38:50.399240 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cfc3fbc-d8e3-494d-b5f2-116d41c35e23 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:38:50.400675 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cfc3fbc-d8e3-494d-b5f2-116d41c35e23 None admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:38:50.406497 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 28/56] 10.222.0.16 () {56 vars in 1322 bytes} [Thu Jul 14 10:38:50 2022] GET /identity/v3/role_assignments?user.id=ae4bcdd8106d4bebbdcae96be33505bc&scope.domain.id=default&role.id=153539819e5542df99269d2913bbecfb => generated 530 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:38:50.421603 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 29/57] 10.222.0.16 () {60 vars in 1140 bytes} [Thu Jul 14 10:38:50 2022] POST /identity/v3/projects => generated 298 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 10:38:52.461562 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881ba6a1-7c45-42b3-9b1b-77e575a362d2 None None] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:38:52.462077 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881ba6a1-7c45-42b3-9b1b-77e575a362d2 None None] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:38:52.462181 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881ba6a1-7c45-42b3-9b1b-77e575a362d2 None None] PATH_INFO: `/` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:38:52.463497 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 29/58] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jul 14 10:38:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:38:52.468623 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c856183-21c9-4416-ba4b-3f0b85c14efb None None] REQUEST_METHOD: `POST` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:38:52.469010 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c856183-21c9-4416-ba4b-3f0b85c14efb None None] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:38:52.469215 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c856183-21c9-4416-ba4b-3f0b85c14efb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:38:52.485898 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.auth.core [None req-2c856183-21c9-4416-ba4b-3f0b85c14efb None None] MFA Rules not processed for user `ae4bcdd8106d4bebbdcae96be33505bc`. Rule list: `[]` (Enabled: `True`). {{(pid=86656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:38:52.487095 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-2c856183-21c9-4416-ba4b-3f0b85c14efb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:38:52.550829 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 30/59] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jul 14 10:38:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 10:38:52.575267 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881ba6a1-7c45-42b3-9b1b-77e575a362d2 None None] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:38:52.675169 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881ba6a1-7c45-42b3-9b1b-77e575a362d2 None None] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:38:52.708349 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f7564e-a03a-466b-8f6f-25d5f974285b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:38:52.709172 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f7564e-a03a-466b-8f6f-25d5f974285b None admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:38:52.709462 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f7564e-a03a-466b-8f6f-25d5f974285b None admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:38:52.709744 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f7564e-a03a-466b-8f6f-25d5f974285b None admin] PATH_INFO: `/v3/domains/default` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:38:52.710925 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f7564e-a03a-466b-8f6f-25d5f974285b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:38:52.712436 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f7564e-a03a-466b-8f6f-25d5f974285b None admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:38:52.714042 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 30/60] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Jul 14 10:38:52 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:38:52.719466 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c856183-21c9-4416-ba4b-3f0b85c14efb None None] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:38:52.814552 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c856183-21c9-4416-ba4b-3f0b85c14efb None None] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:38:52.828035 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:38:52.848507 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28375dfa-ef3f-4f7b-be11-96e84b64a471 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:38:52.849229 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28375dfa-ef3f-4f7b-be11-96e84b64a471 None admin] REQUEST_METHOD: `POST` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:38:52.849515 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28375dfa-ef3f-4f7b-be11-96e84b64a471 None admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:38:52.849793 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28375dfa-ef3f-4f7b-be11-96e84b64a471 None admin] PATH_INFO: `/v3/users` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:38:52.850513 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28375dfa-ef3f-4f7b-be11-96e84b64a471 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:38:52.851982 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28375dfa-ef3f-4f7b-be11-96e84b64a471 None admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:38:52.876014 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 31/61] 10.222.0.16 () {60 vars in 1132 bytes} [Thu Jul 14 10:38:52 2022] POST /identity/v3/users => generated 275 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 10:38:55.949634 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f06b4ba-7445-4f85-ad78-a23a4970d550 None None] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:38:55.949634 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f06b4ba-7445-4f85-ad78-a23a4970d550 None None] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:38:55.949634 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f06b4ba-7445-4f85-ad78-a23a4970d550 None None] PATH_INFO: `/` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:38:55.949634 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 31/62] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jul 14 10:38:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:38:55.960805 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d30606a-1e0c-4143-b042-abb7c11668aa None None] REQUEST_METHOD: `POST` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:38:55.960805 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d30606a-1e0c-4143-b042-abb7c11668aa None None] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:38:55.960805 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d30606a-1e0c-4143-b042-abb7c11668aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:38:55.981893 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.auth.core [None req-6d30606a-1e0c-4143-b042-abb7c11668aa None None] MFA Rules not processed for user `ae4bcdd8106d4bebbdcae96be33505bc`. Rule list: `[]` (Enabled: `True`). {{(pid=86656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:38:55.983408 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-6d30606a-1e0c-4143-b042-abb7c11668aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:38:56.075078 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 32/63] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jul 14 10:38:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 10:38:56.118559 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f06b4ba-7445-4f85-ad78-a23a4970d550 None None] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:38:56.134971 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=100 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:38:56.261558 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f06b4ba-7445-4f85-ad78-a23a4970d550 None None] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:38:56.310438 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69210091-f10e-4925-adc5-10ff438fd17e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:38:56.311264 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69210091-f10e-4925-adc5-10ff438fd17e None admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:38:56.311554 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69210091-f10e-4925-adc5-10ff438fd17e None admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:38:56.311836 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69210091-f10e-4925-adc5-10ff438fd17e None admin] PATH_INFO: `/v3/roles/member` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:38:56.325958 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69210091-f10e-4925-adc5-10ff438fd17e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 10:38:56.337812 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application [None req-69210091-f10e-4925-adc5-10ff438fd17e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 14 10:38:56.337812 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:38:56.337812 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:38:56.337812 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:38:56.337812 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:38:56.337812 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:38:56.337812 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:38:56.337812 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:38:56.337812 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:38:56.337812 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:38:56.337812 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:38:56.337812 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:38:56.337812 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 10:38:56.337812 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 10:38:56.337812 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 10:38:56.337812 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 10:38:56.338874 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 10:38:56.338874 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 10:38:56.338874 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 10:38:56.338874 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 10:38:56.338874 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:38:56.338874 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:38:56.338874 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:38:56.338874 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:38:56.338874 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:38:56.338874 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:38:56.338874 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:38:56.338874 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application with Lock( Jul 14 10:38:56.338874 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:38:56.338874 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:38:56.338874 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:38:56.338874 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:38:56.339807 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:38:56.339807 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:38:56.339807 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:38:56.339807 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:38:56.339807 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 10:38:56.339807 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 10:38:56.339807 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 10:38:56.339807 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 10:38:56.339807 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 10:38:56.339807 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 10:38:56.339807 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 14 10:38:56.339807 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application Jul 14 10:38:56.339807 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 32/64] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Jul 14 10:38:56 2022] GET /identity/v3/roles/member => generated 84 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:38:56.346587 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d30606a-1e0c-4143-b042-abb7c11668aa None None] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:38:56.383896 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47c89c8-d6af-4603-aa51-0de16ebb69fe None None] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:38:56.384197 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47c89c8-d6af-4603-aa51-0de16ebb69fe None None] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:38:56.384462 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47c89c8-d6af-4603-aa51-0de16ebb69fe None None] PATH_INFO: `/` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:38:56.385870 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 33/65] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jul 14 10:38:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:38:56.391650 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1513044e-292f-4130-aa8f-e484a3c818cc None None] REQUEST_METHOD: `POST` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:38:56.392195 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1513044e-292f-4130-aa8f-e484a3c818cc None None] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:38:56.392677 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1513044e-292f-4130-aa8f-e484a3c818cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:38:56.421898 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.auth.core [None req-1513044e-292f-4130-aa8f-e484a3c818cc None None] MFA Rules not processed for user `ae4bcdd8106d4bebbdcae96be33505bc`. Rule list: `[]` (Enabled: `True`). {{(pid=86655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:38:56.426516 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-1513044e-292f-4130-aa8f-e484a3c818cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:38:56.496460 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:38:56.499978 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d30606a-1e0c-4143-b042-abb7c11668aa None None] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:38:56.502779 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=100 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:38:56.511207 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 34/66] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jul 14 10:38:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 10:38:56.512730 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaaa2a99-d626-4a8e-b744-33a6b0be6935 None None] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:38:56.513254 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaaa2a99-d626-4a8e-b744-33a6b0be6935 None None] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:38:56.513746 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaaa2a99-d626-4a8e-b744-33a6b0be6935 None None] PATH_INFO: `/` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:38:56.515248 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 35/67] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jul 14 10:38:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:38:56.523771 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832f067d-f4f8-4774-8d76-dd3ade363e53 None None] REQUEST_METHOD: `POST` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:38:56.524333 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832f067d-f4f8-4774-8d76-dd3ade363e53 None None] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:38:56.524824 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832f067d-f4f8-4774-8d76-dd3ade363e53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:38:56.546351 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5237516-ece4-4611-bcd8-5dee901c4d56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:38:56.547042 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5237516-ece4-4611-bcd8-5dee901c4d56 None admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:38:56.547337 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5237516-ece4-4611-bcd8-5dee901c4d56 None admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:38:56.547622 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5237516-ece4-4611-bcd8-5dee901c4d56 None admin] PATH_INFO: `/v3/roles` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:38:56.548392 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5237516-ece4-4611-bcd8-5dee901c4d56 None admin] RBAC: Adding query filter params (name=member) {{(pid=86656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:38:56.548709 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5237516-ece4-4611-bcd8-5dee901c4d56 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:38:56.550149 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5237516-ece4-4611-bcd8-5dee901c4d56 None admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:38:56.551180 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.auth.core [None req-832f067d-f4f8-4774-8d76-dd3ade363e53 None None] MFA Rules not processed for user `ae4bcdd8106d4bebbdcae96be33505bc`. Rule list: `[]` (Enabled: `True`). {{(pid=86655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:38:56.552721 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-832f067d-f4f8-4774-8d76-dd3ade363e53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:38:56.564797 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 33/68] 10.222.0.16 () {56 vars in 1101 bytes} [Thu Jul 14 10:38:56 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:38:56.564797 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5237516-ece4-4611-bcd8-5dee901c4d56 None admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:38:56.650273 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 36/69] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jul 14 10:38:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 10:38:56.656936 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832f067d-f4f8-4774-8d76-dd3ade363e53 None None] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:38:56.695976 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5237516-ece4-4611-bcd8-5dee901c4d56 None admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:38:56.749089 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a5cf53-65ad-4fe9-968b-4c028b0c0e3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:38:56.750252 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a5cf53-65ad-4fe9-968b-4c028b0c0e3e None admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:38:56.750734 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a5cf53-65ad-4fe9-968b-4c028b0c0e3e None admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:38:56.751084 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a5cf53-65ad-4fe9-968b-4c028b0c0e3e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:38:56.769257 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a5cf53-65ad-4fe9-968b-4c028b0c0e3e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 10:38:56.782585 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application [None req-19a5cf53-65ad-4fe9-968b-4c028b0c0e3e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 14 10:38:56.782585 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:38:56.782585 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:38:56.782585 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:38:56.782585 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:38:56.782585 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:38:56.782585 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:38:56.782585 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:38:56.782585 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:38:56.782585 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:38:56.782585 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:38:56.782585 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:38:56.782585 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 10:38:56.782585 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 10:38:56.782585 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 10:38:56.782585 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 10:38:56.783429 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 10:38:56.783429 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 10:38:56.783429 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 10:38:56.783429 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 10:38:56.783429 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:38:56.783429 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:38:56.783429 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:38:56.783429 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:38:56.783429 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:38:56.783429 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:38:56.783429 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:38:56.783429 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application with Lock( Jul 14 10:38:56.783429 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:38:56.783429 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:38:56.783429 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:38:56.783429 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:38:56.784167 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:38:56.784167 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:38:56.784167 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:38:56.784167 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:38:56.784167 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 10:38:56.784167 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 10:38:56.784167 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 10:38:56.784167 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 10:38:56.784167 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 10:38:56.784167 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 10:38:56.784167 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 14 10:38:56.784167 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application Jul 14 10:38:56.784167 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 34/70] 10.222.0.16 () {56 vars in 1114 bytes} [Thu Jul 14 10:38:56 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:38:56.784828 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a5cf53-65ad-4fe9-968b-4c028b0c0e3e None admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:38:56.813183 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=100 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:38:56.814082 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832f067d-f4f8-4774-8d76-dd3ade363e53 None None] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:38:56.843754 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=100 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:38:56.854129 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343ea25b-3b1a-4b5a-99dd-f8c21ea1d6f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:38:56.855011 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343ea25b-3b1a-4b5a-99dd-f8c21ea1d6f7 None admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:38:56.855312 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343ea25b-3b1a-4b5a-99dd-f8c21ea1d6f7 None admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:38:56.855592 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343ea25b-3b1a-4b5a-99dd-f8c21ea1d6f7 None admin] PATH_INFO: `/v3/users/e58c38e93bc5470c8e1f42d205fe21c2` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:38:56.870630 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343ea25b-3b1a-4b5a-99dd-f8c21ea1d6f7 None admin] RBAC: Authorizing `identity:get_user(user_id=e58c38e93bc5470c8e1f42d205fe21c2)` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:38:56.872108 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343ea25b-3b1a-4b5a-99dd-f8c21ea1d6f7 None admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:38:56.874055 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 37/71] 10.222.0.16 () {56 vars in 1177 bytes} [Thu Jul 14 10:38:56 2022] GET /identity/v3/users/e58c38e93bc5470c8e1f42d205fe21c2 => generated 275 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:38:56.877520 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa91b072-b314-4436-b20a-c360a42b6a98 None None] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:38:56.877828 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa91b072-b314-4436-b20a-c360a42b6a98 None None] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:38:56.878190 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa91b072-b314-4436-b20a-c360a42b6a98 None None] PATH_INFO: `/` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:38:56.881981 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 38/72] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jul 14 10:38:56 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:38:56.881981 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa91b072-b314-4436-b20a-c360a42b6a98 None None] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:38:56.894623 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a5cf53-65ad-4fe9-968b-4c028b0c0e3e None admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:38:56.927902 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0509c975-6694-4358-8aed-513313f9441e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:38:56.928626 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0509c975-6694-4358-8aed-513313f9441e None admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:38:56.928949 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0509c975-6694-4358-8aed-513313f9441e None admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:38:56.929231 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0509c975-6694-4358-8aed-513313f9441e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:38:56.939490 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0509c975-6694-4358-8aed-513313f9441e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 10:38:56.948073 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application [None req-0509c975-6694-4358-8aed-513313f9441e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 10:38:56.948073 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:38:56.948073 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:38:56.948073 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:38:56.948073 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:38:56.948073 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:38:56.948073 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:38:56.948073 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:38:56.948073 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:38:56.948073 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:38:56.948073 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:38:56.948073 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:38:56.948073 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 10:38:56.948073 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 10:38:56.948073 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 10:38:56.948073 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 10:38:56.949034 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 10:38:56.949034 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 10:38:56.949034 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 10:38:56.949034 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 10:38:56.949034 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:38:56.949034 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:38:56.949034 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:38:56.949034 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:38:56.949034 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:38:56.949034 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:38:56.949034 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:38:56.949034 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application with Lock( Jul 14 10:38:56.949034 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:38:56.949034 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:38:56.949034 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:38:56.949034 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:38:56.954711 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:38:56.954711 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:38:56.954711 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:38:56.954711 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:38:56.954711 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 10:38:56.954711 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 10:38:56.954711 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 10:38:56.954711 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 10:38:56.954711 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 10:38:56.954711 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 10:38:56.954711 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 10:38:56.954711 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application Jul 14 10:38:56.954711 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 35/73] 10.222.0.16 () {56 vars in 1096 bytes} [Thu Jul 14 10:38:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:38:56.954711 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae24ebf-b37c-4a88-a9fd-04c12ef58e53 None None] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:38:56.955391 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae24ebf-b37c-4a88-a9fd-04c12ef58e53 None None] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:38:56.955391 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae24ebf-b37c-4a88-a9fd-04c12ef58e53 None None] PATH_INFO: `/` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:38:56.955391 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 36/74] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jul 14 10:38:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:38:56.956819 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae24ebf-b37c-4a88-a9fd-04c12ef58e53 None None] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:38:56.981182 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa91b072-b314-4436-b20a-c360a42b6a98 None None] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:38:57.015482 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b2e8a1-9110-4373-b411-c588a3277cc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:38:57.016146 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b2e8a1-9110-4373-b411-c588a3277cc1 None admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:38:57.016430 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b2e8a1-9110-4373-b411-c588a3277cc1 None admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:38:57.016714 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b2e8a1-9110-4373-b411-c588a3277cc1 None admin] PATH_INFO: `/v3/roles` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:38:57.017498 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b2e8a1-9110-4373-b411-c588a3277cc1 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:38:57.017804 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b2e8a1-9110-4373-b411-c588a3277cc1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:38:57.019230 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b2e8a1-9110-4373-b411-c588a3277cc1 None admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:38:57.027064 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 39/75] 10.222.0.16 () {56 vars in 1111 bytes} [Thu Jul 14 10:38:56 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:38:57.028218 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eed1d1e-68d9-4a8d-8690-0fa170f6e09d None None] REQUEST_METHOD: `POST` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:38:57.028514 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eed1d1e-68d9-4a8d-8690-0fa170f6e09d None None] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:38:57.028822 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eed1d1e-68d9-4a8d-8690-0fa170f6e09d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:38:57.039959 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=100 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:38:57.045014 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.auth.core [None req-6eed1d1e-68d9-4a8d-8690-0fa170f6e09d None None] MFA Rules not processed for user `ae4bcdd8106d4bebbdcae96be33505bc`. Rule list: `[]` (Enabled: `True`). {{(pid=86655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:38:57.046215 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-6eed1d1e-68d9-4a8d-8690-0fa170f6e09d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:38:57.059747 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae24ebf-b37c-4a88-a9fd-04c12ef58e53 None None] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:38:57.091757 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=100 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:38:57.094652 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b4c4ff-cd8e-406e-ae2a-06ad2a4dbf60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:38:57.095313 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b4c4ff-cd8e-406e-ae2a-06ad2a4dbf60 None admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:38:57.095614 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b4c4ff-cd8e-406e-ae2a-06ad2a4dbf60 None admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:38:57.095899 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b4c4ff-cd8e-406e-ae2a-06ad2a4dbf60 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:38:57.115564 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 40/76] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jul 14 10:38:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 10:38:57.116384 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eed1d1e-68d9-4a8d-8690-0fa170f6e09d None None] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:38:57.171855 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b4c4ff-cd8e-406e-ae2a-06ad2a4dbf60 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:38:57.173376 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b4c4ff-cd8e-406e-ae2a-06ad2a4dbf60 None admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:38:57.215221 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eed1d1e-68d9-4a8d-8690-0fa170f6e09d None None] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:38:57.249443 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f946d6-e67e-4b4d-b3a1-fd1701f9e6f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:38:57.250116 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f946d6-e67e-4b4d-b3a1-fd1701f9e6f0 None admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:38:57.250405 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f946d6-e67e-4b4d-b3a1-fd1701f9e6f0 None admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:38:57.250689 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f946d6-e67e-4b4d-b3a1-fd1701f9e6f0 None admin] PATH_INFO: `/v3/roles` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:38:57.251474 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f946d6-e67e-4b4d-b3a1-fd1701f9e6f0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:38:57.251780 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f946d6-e67e-4b4d-b3a1-fd1701f9e6f0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:38:57.253228 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f946d6-e67e-4b4d-b3a1-fd1701f9e6f0 None admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:38:57.256368 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=100 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:38:57.262353 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 41/77] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Jul 14 10:38:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:38:57.262353 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4998623-cfb1-423c-a678-05490cbfb148 None None] REQUEST_METHOD: `POST` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:38:57.262353 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4998623-cfb1-423c-a678-05490cbfb148 None None] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:38:57.262353 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4998623-cfb1-423c-a678-05490cbfb148 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:38:57.277400 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 37/78] 10.222.0.16 () {58 vars in 1282 bytes} [Thu Jul 14 10:38:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 10:38:57.278241 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b4c4ff-cd8e-406e-ae2a-06ad2a4dbf60 None admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:38:57.280331 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.auth.core [None req-a4998623-cfb1-423c-a678-05490cbfb148 None None] MFA Rules not processed for user `ae4bcdd8106d4bebbdcae96be33505bc`. Rule list: `[]` (Enabled: `True`). {{(pid=86655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:38:57.281559 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-a4998623-cfb1-423c-a678-05490cbfb148 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:38:57.316749 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=100 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:38:57.350804 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 42/79] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jul 14 10:38:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 10:38:57.351857 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4998623-cfb1-423c-a678-05490cbfb148 None None] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:38:57.375366 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b4c4ff-cd8e-406e-ae2a-06ad2a4dbf60 None admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:38:57.408863 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff00d39a-e1f2-41c3-82e1-0c31695b506c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:38:57.409828 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff00d39a-e1f2-41c3-82e1-0c31695b506c None admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:38:57.410119 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff00d39a-e1f2-41c3-82e1-0c31695b506c None admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:38:57.410401 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff00d39a-e1f2-41c3-82e1-0c31695b506c None admin] PATH_INFO: `/v3/users/e58c38e93bc5470c8e1f42d205fe21c2` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:38:57.411634 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff00d39a-e1f2-41c3-82e1-0c31695b506c None admin] RBAC: Authorizing `identity:get_user(user_id=e58c38e93bc5470c8e1f42d205fe21c2)` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:38:57.413128 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff00d39a-e1f2-41c3-82e1-0c31695b506c None admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:38:57.414782 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 38/80] 10.222.0.16 () {56 vars in 1177 bytes} [Thu Jul 14 10:38:57 2022] GET /identity/v3/users/e58c38e93bc5470c8e1f42d205fe21c2 => generated 275 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:38:57.419294 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff00d39a-e1f2-41c3-82e1-0c31695b506c None admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:38:57.462744 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4998623-cfb1-423c-a678-05490cbfb148 None None] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:38:57.464847 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=100 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:38:57.495800 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d2f8e7-33ff-4cc7-96c1-3d3b7f861ca1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:38:57.496521 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d2f8e7-33ff-4cc7-96c1-3d3b7f861ca1 None admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:38:57.496835 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d2f8e7-33ff-4cc7-96c1-3d3b7f861ca1 None admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:38:57.497120 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d2f8e7-33ff-4cc7-96c1-3d3b7f861ca1 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:38:57.506952 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d2f8e7-33ff-4cc7-96c1-3d3b7f861ca1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 10:38:57.514454 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff00d39a-e1f2-41c3-82e1-0c31695b506c None admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:38:57.514651 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application [None req-d2d2f8e7-33ff-4cc7-96c1-3d3b7f861ca1 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 14 10:38:57.514651 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:38:57.514651 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:38:57.514651 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:38:57.514651 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:38:57.514651 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:38:57.514651 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:38:57.514651 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:38:57.514651 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:38:57.514651 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:38:57.514651 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:38:57.514651 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:38:57.514651 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 10:38:57.514651 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 10:38:57.514651 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 10:38:57.514651 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 10:38:57.515504 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 10:38:57.515504 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 10:38:57.515504 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 10:38:57.515504 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 10:38:57.515504 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:38:57.515504 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:38:57.515504 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:38:57.515504 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:38:57.515504 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:38:57.515504 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:38:57.515504 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:38:57.515504 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application with Lock( Jul 14 10:38:57.515504 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:38:57.515504 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:38:57.515504 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:38:57.515504 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:38:57.516232 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:38:57.516232 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:38:57.516232 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:38:57.516232 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:38:57.516232 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 10:38:57.516232 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 10:38:57.516232 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 10:38:57.516232 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 10:38:57.516232 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 10:38:57.516232 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 10:38:57.516232 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 14 10:38:57.516232 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application Jul 14 10:38:57.516232 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 43/81] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Jul 14 10:38:57 2022] GET /identity/v3/roles/member => generated 84 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:38:57.516895 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d2f8e7-33ff-4cc7-96c1-3d3b7f861ca1 None admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:38:57.547155 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=100 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:38:57.550839 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09950f9d-a86d-47ae-8a24-ebb5d890c9fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:38:57.551463 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09950f9d-a86d-47ae-8a24-ebb5d890c9fb None admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:38:57.551749 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09950f9d-a86d-47ae-8a24-ebb5d890c9fb None admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:38:57.552028 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09950f9d-a86d-47ae-8a24-ebb5d890c9fb None admin] PATH_INFO: `/v3/users/ae4bcdd8106d4bebbdcae96be33505bc` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:38:57.553307 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09950f9d-a86d-47ae-8a24-ebb5d890c9fb None admin] RBAC: Authorizing `identity:get_user(user_id=ae4bcdd8106d4bebbdcae96be33505bc)` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:38:57.554763 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09950f9d-a86d-47ae-8a24-ebb5d890c9fb None admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:38:57.556388 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 39/82] 10.222.0.16 () {56 vars in 1177 bytes} [Thu Jul 14 10:38:57 2022] GET /identity/v3/users/ae4bcdd8106d4bebbdcae96be33505bc => generated 247 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:38:57.557175 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09950f9d-a86d-47ae-8a24-ebb5d890c9fb None admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:38:57.621022 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d2f8e7-33ff-4cc7-96c1-3d3b7f861ca1 None admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:38:57.654984 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684af27e-9537-40a6-9686-076f26b945e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:38:57.655846 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684af27e-9537-40a6-9686-076f26b945e3 None admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:38:57.656131 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684af27e-9537-40a6-9686-076f26b945e3 None admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:38:57.656407 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684af27e-9537-40a6-9686-076f26b945e3 None admin] PATH_INFO: `/v3/projects/3d3a37cd8fb044539b71f6202165da75` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:38:57.657633 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684af27e-9537-40a6-9686-076f26b945e3 None admin] RBAC: Authorizing `identity:get_project(project_id=3d3a37cd8fb044539b71f6202165da75)` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:38:57.658477 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09950f9d-a86d-47ae-8a24-ebb5d890c9fb None admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:38:57.659102 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684af27e-9537-40a6-9686-076f26b945e3 None admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:38:57.661915 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 44/83] 10.222.0.16 () {56 vars in 1186 bytes} [Thu Jul 14 10:38:57 2022] GET /identity/v3/projects/3d3a37cd8fb044539b71f6202165da75 => generated 298 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:38:57.662461 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684af27e-9537-40a6-9686-076f26b945e3 None admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:38:57.675833 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=100 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:38:57.693765 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0270fc97-d329-4e90-826d-2ee17a8f63f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:38:57.694568 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0270fc97-d329-4e90-826d-2ee17a8f63f5 None admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:38:57.694857 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0270fc97-d329-4e90-826d-2ee17a8f63f5 None admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:38:57.695170 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0270fc97-d329-4e90-826d-2ee17a8f63f5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:38:57.696363 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0270fc97-d329-4e90-826d-2ee17a8f63f5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:38:57.697860 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0270fc97-d329-4e90-826d-2ee17a8f63f5 None admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:38:57.699496 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 40/84] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Jul 14 10:38:57 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:38:57.700263 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0270fc97-d329-4e90-826d-2ee17a8f63f5 None admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:38:57.759832 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=100 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:38:57.764474 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684af27e-9537-40a6-9686-076f26b945e3 None admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:38:57.798101 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bc737e-cf59-4b9c-af97-d07e754febe8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:38:57.798764 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bc737e-cf59-4b9c-af97-d07e754febe8 None admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:38:57.799057 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bc737e-cf59-4b9c-af97-d07e754febe8 None admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:38:57.799345 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bc737e-cf59-4b9c-af97-d07e754febe8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:38:57.802744 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0270fc97-d329-4e90-826d-2ee17a8f63f5 None admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:38:57.836421 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b416b6-994a-45bf-b5d0-e80a1eb7cc7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:38:57.837120 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b416b6-994a-45bf-b5d0-e80a1eb7cc7e None admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:38:57.837407 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b416b6-994a-45bf-b5d0-e80a1eb7cc7e None admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:38:57.837689 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b416b6-994a-45bf-b5d0-e80a1eb7cc7e None admin] PATH_INFO: `/v3/roles` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:38:57.838441 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b416b6-994a-45bf-b5d0-e80a1eb7cc7e None admin] RBAC: Adding query filter params (name=member) {{(pid=86656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:38:57.838754 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b416b6-994a-45bf-b5d0-e80a1eb7cc7e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:38:57.840147 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b416b6-994a-45bf-b5d0-e80a1eb7cc7e None admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:38:57.848740 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 41/85] 10.222.0.16 () {56 vars in 1101 bytes} [Thu Jul 14 10:38:57 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:38:57.848740 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b416b6-994a-45bf-b5d0-e80a1eb7cc7e None admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:38:57.868411 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15bc737e-cf59-4b9c-af97-d07e754febe8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:38:57.869938 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15bc737e-cf59-4b9c-af97-d07e754febe8 None admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:38:57.900723 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=100 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:38:57.951362 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b416b6-994a-45bf-b5d0-e80a1eb7cc7e None admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:38:57.963590 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=100 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:38:57.968976 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 45/86] 10.222.0.16 () {58 vars in 1282 bytes} [Thu Jul 14 10:38:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 10:38:57.970257 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bc737e-cf59-4b9c-af97-d07e754febe8 None admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:38:57.984305 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0f1f45-22d9-4454-8999-24bdd8c43acc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:38:57.985068 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0f1f45-22d9-4454-8999-24bdd8c43acc None admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:38:57.985359 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0f1f45-22d9-4454-8999-24bdd8c43acc None admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:38:57.985643 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0f1f45-22d9-4454-8999-24bdd8c43acc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:38:58.052587 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0f1f45-22d9-4454-8999-24bdd8c43acc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:38:58.054159 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0f1f45-22d9-4454-8999-24bdd8c43acc None admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:38:58.068069 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bc737e-cf59-4b9c-af97-d07e754febe8 None admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:38:58.101857 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31828ec6-73d4-4b38-9017-0828cf9795fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:38:58.102514 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31828ec6-73d4-4b38-9017-0828cf9795fa None admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:38:58.102801 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31828ec6-73d4-4b38-9017-0828cf9795fa None admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:38:58.103083 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31828ec6-73d4-4b38-9017-0828cf9795fa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:38:58.103443 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=100 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:38:58.103924 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31828ec6-73d4-4b38-9017-0828cf9795fa None admin] RBAC: Adding query filter params (role.id=0da46c267d354cce81495dfdd56c1ec2, scope.project.id=3d3a37cd8fb044539b71f6202165da75, user.id=e58c38e93bc5470c8e1f42d205fe21c2) {{(pid=86655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:38:58.104241 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31828ec6-73d4-4b38-9017-0828cf9795fa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:38:58.105709 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31828ec6-73d4-4b38-9017-0828cf9795fa None admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:38:58.111481 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 46/87] 10.222.0.16 () {56 vars in 1374 bytes} [Thu Jul 14 10:38:57 2022] GET /identity/v3/role_assignments?user.id=e58c38e93bc5470c8e1f42d205fe21c2&scope.project.id=3d3a37cd8fb044539b71f6202165da75&role.id=0da46c267d354cce81495dfdd56c1ec2 => generated 259 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:38:58.112255 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31828ec6-73d4-4b38-9017-0828cf9795fa None admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:38:58.164832 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 42/88] 10.222.0.16 () {58 vars in 1282 bytes} [Thu Jul 14 10:38:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 10:38:58.164832 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0f1f45-22d9-4454-8999-24bdd8c43acc None admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:38:58.199156 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=100 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:38:58.241784 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31828ec6-73d4-4b38-9017-0828cf9795fa None admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:38:58.277008 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0f1f45-22d9-4454-8999-24bdd8c43acc None admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:38:58.289647 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b424c5c2-c5d8-4965-a8fc-cf70fe4b53ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:38:58.290332 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b424c5c2-c5d8-4965-a8fc-cf70fe4b53ce None admin] REQUEST_METHOD: `POST` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:38:58.290621 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b424c5c2-c5d8-4965-a8fc-cf70fe4b53ce None admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:38:58.290907 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b424c5c2-c5d8-4965-a8fc-cf70fe4b53ce None admin] PATH_INFO: `/v3/users` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:38:58.291715 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b424c5c2-c5d8-4965-a8fc-cf70fe4b53ce None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:38:58.293190 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b424c5c2-c5d8-4965-a8fc-cf70fe4b53ce None admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:38:58.312002 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f26946-6b01-4a8f-bbd4-b91747166c8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:38:58.313176 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f26946-6b01-4a8f-bbd4-b91747166c8f None admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:38:58.313491 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f26946-6b01-4a8f-bbd4-b91747166c8f None admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:38:58.313878 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f26946-6b01-4a8f-bbd4-b91747166c8f None admin] PATH_INFO: `/v3/users/e58c38e93bc5470c8e1f42d205fe21c2` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:38:58.315115 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f26946-6b01-4a8f-bbd4-b91747166c8f None admin] RBAC: Authorizing `identity:get_user(user_id=e58c38e93bc5470c8e1f42d205fe21c2)` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:38:58.317007 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f26946-6b01-4a8f-bbd4-b91747166c8f None admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:38:58.329097 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 43/89] 10.222.0.16 () {56 vars in 1177 bytes} [Thu Jul 14 10:38:58 2022] GET /identity/v3/users/e58c38e93bc5470c8e1f42d205fe21c2 => generated 275 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:38:58.329097 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f26946-6b01-4a8f-bbd4-b91747166c8f None admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:38:58.329366 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 47/90] 10.222.0.16 () {60 vars in 1132 bytes} [Thu Jul 14 10:38:58 2022] POST /identity/v3/users => generated 289 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:38:58.329366 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b424c5c2-c5d8-4965-a8fc-cf70fe4b53ce None admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:38:58.338290 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=100 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:38:58.428842 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f26946-6b01-4a8f-bbd4-b91747166c8f None admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:38:58.466879 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ef75d8-666a-41e6-911b-3aea0302ffa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:38:58.467947 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ef75d8-666a-41e6-911b-3aea0302ffa9 None admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:38:58.468239 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ef75d8-666a-41e6-911b-3aea0302ffa9 None admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:38:58.468339 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b424c5c2-c5d8-4965-a8fc-cf70fe4b53ce None admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:38:58.468537 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ef75d8-666a-41e6-911b-3aea0302ffa9 None admin] PATH_INFO: `/v3/projects/3d3a37cd8fb044539b71f6202165da75` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:38:58.470170 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ef75d8-666a-41e6-911b-3aea0302ffa9 None admin] RBAC: Authorizing `identity:get_project(project_id=3d3a37cd8fb044539b71f6202165da75)` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:38:58.471834 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ef75d8-666a-41e6-911b-3aea0302ffa9 None admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:38:58.479086 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 44/91] 10.222.0.16 () {56 vars in 1186 bytes} [Thu Jul 14 10:38:58 2022] GET /identity/v3/projects/3d3a37cd8fb044539b71f6202165da75 => generated 298 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:38:58.480173 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ef75d8-666a-41e6-911b-3aea0302ffa9 None admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:38:58.490164 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:38:58.515397 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6a5fab-f23e-41c5-bb0c-6e2b2112b640 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:38:58.516818 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6a5fab-f23e-41c5-bb0c-6e2b2112b640 None admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:38:58.517118 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6a5fab-f23e-41c5-bb0c-6e2b2112b640 None admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:38:58.517410 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6a5fab-f23e-41c5-bb0c-6e2b2112b640 None admin] PATH_INFO: `/v3/projects/3d3a37cd8fb044539b71f6202165da75` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:38:58.519476 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6a5fab-f23e-41c5-bb0c-6e2b2112b640 None admin] RBAC: Authorizing `identity:get_project(project_id=3d3a37cd8fb044539b71f6202165da75)` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:38:58.522718 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6a5fab-f23e-41c5-bb0c-6e2b2112b640 None admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:38:58.524924 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 48/92] 10.222.0.16 () {56 vars in 1186 bytes} [Thu Jul 14 10:38:58 2022] GET /identity/v3/projects/3d3a37cd8fb044539b71f6202165da75 => generated 298 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:38:58.525812 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6a5fab-f23e-41c5-bb0c-6e2b2112b640 None admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:38:58.592839 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=100 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:38:58.615249 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ef75d8-666a-41e6-911b-3aea0302ffa9 None admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:38:58.659364 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6a5fab-f23e-41c5-bb0c-6e2b2112b640 None admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:38:58.667288 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787d155a-0cd4-449c-a45b-4bb1c3ceb41b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:38:58.668190 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787d155a-0cd4-449c-a45b-4bb1c3ceb41b None admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:38:58.668486 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787d155a-0cd4-449c-a45b-4bb1c3ceb41b None admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:38:58.668813 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787d155a-0cd4-449c-a45b-4bb1c3ceb41b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:38:58.713328 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0097f1-463f-40d0-8330-22f41e0a11b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:38:58.714216 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0097f1-463f-40d0-8330-22f41e0a11b3 None admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:38:58.714828 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0097f1-463f-40d0-8330-22f41e0a11b3 None admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:38:58.715305 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0097f1-463f-40d0-8330-22f41e0a11b3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:38:58.716288 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0097f1-463f-40d0-8330-22f41e0a11b3 None admin] RBAC: Adding query filter params (role.id=64ec6989f4724a8ab1e32d37c186c8f8, scope.project.id=3d3a37cd8fb044539b71f6202165da75, user.id=e58c38e93bc5470c8e1f42d205fe21c2) {{(pid=86655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:38:58.716605 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0097f1-463f-40d0-8330-22f41e0a11b3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:38:58.718447 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0097f1-463f-40d0-8330-22f41e0a11b3 None admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:38:58.726320 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 49/93] 10.222.0.16 () {56 vars in 1374 bytes} [Thu Jul 14 10:38:58 2022] GET /identity/v3/role_assignments?user.id=e58c38e93bc5470c8e1f42d205fe21c2&scope.project.id=3d3a37cd8fb044539b71f6202165da75&role.id=64ec6989f4724a8ab1e32d37c186c8f8 => generated 259 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:38:58.727170 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0097f1-463f-40d0-8330-22f41e0a11b3 None admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:38:58.772139 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787d155a-0cd4-449c-a45b-4bb1c3ceb41b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:38:58.773735 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787d155a-0cd4-449c-a45b-4bb1c3ceb41b None admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:38:58.814177 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=100 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:38:58.886896 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=100 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:38:58.892750 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0097f1-463f-40d0-8330-22f41e0a11b3 None admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:38:58.905756 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 45/94] 10.222.0.16 () {58 vars in 1282 bytes} [Thu Jul 14 10:38:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 426 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 10:38:58.912313 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787d155a-0cd4-449c-a45b-4bb1c3ceb41b None admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:38:58.942209 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4c3d37-384c-4cfd-a707-7ed0e741c427 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:38:58.943151 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4c3d37-384c-4cfd-a707-7ed0e741c427 None admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:38:58.943442 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4c3d37-384c-4cfd-a707-7ed0e741c427 None admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:38:58.944165 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4c3d37-384c-4cfd-a707-7ed0e741c427 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:38:58.945204 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4c3d37-384c-4cfd-a707-7ed0e741c427 None admin] RBAC: Adding query filter params (role.id=153539819e5542df99269d2913bbecfb, scope.project.id=3d3a37cd8fb044539b71f6202165da75, user.id=ae4bcdd8106d4bebbdcae96be33505bc) {{(pid=86655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:38:58.945530 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4c3d37-384c-4cfd-a707-7ed0e741c427 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:38:58.947015 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4c3d37-384c-4cfd-a707-7ed0e741c427 None admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:38:58.953556 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 50/95] 10.222.0.16 () {56 vars in 1374 bytes} [Thu Jul 14 10:38:58 2022] GET /identity/v3/role_assignments?user.id=ae4bcdd8106d4bebbdcae96be33505bc&scope.project.id=3d3a37cd8fb044539b71f6202165da75&role.id=153539819e5542df99269d2913bbecfb => generated 259 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:38:59.033007 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787d155a-0cd4-449c-a45b-4bb1c3ceb41b None admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:38:59.075206 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3d123c-e1ed-4bfa-ab86-c92be4359bf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:38:59.077000 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3d123c-e1ed-4bfa-ab86-c92be4359bf6 None admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:38:59.077492 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3d123c-e1ed-4bfa-ab86-c92be4359bf6 None admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:38:59.077971 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3d123c-e1ed-4bfa-ab86-c92be4359bf6 None admin] PATH_INFO: `/v3/projects/6bf2528ae7564dd9a6b6bafc9559875a` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:38:59.079549 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3d123c-e1ed-4bfa-ab86-c92be4359bf6 None admin] RBAC: Authorizing `identity:get_project(project_id=6bf2528ae7564dd9a6b6bafc9559875a)` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:38:59.081868 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3d123c-e1ed-4bfa-ab86-c92be4359bf6 None admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:38:59.083961 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 46/96] 10.222.0.16 () {56 vars in 1186 bytes} [Thu Jul 14 10:38:58 2022] GET /identity/v3/projects/6bf2528ae7564dd9a6b6bafc9559875a => generated 312 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 10:38:59.092167 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4c3d37-384c-4cfd-a707-7ed0e741c427 None admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:38:59.232943 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4c3d37-384c-4cfd-a707-7ed0e741c427 None admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:38:59.247673 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=100 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:38:59.269046 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3deaedf1-2480-450b-89ee-e78df44e3af2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:38:59.269716 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3deaedf1-2480-450b-89ee-e78df44e3af2 None admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:38:59.270012 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3deaedf1-2480-450b-89ee-e78df44e3af2 None admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:38:59.270295 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3deaedf1-2480-450b-89ee-e78df44e3af2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:38:59.271157 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3deaedf1-2480-450b-89ee-e78df44e3af2 None admin] RBAC: Adding query filter params (role.id=0da46c267d354cce81495dfdd56c1ec2, scope.project.id=6bf2528ae7564dd9a6b6bafc9559875a, user.id=e58c38e93bc5470c8e1f42d205fe21c2) {{(pid=86655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:38:59.271474 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3deaedf1-2480-450b-89ee-e78df44e3af2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:38:59.273036 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3deaedf1-2480-450b-89ee-e78df44e3af2 None admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:38:59.278858 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 51/97] 10.222.0.16 () {56 vars in 1374 bytes} [Thu Jul 14 10:38:59 2022] GET /identity/v3/role_assignments?user.id=e58c38e93bc5470c8e1f42d205fe21c2&scope.project.id=6bf2528ae7564dd9a6b6bafc9559875a&role.id=0da46c267d354cce81495dfdd56c1ec2 => generated 259 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:39:00.530755 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c8b39e-40d9-4607-b924-88651d4aa403 None None] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:00.531779 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c8b39e-40d9-4607-b924-88651d4aa403 None None] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:00.532265 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c8b39e-40d9-4607-b924-88651d4aa403 None None] PATH_INFO: `/` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:00.533886 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 47/98] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jul 14 10:39:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:39:00.539894 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b85a8c4-3867-49d2-8c63-f4d12c49fde7 None None] REQUEST_METHOD: `POST` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:00.540692 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b85a8c4-3867-49d2-8c63-f4d12c49fde7 None None] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:00.541237 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b85a8c4-3867-49d2-8c63-f4d12c49fde7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:00.563090 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.auth.core [None req-4b85a8c4-3867-49d2-8c63-f4d12c49fde7 None None] MFA Rules not processed for user `ae4bcdd8106d4bebbdcae96be33505bc`. Rule list: `[]` (Enabled: `True`). {{(pid=86655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:39:00.564628 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-4b85a8c4-3867-49d2-8c63-f4d12c49fde7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:39:00.654941 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 52/99] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jul 14 10:39:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 10:39:00.702154 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c8b39e-40d9-4607-b924-88651d4aa403 None None] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:00.759550 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=100 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:39:00.821971 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c8b39e-40d9-4607-b924-88651d4aa403 None None] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:00.858209 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a47ba0-8018-4a5f-bbcd-77eba809c9cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:00.859348 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a47ba0-8018-4a5f-bbcd-77eba809c9cf None admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:00.859859 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a47ba0-8018-4a5f-bbcd-77eba809c9cf None admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:00.860344 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a47ba0-8018-4a5f-bbcd-77eba809c9cf None admin] PATH_INFO: `/v3/roles/member` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:00.871258 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a47ba0-8018-4a5f-bbcd-77eba809c9cf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 10:39:00.879818 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application [None req-77a47ba0-8018-4a5f-bbcd-77eba809c9cf None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 14 10:39:00.879818 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:39:00.879818 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:39:00.879818 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:39:00.879818 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:39:00.879818 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:39:00.879818 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:39:00.879818 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:39:00.879818 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:39:00.879818 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:39:00.879818 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:39:00.879818 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:39:00.879818 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 10:39:00.879818 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 10:39:00.879818 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 10:39:00.879818 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 10:39:00.880690 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 10:39:00.880690 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 10:39:00.880690 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 10:39:00.880690 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 10:39:00.880690 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:39:00.880690 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:39:00.880690 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:39:00.880690 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:39:00.880690 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:39:00.880690 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:39:00.880690 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:39:00.880690 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application with Lock( Jul 14 10:39:00.880690 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:39:00.880690 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:39:00.880690 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:39:00.880690 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:39:00.881487 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:39:00.881487 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:39:00.881487 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:39:00.881487 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:39:00.881487 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 10:39:00.881487 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 10:39:00.881487 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 10:39:00.881487 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 10:39:00.881487 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 10:39:00.881487 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 10:39:00.881487 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 14 10:39:00.881487 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application Jul 14 10:39:00.884087 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 48/100] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Jul 14 10:39:00 2022] GET /identity/v3/roles/member => generated 84 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 10:39:00.890176 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b85a8c4-3867-49d2-8c63-f4d12c49fde7 None None] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:01.014778 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b85a8c4-3867-49d2-8c63-f4d12c49fde7 None None] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:01.030953 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=100 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:39:01.066921 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75a1cb0-612e-47e8-afba-c3982fd676de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:01.067609 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75a1cb0-612e-47e8-afba-c3982fd676de None admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:01.067900 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75a1cb0-612e-47e8-afba-c3982fd676de None admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:01.068185 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75a1cb0-612e-47e8-afba-c3982fd676de None admin] PATH_INFO: `/v3/roles` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:01.069030 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75a1cb0-612e-47e8-afba-c3982fd676de None admin] RBAC: Adding query filter params (name=member) {{(pid=86655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:39:01.069348 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75a1cb0-612e-47e8-afba-c3982fd676de None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:39:01.070741 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75a1cb0-612e-47e8-afba-c3982fd676de None admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:39:01.084637 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 53/101] 10.222.0.16 () {56 vars in 1101 bytes} [Thu Jul 14 10:39:00 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:39:01.090160 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a47ba0-8018-4a5f-bbcd-77eba809c9cf None admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:01.230962 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a47ba0-8018-4a5f-bbcd-77eba809c9cf None admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:01.244994 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=100 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:39:01.267799 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e7e692-1e50-4920-8f6c-6a768efc4fdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:01.269812 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e7e692-1e50-4920-8f6c-6a768efc4fdf None admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:01.270311 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e7e692-1e50-4920-8f6c-6a768efc4fdf None admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:01.270790 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e7e692-1e50-4920-8f6c-6a768efc4fdf None admin] PATH_INFO: `/v3/users/e58c38e93bc5470c8e1f42d205fe21c2` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:01.272286 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e7e692-1e50-4920-8f6c-6a768efc4fdf None admin] RBAC: Authorizing `identity:get_user(user_id=e58c38e93bc5470c8e1f42d205fe21c2)` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:39:01.274010 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e7e692-1e50-4920-8f6c-6a768efc4fdf None admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:39:01.275881 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 49/102] 10.222.0.16 () {56 vars in 1177 bytes} [Thu Jul 14 10:39:01 2022] GET /identity/v3/users/e58c38e93bc5470c8e1f42d205fe21c2 => generated 275 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:39:01.285914 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75a1cb0-612e-47e8-afba-c3982fd676de None admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:01.449319 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75a1cb0-612e-47e8-afba-c3982fd676de None admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:01.490571 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0560ebb-e860-4cf5-9194-5e3911651f5a None None] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:01.491134 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0560ebb-e860-4cf5-9194-5e3911651f5a None None] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:01.491434 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0560ebb-e860-4cf5-9194-5e3911651f5a None None] PATH_INFO: `/` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:01.492951 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 50/103] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jul 14 10:39:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:39:01.493818 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25097577-273d-46f4-9ca1-64eb91dfd4ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:01.494834 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25097577-273d-46f4-9ca1-64eb91dfd4ba None admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:01.495123 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25097577-273d-46f4-9ca1-64eb91dfd4ba None admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:01.495402 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25097577-273d-46f4-9ca1-64eb91dfd4ba None admin] PATH_INFO: `/v3/projects/3d3a37cd8fb044539b71f6202165da75` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:01.498505 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25097577-273d-46f4-9ca1-64eb91dfd4ba None admin] RBAC: Authorizing `identity:get_project(project_id=3d3a37cd8fb044539b71f6202165da75)` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:39:01.499274 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33eb11f-afb6-46b2-8cae-604cc484fb19 None None] REQUEST_METHOD: `POST` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:01.499779 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33eb11f-afb6-46b2-8cae-604cc484fb19 None None] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:01.499966 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25097577-273d-46f4-9ca1-64eb91dfd4ba None admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:39:01.500442 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33eb11f-afb6-46b2-8cae-604cc484fb19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:01.501713 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 54/104] 10.222.0.16 () {56 vars in 1186 bytes} [Thu Jul 14 10:39:01 2022] GET /identity/v3/projects/3d3a37cd8fb044539b71f6202165da75 => generated 298 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:39:01.507479 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25097577-273d-46f4-9ca1-64eb91dfd4ba None admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:01.520600 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.auth.core [None req-c33eb11f-afb6-46b2-8cae-604cc484fb19 None None] MFA Rules not processed for user `ae4bcdd8106d4bebbdcae96be33505bc`. Rule list: `[]` (Enabled: `True`). {{(pid=86656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:39:01.522193 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-c33eb11f-afb6-46b2-8cae-604cc484fb19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:39:01.574224 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=100 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:39:01.638693 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 51/105] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jul 14 10:39:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 14 10:39:01.639953 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a000627e-8709-4891-85c6-ab4b239a8b6e None None] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:01.640248 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a000627e-8709-4891-85c6-ab4b239a8b6e None None] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:01.640528 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a000627e-8709-4891-85c6-ab4b239a8b6e None None] PATH_INFO: `/` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:01.642209 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 52/106] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jul 14 10:39:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:39:01.647941 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9901c0-8073-4dd8-a93f-439736889751 None None] REQUEST_METHOD: `POST` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:01.648237 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9901c0-8073-4dd8-a93f-439736889751 None None] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:01.648520 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9901c0-8073-4dd8-a93f-439736889751 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:01.659315 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25097577-273d-46f4-9ca1-64eb91dfd4ba None admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:01.684590 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.auth.core [None req-5a9901c0-8073-4dd8-a93f-439736889751 None None] MFA Rules not processed for user `ae4bcdd8106d4bebbdcae96be33505bc`. Rule list: `[]` (Enabled: `True`). {{(pid=86656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:39:01.685842 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-5a9901c0-8073-4dd8-a93f-439736889751 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:39:01.701107 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43631ef2-0c25-416d-95e9-1db9d01dbc4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:01.702298 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43631ef2-0c25-416d-95e9-1db9d01dbc4e None admin] REQUEST_METHOD: `PUT` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:01.702787 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43631ef2-0c25-416d-95e9-1db9d01dbc4e None admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:01.703287 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43631ef2-0c25-416d-95e9-1db9d01dbc4e None admin] PATH_INFO: `/v3/projects/3d3a37cd8fb044539b71f6202165da75/users/e58c38e93bc5470c8e1f42d205fe21c2/roles/0da46c267d354cce81495dfdd56c1ec2` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:01.705541 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43631ef2-0c25-416d-95e9-1db9d01dbc4e None admin] RBAC: Authorizing `identity:create_grant(project_id=3d3a37cd8fb044539b71f6202165da75, user_id=e58c38e93bc5470c8e1f42d205fe21c2, role_id=0da46c267d354cce81495dfdd56c1ec2)` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:39:01.708222 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43631ef2-0c25-416d-95e9-1db9d01dbc4e None admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:39:01.727478 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 55/107] 10.222.0.16 () {58 vars in 1439 bytes} [Thu Jul 14 10:39:01 2022] PUT /identity/v3/projects/3d3a37cd8fb044539b71f6202165da75/users/e58c38e93bc5470c8e1f42d205fe21c2/roles/0da46c267d354cce81495dfdd56c1ec2 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 10:39:01.728706 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43631ef2-0c25-416d-95e9-1db9d01dbc4e None admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:01.835195 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 53/108] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jul 14 10:39:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 10:39:01.873723 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9901c0-8073-4dd8-a93f-439736889751 None None] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:01.913156 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:39:01.920020 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43631ef2-0c25-416d-95e9-1db9d01dbc4e None admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:01.963009 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=100 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:39:01.974624 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d6153c-7309-4f80-a3c4-92d857c4ba8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:01.975454 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d6153c-7309-4f80-a3c4-92d857c4ba8c None admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:01.975749 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d6153c-7309-4f80-a3c4-92d857c4ba8c None admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:01.976033 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d6153c-7309-4f80-a3c4-92d857c4ba8c None admin] PATH_INFO: `/v3/roles/reader` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:01.999920 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d6153c-7309-4f80-a3c4-92d857c4ba8c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 10:39:02.009476 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application [None req-43d6153c-7309-4f80-a3c4-92d857c4ba8c None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 14 10:39:02.009476 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:39:02.009476 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:39:02.009476 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:39:02.009476 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:39:02.009476 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:39:02.009476 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:39:02.009476 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:39:02.009476 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:39:02.009476 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:39:02.009476 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:39:02.009476 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:39:02.009476 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 10:39:02.009476 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 10:39:02.009476 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 10:39:02.009476 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 10:39:02.010431 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 10:39:02.010431 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 10:39:02.010431 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 10:39:02.010431 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 10:39:02.010431 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:39:02.010431 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:39:02.010431 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:39:02.010431 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:39:02.010431 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:39:02.010431 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:39:02.010431 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:39:02.010431 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application with Lock( Jul 14 10:39:02.010431 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:39:02.010431 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:39:02.010431 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:39:02.010431 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:39:02.011215 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:39:02.011215 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:39:02.011215 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:39:02.011215 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:39:02.011215 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 10:39:02.011215 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 10:39:02.011215 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 10:39:02.011215 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 10:39:02.011215 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 10:39:02.011215 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 10:39:02.011215 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 14 10:39:02.011215 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application Jul 14 10:39:02.011215 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 56/109] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Jul 14 10:39:01 2022] GET /identity/v3/roles/reader => generated 84 bytes in 282 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:39:02.012185 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c44c82-e77d-44fb-80a4-51ad29c56746 None None] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:02.012520 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c44c82-e77d-44fb-80a4-51ad29c56746 None None] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:02.012734 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c44c82-e77d-44fb-80a4-51ad29c56746 None None] PATH_INFO: `/` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:02.014091 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 57/110] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jul 14 10:39:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:39:02.018759 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c44c82-e77d-44fb-80a4-51ad29c56746 None None] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:02.088306 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9901c0-8073-4dd8-a93f-439736889751 None None] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:02.136992 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169245f5-4de7-4aca-ac3c-da57aca7ae1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:02.137806 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169245f5-4de7-4aca-ac3c-da57aca7ae1e None admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:02.139853 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169245f5-4de7-4aca-ac3c-da57aca7ae1e None admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:02.140145 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169245f5-4de7-4aca-ac3c-da57aca7ae1e None admin] PATH_INFO: `/v3/domains/default` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:02.141100 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c44c82-e77d-44fb-80a4-51ad29c56746 None None] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:02.141407 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169245f5-4de7-4aca-ac3c-da57aca7ae1e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:39:02.142884 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169245f5-4de7-4aca-ac3c-da57aca7ae1e None admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:39:02.144567 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 54/111] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Jul 14 10:39:01 2022] GET /identity/v3/domains/default => generated 199 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:39:02.150361 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8fdc8c-1f22-49da-92f5-5bfcb8930e2d None None] REQUEST_METHOD: `POST` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:02.150664 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8fdc8c-1f22-49da-92f5-5bfcb8930e2d None None] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:02.150951 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8fdc8c-1f22-49da-92f5-5bfcb8930e2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:02.170166 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.auth.core [None req-4f8fdc8c-1f22-49da-92f5-5bfcb8930e2d None None] MFA Rules not processed for user `ae4bcdd8106d4bebbdcae96be33505bc`. Rule list: `[]` (Enabled: `True`). {{(pid=86656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:39:02.171841 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-4f8fdc8c-1f22-49da-92f5-5bfcb8930e2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:39:02.180017 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247f322b-a1e8-492d-be8e-1830604f6fd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:02.180841 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247f322b-a1e8-492d-be8e-1830604f6fd9 None admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:02.181139 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247f322b-a1e8-492d-be8e-1830604f6fd9 None admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:02.181426 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247f322b-a1e8-492d-be8e-1830604f6fd9 None admin] PATH_INFO: `/v3/roles` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:02.182265 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247f322b-a1e8-492d-be8e-1830604f6fd9 None admin] RBAC: Adding query filter params (name=reader) {{(pid=86655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:39:02.182584 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247f322b-a1e8-492d-be8e-1830604f6fd9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:39:02.184062 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247f322b-a1e8-492d-be8e-1830604f6fd9 None admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:39:02.194729 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 58/112] 10.222.0.16 () {56 vars in 1101 bytes} [Thu Jul 14 10:39:02 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:39:02.195599 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247f322b-a1e8-492d-be8e-1830604f6fd9 None admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:02.237073 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=100 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:39:02.292996 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 55/113] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jul 14 10:39:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 10:39:02.293889 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8fdc8c-1f22-49da-92f5-5bfcb8930e2d None None] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:02.372864 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247f322b-a1e8-492d-be8e-1830604f6fd9 None admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:02.381110 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=100 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:39:02.410123 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f3956a-86bb-4aa2-8182-e136dfeae30b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:02.410838 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f3956a-86bb-4aa2-8182-e136dfeae30b None admin] REQUEST_METHOD: `POST` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:02.411125 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f3956a-86bb-4aa2-8182-e136dfeae30b None admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:02.411406 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f3956a-86bb-4aa2-8182-e136dfeae30b None admin] PATH_INFO: `/v3/projects` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:02.412130 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f3956a-86bb-4aa2-8182-e136dfeae30b None admin] RBAC: Authorizing `identity:create_project()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:39:02.413603 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f3956a-86bb-4aa2-8182-e136dfeae30b None admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:39:02.443144 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 59/114] 10.222.0.16 () {60 vars in 1141 bytes} [Thu Jul 14 10:39:02 2022] POST /identity/v3/projects => generated 302 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:39:02.444714 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f3956a-86bb-4aa2-8182-e136dfeae30b None admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:02.528862 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8fdc8c-1f22-49da-92f5-5bfcb8930e2d None None] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:02.584228 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3254d83-dab8-4410-b5a0-345da7136d0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:02.587782 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3254d83-dab8-4410-b5a0-345da7136d0d None admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:02.593542 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3254d83-dab8-4410-b5a0-345da7136d0d None admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:02.593796 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:39:02.594256 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3254d83-dab8-4410-b5a0-345da7136d0d None admin] PATH_INFO: `/v3/users/3592686c34704273a175a9090876e62d` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:02.616897 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3254d83-dab8-4410-b5a0-345da7136d0d None admin] RBAC: Authorizing `identity:get_user(user_id=3592686c34704273a175a9090876e62d)` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:39:02.618779 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3254d83-dab8-4410-b5a0-345da7136d0d None admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:39:02.621144 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 56/115] 10.222.0.16 () {56 vars in 1177 bytes} [Thu Jul 14 10:39:02 2022] GET /identity/v3/users/3592686c34704273a175a9090876e62d => generated 289 bytes in 327 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:39:02.622691 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9a183f-d784-43ba-9a18-653d85ba972e None None] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:02.623267 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9a183f-d784-43ba-9a18-653d85ba972e None None] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:02.623638 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9a183f-d784-43ba-9a18-653d85ba972e None None] PATH_INFO: `/` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:02.625237 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 57/116] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jul 14 10:39:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:39:02.630340 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f3956a-86bb-4aa2-8182-e136dfeae30b None admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:02.631698 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0aac4e5-b50c-4e25-97f3-f9657f002b0e None None] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:02.632163 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0aac4e5-b50c-4e25-97f3-f9657f002b0e None None] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:02.632597 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0aac4e5-b50c-4e25-97f3-f9657f002b0e None None] PATH_INFO: `/` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:02.634186 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 58/117] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jul 14 10:39:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:39:02.635092 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0aac4e5-b50c-4e25-97f3-f9657f002b0e None None] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:02.678764 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9475c1af-6af3-4ad8-aa57-527d5e1b90e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:02.679772 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9475c1af-6af3-4ad8-aa57-527d5e1b90e6 None admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:02.680068 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9475c1af-6af3-4ad8-aa57-527d5e1b90e6 None admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:02.680621 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9475c1af-6af3-4ad8-aa57-527d5e1b90e6 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:02.697063 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9475c1af-6af3-4ad8-aa57-527d5e1b90e6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 10:39:02.706307 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application [None req-9475c1af-6af3-4ad8-aa57-527d5e1b90e6 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 14 10:39:02.706307 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:39:02.706307 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:39:02.706307 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:39:02.706307 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:39:02.706307 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:39:02.706307 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:39:02.706307 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:39:02.706307 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:39:02.706307 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:39:02.706307 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:39:02.706307 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:39:02.706307 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 10:39:02.706307 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 10:39:02.706307 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 10:39:02.706307 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 10:39:02.707230 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 10:39:02.707230 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 10:39:02.707230 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 10:39:02.707230 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 10:39:02.707230 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:39:02.707230 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:39:02.707230 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:39:02.707230 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:39:02.707230 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:39:02.707230 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:39:02.707230 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:39:02.707230 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application with Lock( Jul 14 10:39:02.707230 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:39:02.707230 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:39:02.707230 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:39:02.707230 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:39:02.707961 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:39:02.707961 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:39:02.707961 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:39:02.707961 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:39:02.707961 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 10:39:02.707961 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 10:39:02.707961 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 10:39:02.707961 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 10:39:02.707961 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 10:39:02.707961 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 10:39:02.707961 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 14 10:39:02.707961 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application Jul 14 10:39:02.707961 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 60/118] 10.222.0.16 () {56 vars in 1114 bytes} [Thu Jul 14 10:39:02 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:39:02.708751 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57450685-a555-40ed-bd8e-989d60a50535 None None] REQUEST_METHOD: `POST` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:02.709069 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57450685-a555-40ed-bd8e-989d60a50535 None None] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:02.713945 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57450685-a555-40ed-bd8e-989d60a50535 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:02.729553 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.auth.core [None req-57450685-a555-40ed-bd8e-989d60a50535 None None] MFA Rules not processed for user `ae4bcdd8106d4bebbdcae96be33505bc`. Rule list: `[]` (Enabled: `True`). {{(pid=86655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:39:02.730771 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-57450685-a555-40ed-bd8e-989d60a50535 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:39:02.768477 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=100 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:39:02.783215 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0aac4e5-b50c-4e25-97f3-f9657f002b0e None None] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:02.822164 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c891ecf-3c46-4f18-b277-7c3448409a65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:02.822822 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c891ecf-3c46-4f18-b277-7c3448409a65 None admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:02.823112 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c891ecf-3c46-4f18-b277-7c3448409a65 None admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:02.823389 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c891ecf-3c46-4f18-b277-7c3448409a65 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:02.830071 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 61/119] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jul 14 10:39:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 10:39:02.836720 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4295c71f-3bcb-457e-a6a5-545427317026 None None] REQUEST_METHOD: `POST` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:02.836970 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4295c71f-3bcb-457e-a6a5-545427317026 None None] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:02.837183 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4295c71f-3bcb-457e-a6a5-545427317026 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:02.865248 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.auth.core [None req-4295c71f-3bcb-457e-a6a5-545427317026 None None] MFA Rules not processed for user `ae4bcdd8106d4bebbdcae96be33505bc`. Rule list: `[]` (Enabled: `True`). {{(pid=86655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:39:02.866295 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-4295c71f-3bcb-457e-a6a5-545427317026 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:39:02.913113 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c891ecf-3c46-4f18-b277-7c3448409a65 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:39:02.914602 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c891ecf-3c46-4f18-b277-7c3448409a65 None admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:39:02.947348 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=100 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:39:02.961603 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 62/120] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jul 14 10:39:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 10:39:02.969131 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4295c71f-3bcb-457e-a6a5-545427317026 None None] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:03.037701 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=100 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:39:03.048346 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 59/121] 10.222.0.16 () {58 vars in 1282 bytes} [Thu Jul 14 10:39:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 413 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 10:39:03.050454 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c891ecf-3c46-4f18-b277-7c3448409a65 None admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:03.093411 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4295c71f-3bcb-457e-a6a5-545427317026 None None] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:03.129932 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff24e80-0abb-41d7-8adb-c9f54e2876a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:03.130615 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff24e80-0abb-41d7-8adb-c9f54e2876a0 None admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:03.130901 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff24e80-0abb-41d7-8adb-c9f54e2876a0 None admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:03.131180 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff24e80-0abb-41d7-8adb-c9f54e2876a0 None admin] PATH_INFO: `/v3/roles` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:03.131944 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff24e80-0abb-41d7-8adb-c9f54e2876a0 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:39:03.132251 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff24e80-0abb-41d7-8adb-c9f54e2876a0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:39:03.133694 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff24e80-0abb-41d7-8adb-c9f54e2876a0 None admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:39:03.146698 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 63/122] 10.222.0.16 () {56 vars in 1111 bytes} [Thu Jul 14 10:39:02 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:39:03.146698 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff24e80-0abb-41d7-8adb-c9f54e2876a0 None admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:03.195472 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c891ecf-3c46-4f18-b277-7c3448409a65 None admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:03.205866 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=100 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:39:03.241382 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2775c7-c010-42d1-96f9-259ad03f2042 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:03.243026 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2775c7-c010-42d1-96f9-259ad03f2042 None admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:03.243779 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2775c7-c010-42d1-96f9-259ad03f2042 None admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:03.244259 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2775c7-c010-42d1-96f9-259ad03f2042 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:03.254826 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff24e80-0abb-41d7-8adb-c9f54e2876a0 None admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:03.260882 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2775c7-c010-42d1-96f9-259ad03f2042 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 10:39:03.272103 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application [None req-8c2775c7-c010-42d1-96f9-259ad03f2042 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 14 10:39:03.272103 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:39:03.272103 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:39:03.272103 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:39:03.272103 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:39:03.272103 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:39:03.272103 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:39:03.272103 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:39:03.272103 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:39:03.272103 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:39:03.272103 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:39:03.272103 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:39:03.272103 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 10:39:03.272103 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 10:39:03.272103 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 10:39:03.272103 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 10:39:03.273027 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 10:39:03.273027 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 10:39:03.273027 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 10:39:03.273027 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 10:39:03.273027 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:39:03.273027 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:39:03.273027 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:39:03.273027 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:39:03.273027 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:39:03.273027 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:39:03.273027 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:39:03.273027 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application with Lock( Jul 14 10:39:03.273027 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:39:03.273027 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:39:03.273027 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:39:03.273027 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:39:03.273779 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:39:03.273779 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:39:03.273779 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:39:03.273779 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:39:03.273779 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 10:39:03.273779 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 10:39:03.273779 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 10:39:03.273779 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 10:39:03.273779 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 10:39:03.273779 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 10:39:03.273779 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 14 10:39:03.273779 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application Jul 14 10:39:03.274359 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 60/123] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Jul 14 10:39:03 2022] GET /identity/v3/roles/member => generated 84 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:39:03.280498 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2775c7-c010-42d1-96f9-259ad03f2042 None admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:03.301622 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f69076-5ce0-4e7e-b65a-df768925ccfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:03.303150 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f69076-5ce0-4e7e-b65a-df768925ccfa None admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:03.303649 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f69076-5ce0-4e7e-b65a-df768925ccfa None admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:03.304185 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f69076-5ce0-4e7e-b65a-df768925ccfa None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:03.321577 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f69076-5ce0-4e7e-b65a-df768925ccfa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 10:39:03.332907 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application [None req-49f69076-5ce0-4e7e-b65a-df768925ccfa None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 10:39:03.332907 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:39:03.332907 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:39:03.332907 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:39:03.332907 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:39:03.332907 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:39:03.332907 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:39:03.332907 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:39:03.332907 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:39:03.332907 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:39:03.332907 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:39:03.332907 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:39:03.332907 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 10:39:03.332907 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 10:39:03.332907 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 10:39:03.332907 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 10:39:03.333786 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 10:39:03.333786 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 10:39:03.333786 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 10:39:03.333786 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 10:39:03.333786 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:39:03.333786 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:39:03.333786 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:39:03.333786 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:39:03.333786 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:39:03.333786 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:39:03.333786 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:39:03.333786 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application with Lock( Jul 14 10:39:03.333786 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:39:03.333786 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:39:03.333786 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:39:03.333786 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:39:03.334541 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:39:03.334541 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:39:03.334541 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:39:03.334541 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:39:03.334541 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 10:39:03.334541 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 10:39:03.334541 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 10:39:03.334541 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 10:39:03.334541 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 10:39:03.334541 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 10:39:03.334541 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 10:39:03.334541 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application Jul 14 10:39:03.342342 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 64/124] 10.222.0.16 () {56 vars in 1096 bytes} [Thu Jul 14 10:39:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:39:03.342342 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f69076-5ce0-4e7e-b65a-df768925ccfa None admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:03.349324 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=100 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:39:03.397282 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2775c7-c010-42d1-96f9-259ad03f2042 None admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:03.434247 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8915b193-5363-41e5-842a-e09ab58f9276 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:03.435107 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8915b193-5363-41e5-842a-e09ab58f9276 None admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:03.435512 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8915b193-5363-41e5-842a-e09ab58f9276 None admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:03.435718 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8915b193-5363-41e5-842a-e09ab58f9276 None admin] PATH_INFO: `/v3/projects/3d3a37cd8fb044539b71f6202165da75` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:03.436970 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8915b193-5363-41e5-842a-e09ab58f9276 None admin] RBAC: Authorizing `identity:get_project(project_id=3d3a37cd8fb044539b71f6202165da75)` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:39:03.438670 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8915b193-5363-41e5-842a-e09ab58f9276 None admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:39:03.441220 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 61/125] 10.222.0.16 () {56 vars in 1186 bytes} [Thu Jul 14 10:39:03 2022] GET /identity/v3/projects/3d3a37cd8fb044539b71f6202165da75 => generated 298 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:39:03.442008 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8915b193-5363-41e5-842a-e09ab58f9276 None admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:03.483585 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f69076-5ce0-4e7e-b65a-df768925ccfa None admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:03.500500 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=100 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:39:03.522574 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39057d5-75b7-4d61-ba73-8f1b9aaa7004 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:03.523450 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39057d5-75b7-4d61-ba73-8f1b9aaa7004 None admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:03.523734 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39057d5-75b7-4d61-ba73-8f1b9aaa7004 None admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:03.524010 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39057d5-75b7-4d61-ba73-8f1b9aaa7004 None admin] PATH_INFO: `/v3/users/e58c38e93bc5470c8e1f42d205fe21c2` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:03.525410 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39057d5-75b7-4d61-ba73-8f1b9aaa7004 None admin] RBAC: Authorizing `identity:get_user(user_id=e58c38e93bc5470c8e1f42d205fe21c2)` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:39:03.526952 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39057d5-75b7-4d61-ba73-8f1b9aaa7004 None admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:39:03.528742 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 65/126] 10.222.0.16 () {56 vars in 1177 bytes} [Thu Jul 14 10:39:03 2022] GET /identity/v3/users/e58c38e93bc5470c8e1f42d205fe21c2 => generated 275 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:39:03.533472 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39057d5-75b7-4d61-ba73-8f1b9aaa7004 None admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:03.567453 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8915b193-5363-41e5-842a-e09ab58f9276 None admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:03.592259 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=100 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:39:03.604577 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9324a8b9-c525-442c-971c-9ce23ac95c2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:03.605105 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9324a8b9-c525-442c-971c-9ce23ac95c2c None admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:03.605396 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9324a8b9-c525-442c-971c-9ce23ac95c2c None admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:03.605678 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9324a8b9-c525-442c-971c-9ce23ac95c2c None admin] PATH_INFO: `/v3/roles` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:03.606642 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9324a8b9-c525-442c-971c-9ce23ac95c2c None admin] RBAC: Adding query filter params (name=member) {{(pid=86656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:39:03.607026 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9324a8b9-c525-442c-971c-9ce23ac95c2c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:39:03.608420 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9324a8b9-c525-442c-971c-9ce23ac95c2c None admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:39:03.617793 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 62/127] 10.222.0.16 () {56 vars in 1101 bytes} [Thu Jul 14 10:39:03 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:39:03.618649 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9324a8b9-c525-442c-971c-9ce23ac95c2c None admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:03.668091 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39057d5-75b7-4d61-ba73-8f1b9aaa7004 None admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:03.707166 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea53ed3-2853-4d32-aa5a-21978596560e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:03.708221 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea53ed3-2853-4d32-aa5a-21978596560e None admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:03.708710 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea53ed3-2853-4d32-aa5a-21978596560e None admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:03.709045 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea53ed3-2853-4d32-aa5a-21978596560e None admin] PATH_INFO: `/v3/roles` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:03.710169 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea53ed3-2853-4d32-aa5a-21978596560e None admin] RBAC: Adding query filter params (name=admin) {{(pid=86655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:39:03.710484 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea53ed3-2853-4d32-aa5a-21978596560e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:39:03.711890 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea53ed3-2853-4d32-aa5a-21978596560e None admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:39:03.720544 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 66/128] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Jul 14 10:39:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:39:03.721733 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea53ed3-2853-4d32-aa5a-21978596560e None admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:03.740533 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9324a8b9-c525-442c-971c-9ce23ac95c2c None admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:03.779666 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5c55e7-f009-4d20-aafe-304e95384107 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:03.780804 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5c55e7-f009-4d20-aafe-304e95384107 None admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:03.780804 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5c55e7-f009-4d20-aafe-304e95384107 None admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:03.781061 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5c55e7-f009-4d20-aafe-304e95384107 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:03.781950 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5c55e7-f009-4d20-aafe-304e95384107 None admin] RBAC: Adding query filter params (role.id=ac28665f2a2446b8a9c98f0de3126d33, scope.project.id=3d3a37cd8fb044539b71f6202165da75, user.id=3592686c34704273a175a9090876e62d) {{(pid=86656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:39:03.782382 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5c55e7-f009-4d20-aafe-304e95384107 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:39:03.787000 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5c55e7-f009-4d20-aafe-304e95384107 None admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:39:03.788567 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=100 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:39:03.805115 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 63/129] 10.222.0.16 () {56 vars in 1374 bytes} [Thu Jul 14 10:39:03 2022] GET /identity/v3/role_assignments?user.id=3592686c34704273a175a9090876e62d&scope.project.id=3d3a37cd8fb044539b71f6202165da75&role.id=ac28665f2a2446b8a9c98f0de3126d33 => generated 259 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:39:03.806190 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5c55e7-f009-4d20-aafe-304e95384107 None admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:03.863046 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea53ed3-2853-4d32-aa5a-21978596560e None admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:03.910226 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f2c722-5fd8-494a-b8b8-878eb4b62912 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:03.911234 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f2c722-5fd8-494a-b8b8-878eb4b62912 None admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:03.911528 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f2c722-5fd8-494a-b8b8-878eb4b62912 None admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:03.911807 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f2c722-5fd8-494a-b8b8-878eb4b62912 None admin] PATH_INFO: `/v3/projects/3d3a37cd8fb044539b71f6202165da75` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:03.918856 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f2c722-5fd8-494a-b8b8-878eb4b62912 None admin] RBAC: Authorizing `identity:get_project(project_id=3d3a37cd8fb044539b71f6202165da75)` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:39:03.920401 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f2c722-5fd8-494a-b8b8-878eb4b62912 None admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:39:03.929732 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 67/130] 10.222.0.16 () {56 vars in 1186 bytes} [Thu Jul 14 10:39:03 2022] GET /identity/v3/projects/3d3a37cd8fb044539b71f6202165da75 => generated 298 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:39:03.930730 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f2c722-5fd8-494a-b8b8-878eb4b62912 None admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:03.957192 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=100 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:39:04.036585 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5c55e7-f009-4d20-aafe-304e95384107 None admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:04.104350 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f748ce5-9b64-4c4f-8807-5929f7b46fad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:04.105321 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f748ce5-9b64-4c4f-8807-5929f7b46fad None admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:04.105658 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f748ce5-9b64-4c4f-8807-5929f7b46fad None admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:04.105952 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f748ce5-9b64-4c4f-8807-5929f7b46fad None admin] PATH_INFO: `/v3/users/e58c38e93bc5470c8e1f42d205fe21c2` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:04.108664 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f748ce5-9b64-4c4f-8807-5929f7b46fad None admin] RBAC: Authorizing `identity:get_user(user_id=e58c38e93bc5470c8e1f42d205fe21c2)` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:39:04.110188 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f748ce5-9b64-4c4f-8807-5929f7b46fad None admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:39:04.116374 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 64/131] 10.222.0.16 () {56 vars in 1177 bytes} [Thu Jul 14 10:39:03 2022] GET /identity/v3/users/e58c38e93bc5470c8e1f42d205fe21c2 => generated 275 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:39:04.117180 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f748ce5-9b64-4c4f-8807-5929f7b46fad None admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:04.158688 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f2c722-5fd8-494a-b8b8-878eb4b62912 None admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:04.189139 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=100 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:39:04.226003 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64afe1ef-9d09-4c2e-aabb-f6bd3b0154b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:04.226896 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64afe1ef-9d09-4c2e-aabb-f6bd3b0154b1 None admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:04.227188 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64afe1ef-9d09-4c2e-aabb-f6bd3b0154b1 None admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:04.227473 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64afe1ef-9d09-4c2e-aabb-f6bd3b0154b1 None admin] PATH_INFO: `/v3/users/ae4bcdd8106d4bebbdcae96be33505bc` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:04.228929 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64afe1ef-9d09-4c2e-aabb-f6bd3b0154b1 None admin] RBAC: Authorizing `identity:get_user(user_id=ae4bcdd8106d4bebbdcae96be33505bc)` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:39:04.230415 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64afe1ef-9d09-4c2e-aabb-f6bd3b0154b1 None admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:39:04.232491 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 68/132] 10.222.0.16 () {56 vars in 1177 bytes} [Thu Jul 14 10:39:03 2022] GET /identity/v3/users/ae4bcdd8106d4bebbdcae96be33505bc => generated 247 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:39:04.233494 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64afe1ef-9d09-4c2e-aabb-f6bd3b0154b1 None admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:04.277153 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f748ce5-9b64-4c4f-8807-5929f7b46fad None admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:04.295969 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=100 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:39:04.316111 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9dfa95-b0ff-4646-87fb-bf796ae9aa77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:04.317513 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9dfa95-b0ff-4646-87fb-bf796ae9aa77 None admin] REQUEST_METHOD: `PUT` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:04.318052 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9dfa95-b0ff-4646-87fb-bf796ae9aa77 None admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:04.318531 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9dfa95-b0ff-4646-87fb-bf796ae9aa77 None admin] PATH_INFO: `/v3/projects/3d3a37cd8fb044539b71f6202165da75/users/e58c38e93bc5470c8e1f42d205fe21c2/roles/64ec6989f4724a8ab1e32d37c186c8f8` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:04.321193 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9dfa95-b0ff-4646-87fb-bf796ae9aa77 None admin] RBAC: Authorizing `identity:create_grant(project_id=3d3a37cd8fb044539b71f6202165da75, user_id=e58c38e93bc5470c8e1f42d205fe21c2, role_id=64ec6989f4724a8ab1e32d37c186c8f8)` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:39:04.322905 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9dfa95-b0ff-4646-87fb-bf796ae9aa77 None admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:39:04.343365 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 65/133] 10.222.0.16 () {58 vars in 1439 bytes} [Thu Jul 14 10:39:04 2022] PUT /identity/v3/projects/3d3a37cd8fb044539b71f6202165da75/users/e58c38e93bc5470c8e1f42d205fe21c2/roles/64ec6989f4724a8ab1e32d37c186c8f8 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:39:04.345415 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654bbbeb-8cc5-4a52-a67d-eb50c7440589 None None] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:04.345985 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654bbbeb-8cc5-4a52-a67d-eb50c7440589 None None] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:04.346574 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654bbbeb-8cc5-4a52-a67d-eb50c7440589 None None] PATH_INFO: `/` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:04.353032 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 66/134] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jul 14 10:39:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:39:04.354446 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654bbbeb-8cc5-4a52-a67d-eb50c7440589 None None] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:04.363439 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64afe1ef-9d09-4c2e-aabb-f6bd3b0154b1 None admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:04.458306 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8fcb4c-acfd-4d07-b9f9-fff564556f3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:04.459327 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8fcb4c-acfd-4d07-b9f9-fff564556f3e None admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:04.459626 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8fcb4c-acfd-4d07-b9f9-fff564556f3e None admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:04.459913 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8fcb4c-acfd-4d07-b9f9-fff564556f3e None admin] PATH_INFO: `/v3/projects/6bf2528ae7564dd9a6b6bafc9559875a` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:04.467020 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8fcb4c-acfd-4d07-b9f9-fff564556f3e None admin] RBAC: Authorizing `identity:get_project(project_id=6bf2528ae7564dd9a6b6bafc9559875a)` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:39:04.468534 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8fcb4c-acfd-4d07-b9f9-fff564556f3e None admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:39:04.470633 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 69/135] 10.222.0.16 () {56 vars in 1186 bytes} [Thu Jul 14 10:39:04 2022] GET /identity/v3/projects/6bf2528ae7564dd9a6b6bafc9559875a => generated 312 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:39:04.482010 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67225dac-574d-4b9e-9587-d7a8f351ef17 None None] REQUEST_METHOD: `POST` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:04.482343 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67225dac-574d-4b9e-9587-d7a8f351ef17 None None] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:04.482775 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67225dac-574d-4b9e-9587-d7a8f351ef17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:04.507964 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654bbbeb-8cc5-4a52-a67d-eb50c7440589 None None] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:04.519844 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.auth.core [None req-67225dac-574d-4b9e-9587-d7a8f351ef17 None None] MFA Rules not processed for user `ae4bcdd8106d4bebbdcae96be33505bc`. Rule list: `[]` (Enabled: `True`). {{(pid=86655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:39:04.521592 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-67225dac-574d-4b9e-9587-d7a8f351ef17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:39:04.569675 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ae8101-1e01-4b46-af26-48e3c328d025 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:04.570996 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ae8101-1e01-4b46-af26-48e3c328d025 None admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:04.571517 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ae8101-1e01-4b46-af26-48e3c328d025 None admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:04.571973 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ae8101-1e01-4b46-af26-48e3c328d025 None admin] PATH_INFO: `/v3/projects/3d3a37cd8fb044539b71f6202165da75` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:04.573407 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ae8101-1e01-4b46-af26-48e3c328d025 None admin] RBAC: Authorizing `identity:get_project(project_id=3d3a37cd8fb044539b71f6202165da75)` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:39:04.575797 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ae8101-1e01-4b46-af26-48e3c328d025 None admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:39:04.578028 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 67/136] 10.222.0.16 () {56 vars in 1186 bytes} [Thu Jul 14 10:39:04 2022] GET /identity/v3/projects/3d3a37cd8fb044539b71f6202165da75 => generated 298 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:39:04.579173 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ae8101-1e01-4b46-af26-48e3c328d025 None admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:04.620834 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=100 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:39:04.641248 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:39:04.665198 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 70/137] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jul 14 10:39:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 10:39:04.665198 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67225dac-574d-4b9e-9587-d7a8f351ef17 None None] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:04.734636 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ae8101-1e01-4b46-af26-48e3c328d025 None admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:04.796801 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f0320d-d687-48a0-86db-626a1e5e44d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:04.796801 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f0320d-d687-48a0-86db-626a1e5e44d0 None admin] REQUEST_METHOD: `PUT` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:04.796801 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f0320d-d687-48a0-86db-626a1e5e44d0 None admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:04.796801 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f0320d-d687-48a0-86db-626a1e5e44d0 None admin] PATH_INFO: `/v3/projects/6bf2528ae7564dd9a6b6bafc9559875a/users/e58c38e93bc5470c8e1f42d205fe21c2/roles/0da46c267d354cce81495dfdd56c1ec2` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:04.797599 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f0320d-d687-48a0-86db-626a1e5e44d0 None admin] RBAC: Authorizing `identity:create_grant(project_id=6bf2528ae7564dd9a6b6bafc9559875a, user_id=e58c38e93bc5470c8e1f42d205fe21c2, role_id=0da46c267d354cce81495dfdd56c1ec2)` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:39:04.798699 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f0320d-d687-48a0-86db-626a1e5e44d0 None admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:39:04.818869 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 68/138] 10.222.0.16 () {58 vars in 1439 bytes} [Thu Jul 14 10:39:04 2022] PUT /identity/v3/projects/6bf2528ae7564dd9a6b6bafc9559875a/users/e58c38e93bc5470c8e1f42d205fe21c2/roles/0da46c267d354cce81495dfdd56c1ec2 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:39:04.825664 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f0320d-d687-48a0-86db-626a1e5e44d0 None admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:04.876681 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67225dac-574d-4b9e-9587-d7a8f351ef17 None None] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:04.960713 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a191a35c-1e91-4239-86e9-4a3e261f18f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:04.961739 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a191a35c-1e91-4239-86e9-4a3e261f18f7 None admin] REQUEST_METHOD: `PUT` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:04.962110 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a191a35c-1e91-4239-86e9-4a3e261f18f7 None admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:04.962467 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a191a35c-1e91-4239-86e9-4a3e261f18f7 None admin] PATH_INFO: `/v3/projects/3d3a37cd8fb044539b71f6202165da75/users/ae4bcdd8106d4bebbdcae96be33505bc/roles/153539819e5542df99269d2913bbecfb` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:04.964883 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a191a35c-1e91-4239-86e9-4a3e261f18f7 None admin] RBAC: Authorizing `identity:create_grant(project_id=3d3a37cd8fb044539b71f6202165da75, user_id=ae4bcdd8106d4bebbdcae96be33505bc, role_id=153539819e5542df99269d2913bbecfb)` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:39:04.966364 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a191a35c-1e91-4239-86e9-4a3e261f18f7 None admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:39:04.990646 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f0320d-d687-48a0-86db-626a1e5e44d0 None admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:05.000140 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:39:05.004226 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 71/139] 10.222.0.16 () {58 vars in 1439 bytes} [Thu Jul 14 10:39:04 2022] PUT /identity/v3/projects/3d3a37cd8fb044539b71f6202165da75/users/ae4bcdd8106d4bebbdcae96be33505bc/roles/153539819e5542df99269d2913bbecfb => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:39:05.006663 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c8c50f-c75c-4a5d-b705-05b12a1e8645 None None] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:05.006959 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c8c50f-c75c-4a5d-b705-05b12a1e8645 None None] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:05.007241 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c8c50f-c75c-4a5d-b705-05b12a1e8645 None None] PATH_INFO: `/` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:05.013035 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 72/140] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jul 14 10:39:05 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:39:05.014684 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207c3200-2e99-4667-b228-644f7ba783e3 None None] REQUEST_METHOD: `POST` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:05.014982 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207c3200-2e99-4667-b228-644f7ba783e3 None None] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:05.015270 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207c3200-2e99-4667-b228-644f7ba783e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:05.042367 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b994348e-485b-4367-8b9b-04a6f44577a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:05.043224 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b994348e-485b-4367-8b9b-04a6f44577a9 None admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:05.043521 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b994348e-485b-4367-8b9b-04a6f44577a9 None admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:05.043804 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b994348e-485b-4367-8b9b-04a6f44577a9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:05.051052 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.auth.core [None req-207c3200-2e99-4667-b228-644f7ba783e3 None None] MFA Rules not processed for user `ae4bcdd8106d4bebbdcae96be33505bc`. Rule list: `[]` (Enabled: `True`). {{(pid=86655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:39:05.052700 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-207c3200-2e99-4667-b228-644f7ba783e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:39:05.058100 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b994348e-485b-4367-8b9b-04a6f44577a9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 10:39:05.070877 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application [None req-b994348e-485b-4367-8b9b-04a6f44577a9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 14 10:39:05.070877 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:39:05.070877 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:39:05.070877 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:39:05.070877 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:39:05.070877 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:39:05.070877 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:39:05.070877 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:39:05.070877 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:39:05.070877 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:39:05.070877 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:39:05.070877 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:39:05.070877 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 10:39:05.070877 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 10:39:05.070877 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 10:39:05.070877 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 10:39:05.071797 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 10:39:05.071797 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 10:39:05.071797 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 10:39:05.071797 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 10:39:05.071797 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:39:05.071797 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:39:05.071797 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:39:05.071797 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:39:05.071797 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:39:05.071797 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:39:05.071797 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:39:05.071797 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application with Lock( Jul 14 10:39:05.071797 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:39:05.071797 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:39:05.071797 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:39:05.071797 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:39:05.072568 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:39:05.072568 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:39:05.072568 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:39:05.072568 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:39:05.072568 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 10:39:05.072568 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 10:39:05.072568 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 10:39:05.072568 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 10:39:05.072568 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 10:39:05.072568 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 10:39:05.072568 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 14 10:39:05.072568 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application Jul 14 10:39:05.072568 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 69/141] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Jul 14 10:39:04 2022] GET /identity/v3/roles/member => generated 84 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:39:05.078417 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b994348e-485b-4367-8b9b-04a6f44577a9 None admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:05.106447 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:39:05.160407 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 73/142] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jul 14 10:39:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 10:39:05.190062 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207c3200-2e99-4667-b228-644f7ba783e3 None None] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:05.204809 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b994348e-485b-4367-8b9b-04a6f44577a9 None admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:05.243911 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53841510-eacc-4c03-a2ed-b692163222e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:05.244970 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53841510-eacc-4c03-a2ed-b692163222e4 None admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:05.245487 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53841510-eacc-4c03-a2ed-b692163222e4 None admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:05.245978 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53841510-eacc-4c03-a2ed-b692163222e4 None admin] PATH_INFO: `/v3/roles` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:05.247067 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53841510-eacc-4c03-a2ed-b692163222e4 None admin] RBAC: Adding query filter params (name=member) {{(pid=86656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:39:05.247644 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53841510-eacc-4c03-a2ed-b692163222e4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:39:05.249364 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53841510-eacc-4c03-a2ed-b692163222e4 None admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:39:05.259095 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 70/143] 10.222.0.16 () {56 vars in 1101 bytes} [Thu Jul 14 10:39:05 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 10:39:05.265892 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53841510-eacc-4c03-a2ed-b692163222e4 None admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:05.318847 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207c3200-2e99-4667-b228-644f7ba783e3 None None] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:05.321259 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=100 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:39:05.360140 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8d52b8-5fd6-4696-a97d-ed9af848042f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:05.361107 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8d52b8-5fd6-4696-a97d-ed9af848042f None admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:05.361391 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8d52b8-5fd6-4696-a97d-ed9af848042f None admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:05.361669 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8d52b8-5fd6-4696-a97d-ed9af848042f None admin] PATH_INFO: `/v3/domains/default` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:05.363130 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8d52b8-5fd6-4696-a97d-ed9af848042f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:39:05.364942 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8d52b8-5fd6-4696-a97d-ed9af848042f None admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:39:05.366584 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 74/144] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Jul 14 10:39:05 2022] GET /identity/v3/domains/default => generated 199 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 10:39:05.373260 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8d52b8-5fd6-4696-a97d-ed9af848042f None admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:05.416531 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=100 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:39:05.477643 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53841510-eacc-4c03-a2ed-b692163222e4 None admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:05.574201 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1266aeae-d82b-4a10-a2eb-9532fb701040 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:05.575090 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1266aeae-d82b-4a10-a2eb-9532fb701040 None admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:05.575378 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1266aeae-d82b-4a10-a2eb-9532fb701040 None admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:05.575660 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1266aeae-d82b-4a10-a2eb-9532fb701040 None admin] PATH_INFO: `/v3/users/e58c38e93bc5470c8e1f42d205fe21c2` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:05.577017 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1266aeae-d82b-4a10-a2eb-9532fb701040 None admin] RBAC: Authorizing `identity:get_user(user_id=e58c38e93bc5470c8e1f42d205fe21c2)` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:39:05.578499 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1266aeae-d82b-4a10-a2eb-9532fb701040 None admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:39:05.580150 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 71/145] 10.222.0.16 () {56 vars in 1177 bytes} [Thu Jul 14 10:39:05 2022] GET /identity/v3/users/e58c38e93bc5470c8e1f42d205fe21c2 => generated 275 bytes in 315 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:39:05.590311 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8d52b8-5fd6-4696-a97d-ed9af848042f None admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:05.592359 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1266aeae-d82b-4a10-a2eb-9532fb701040 None admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:05.656341 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5642d1cf-16de-41db-8b8c-a5bf6337a395 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:05.657065 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5642d1cf-16de-41db-8b8c-a5bf6337a395 None admin] REQUEST_METHOD: `POST` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:05.657351 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5642d1cf-16de-41db-8b8c-a5bf6337a395 None admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:05.657749 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5642d1cf-16de-41db-8b8c-a5bf6337a395 None admin] PATH_INFO: `/v3/users` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:05.658490 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5642d1cf-16de-41db-8b8c-a5bf6337a395 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:39:05.660193 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5642d1cf-16de-41db-8b8c-a5bf6337a395 None admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:39:05.702176 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 75/146] 10.222.0.16 () {60 vars in 1132 bytes} [Thu Jul 14 10:39:05 2022] POST /identity/v3/users => generated 283 bytes in 329 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 10:39:05.763893 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=100 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:39:05.770267 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1266aeae-d82b-4a10-a2eb-9532fb701040 None admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:05.810127 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff15ac2-dc40-4376-b2b9-23580cbd7c0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:05.810890 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff15ac2-dc40-4376-b2b9-23580cbd7c0f None admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:05.811132 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff15ac2-dc40-4376-b2b9-23580cbd7c0f None admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:05.811421 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff15ac2-dc40-4376-b2b9-23580cbd7c0f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:05.895417 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff15ac2-dc40-4376-b2b9-23580cbd7c0f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:39:05.896867 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff15ac2-dc40-4376-b2b9-23580cbd7c0f None admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:39:05.999271 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=100 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:39:06.006133 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 72/147] 10.222.0.16 () {58 vars in 1282 bytes} [Thu Jul 14 10:39:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 419 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 10:39:06.012839 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5642d1cf-16de-41db-8b8c-a5bf6337a395 None admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:06.145834 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:39:06.156881 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5642d1cf-16de-41db-8b8c-a5bf6337a395 None admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:06.205456 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db89625-830d-4d7e-85aa-09796759cdda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:06.206585 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db89625-830d-4d7e-85aa-09796759cdda None admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:06.207004 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db89625-830d-4d7e-85aa-09796759cdda None admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:06.207513 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db89625-830d-4d7e-85aa-09796759cdda None admin] PATH_INFO: `/v3/projects/3d3a37cd8fb044539b71f6202165da75` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:06.208896 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db89625-830d-4d7e-85aa-09796759cdda None admin] RBAC: Authorizing `identity:get_project(project_id=3d3a37cd8fb044539b71f6202165da75)` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:39:06.210491 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db89625-830d-4d7e-85aa-09796759cdda None admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:39:06.212332 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 76/148] 10.222.0.16 () {56 vars in 1186 bytes} [Thu Jul 14 10:39:06 2022] GET /identity/v3/projects/3d3a37cd8fb044539b71f6202165da75 => generated 298 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:39:06.218360 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff15ac2-dc40-4376-b2b9-23580cbd7c0f None admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:06.333467 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff15ac2-dc40-4376-b2b9-23580cbd7c0f None admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:06.368693 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9f7599-b119-49b1-a9e5-56e0f4d00a18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:06.369460 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9f7599-b119-49b1-a9e5-56e0f4d00a18 None admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:06.369749 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9f7599-b119-49b1-a9e5-56e0f4d00a18 None admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:06.370030 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9f7599-b119-49b1-a9e5-56e0f4d00a18 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:06.370973 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9f7599-b119-49b1-a9e5-56e0f4d00a18 None admin] RBAC: Adding query filter params (role.id=0da46c267d354cce81495dfdd56c1ec2, scope.project.id=3d3a37cd8fb044539b71f6202165da75, user.id=e58c38e93bc5470c8e1f42d205fe21c2) {{(pid=86656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:39:06.371292 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9f7599-b119-49b1-a9e5-56e0f4d00a18 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:39:06.372757 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9f7599-b119-49b1-a9e5-56e0f4d00a18 None admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:39:06.379477 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 73/149] 10.222.0.16 () {56 vars in 1374 bytes} [Thu Jul 14 10:39:06 2022] GET /identity/v3/role_assignments?user.id=e58c38e93bc5470c8e1f42d205fe21c2&scope.project.id=3d3a37cd8fb044539b71f6202165da75&role.id=0da46c267d354cce81495dfdd56c1ec2 => generated 608 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:39:06.650018 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd046e1-3bb0-4d3d-94f3-ae9e105e02c2 None None] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:06.650720 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd046e1-3bb0-4d3d-94f3-ae9e105e02c2 None None] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:06.651201 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd046e1-3bb0-4d3d-94f3-ae9e105e02c2 None None] PATH_INFO: `/` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:06.652816 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 77/150] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jul 14 10:39:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:39:06.658565 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94849a85-0404-4dcf-8a87-4558d4036391 None None] REQUEST_METHOD: `POST` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:06.658857 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94849a85-0404-4dcf-8a87-4558d4036391 None None] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:06.659201 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94849a85-0404-4dcf-8a87-4558d4036391 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:06.681819 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.auth.core [None req-94849a85-0404-4dcf-8a87-4558d4036391 None None] MFA Rules not processed for user `ae4bcdd8106d4bebbdcae96be33505bc`. Rule list: `[]` (Enabled: `True`). {{(pid=86656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:39:06.683040 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-94849a85-0404-4dcf-8a87-4558d4036391 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:39:06.752606 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=100 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:39:06.771592 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 74/151] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jul 14 10:39:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 10:39:06.810851 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd046e1-3bb0-4d3d-94f3-ae9e105e02c2 None None] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:06.934086 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd046e1-3bb0-4d3d-94f3-ae9e105e02c2 None None] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:06.973359 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d10331-e940-405b-996e-7976507063ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:06.974171 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d10331-e940-405b-996e-7976507063ea None admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:06.974468 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d10331-e940-405b-996e-7976507063ea None admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:06.974735 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d10331-e940-405b-996e-7976507063ea None admin] PATH_INFO: `/v3/roles/reader` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:06.985427 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d10331-e940-405b-996e-7976507063ea None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 10:39:06.994090 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application [None req-72d10331-e940-405b-996e-7976507063ea None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 14 10:39:06.994090 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:39:06.994090 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:39:06.994090 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:39:06.994090 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:39:06.994090 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:39:06.994090 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:39:06.994090 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:39:06.994090 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:39:06.994090 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:39:06.994090 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:39:06.994090 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:39:06.994090 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 10:39:06.994090 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 10:39:06.994090 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 10:39:06.994090 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 10:39:06.994940 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 10:39:06.994940 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 10:39:06.994940 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 10:39:06.994940 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 10:39:06.994940 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:39:06.994940 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:39:06.994940 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:39:06.994940 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:39:06.994940 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:39:06.994940 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:39:06.994940 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:39:06.994940 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application with Lock( Jul 14 10:39:06.994940 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:39:06.994940 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:39:06.994940 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:39:06.994940 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:39:06.995685 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:39:06.995685 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:39:06.995685 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:39:06.995685 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:39:06.995685 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 10:39:06.995685 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 10:39:06.995685 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 10:39:06.995685 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 10:39:06.995685 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 10:39:06.995685 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 10:39:06.995685 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 14 10:39:06.995685 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application Jul 14 10:39:06.995685 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 78/152] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Jul 14 10:39:06 2022] GET /identity/v3/roles/reader => generated 84 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:39:07.003843 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94849a85-0404-4dcf-8a87-4558d4036391 None None] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:07.172674 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94849a85-0404-4dcf-8a87-4558d4036391 None None] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:07.218066 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5d2180-be67-4df9-a308-ee2a899b13e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:07.218672 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5d2180-be67-4df9-a308-ee2a899b13e8 None admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:07.218961 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5d2180-be67-4df9-a308-ee2a899b13e8 None admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:07.219242 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5d2180-be67-4df9-a308-ee2a899b13e8 None admin] PATH_INFO: `/v3/roles` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:07.220009 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5d2180-be67-4df9-a308-ee2a899b13e8 None admin] RBAC: Adding query filter params (name=reader) {{(pid=86656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:39:07.220325 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5d2180-be67-4df9-a308-ee2a899b13e8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:39:07.221796 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5d2180-be67-4df9-a308-ee2a899b13e8 None admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:39:07.232670 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 75/153] 10.222.0.16 () {56 vars in 1101 bytes} [Thu Jul 14 10:39:07 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:39:07.239489 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d10331-e940-405b-996e-7976507063ea None admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:07.279533 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=100 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:39:07.285427 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52dda442-80a7-4924-9736-29b148f3a517 None None] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:07.285722 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52dda442-80a7-4924-9736-29b148f3a517 None None] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:07.286040 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52dda442-80a7-4924-9736-29b148f3a517 None None] PATH_INFO: `/` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:07.287406 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 76/154] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jul 14 10:39:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 14 10:39:07.295707 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26adebff-1233-4bdb-8e05-bc4e68f8ea59 None None] REQUEST_METHOD: `POST` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:07.296002 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26adebff-1233-4bdb-8e05-bc4e68f8ea59 None None] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:07.296280 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26adebff-1233-4bdb-8e05-bc4e68f8ea59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:07.325454 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.auth.core [None req-26adebff-1233-4bdb-8e05-bc4e68f8ea59 None None] MFA Rules not processed for user `ae4bcdd8106d4bebbdcae96be33505bc`. Rule list: `[]` (Enabled: `True`). {{(pid=86656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:39:07.326680 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-26adebff-1233-4bdb-8e05-bc4e68f8ea59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:39:07.392659 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d10331-e940-405b-996e-7976507063ea None admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:07.401964 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=100 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:39:07.428079 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 77/155] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jul 14 10:39:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 10:39:07.438190 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1966f665-418d-4e2d-817f-0fc936c62642 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:07.439085 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1966f665-418d-4e2d-817f-0fc936c62642 None admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:07.439376 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1966f665-418d-4e2d-817f-0fc936c62642 None admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:07.439654 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1966f665-418d-4e2d-817f-0fc936c62642 None admin] PATH_INFO: `/v3/users/3592686c34704273a175a9090876e62d` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:07.441497 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1966f665-418d-4e2d-817f-0fc936c62642 None admin] RBAC: Authorizing `identity:get_user(user_id=3592686c34704273a175a9090876e62d)` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:39:07.442978 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1966f665-418d-4e2d-817f-0fc936c62642 None admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:39:07.445026 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 79/156] 10.222.0.16 () {56 vars in 1177 bytes} [Thu Jul 14 10:39:07 2022] GET /identity/v3/users/3592686c34704273a175a9090876e62d => generated 289 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:39:07.450498 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26adebff-1233-4bdb-8e05-bc4e68f8ea59 None None] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:07.472598 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1966f665-418d-4e2d-817f-0fc936c62642 None admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:07.599514 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26adebff-1233-4bdb-8e05-bc4e68f8ea59 None None] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:07.635908 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=100 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:39:07.656760 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e679351f-ad86-4bef-b1da-34de0bf95d8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:07.657665 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e679351f-ad86-4bef-b1da-34de0bf95d8d None admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:07.657950 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e679351f-ad86-4bef-b1da-34de0bf95d8d None admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:07.658225 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e679351f-ad86-4bef-b1da-34de0bf95d8d None admin] PATH_INFO: `/v3/projects/3d3a37cd8fb044539b71f6202165da75` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:07.660203 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e679351f-ad86-4bef-b1da-34de0bf95d8d None admin] RBAC: Authorizing `identity:get_project(project_id=3d3a37cd8fb044539b71f6202165da75)` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:39:07.660308 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1966f665-418d-4e2d-817f-0fc936c62642 None admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:07.661694 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e679351f-ad86-4bef-b1da-34de0bf95d8d None admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:39:07.663596 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 78/157] 10.222.0.16 () {56 vars in 1186 bytes} [Thu Jul 14 10:39:07 2022] GET /identity/v3/projects/3d3a37cd8fb044539b71f6202165da75 => generated 298 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:39:07.674039 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e679351f-ad86-4bef-b1da-34de0bf95d8d None admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:07.733641 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d3dcdb-5aa4-4275-b503-5cd3f245fdd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:07.734402 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d3dcdb-5aa4-4275-b503-5cd3f245fdd5 None admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:07.734691 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d3dcdb-5aa4-4275-b503-5cd3f245fdd5 None admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:07.734979 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d3dcdb-5aa4-4275-b503-5cd3f245fdd5 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:07.750849 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d3dcdb-5aa4-4275-b503-5cd3f245fdd5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 10:39:07.765372 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=100 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:39:07.765693 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application [None req-63d3dcdb-5aa4-4275-b503-5cd3f245fdd5 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 14 10:39:07.765693 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:39:07.765693 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:39:07.765693 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:39:07.765693 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:39:07.765693 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:39:07.765693 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:39:07.765693 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:39:07.765693 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:39:07.765693 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:39:07.765693 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:39:07.765693 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:39:07.765693 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 10:39:07.765693 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 10:39:07.765693 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 10:39:07.765693 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 10:39:07.766599 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 10:39:07.766599 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 10:39:07.766599 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 10:39:07.766599 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 10:39:07.766599 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:39:07.766599 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:39:07.766599 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:39:07.766599 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:39:07.766599 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:39:07.766599 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:39:07.766599 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:39:07.766599 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application with Lock( Jul 14 10:39:07.766599 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:39:07.766599 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:39:07.766599 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:39:07.766599 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:39:07.767783 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:39:07.767783 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:39:07.767783 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:39:07.767783 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:39:07.767783 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 10:39:07.767783 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 10:39:07.767783 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 10:39:07.767783 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 10:39:07.767783 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 10:39:07.767783 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 10:39:07.767783 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 14 10:39:07.767783 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application Jul 14 10:39:07.767783 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 80/158] 10.222.0.16 () {56 vars in 1114 bytes} [Thu Jul 14 10:39:07 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 296 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:39:07.778241 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d3dcdb-5aa4-4275-b503-5cd3f245fdd5 None admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:07.861435 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e679351f-ad86-4bef-b1da-34de0bf95d8d None admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:07.927312 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0228a4a5-3ee2-4044-a523-08190f8ce98d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:07.928232 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0228a4a5-3ee2-4044-a523-08190f8ce98d None admin] REQUEST_METHOD: `PUT` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:07.928582 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0228a4a5-3ee2-4044-a523-08190f8ce98d None admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:07.928871 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0228a4a5-3ee2-4044-a523-08190f8ce98d None admin] PATH_INFO: `/v3/projects/3d3a37cd8fb044539b71f6202165da75/users/3592686c34704273a175a9090876e62d/roles/ac28665f2a2446b8a9c98f0de3126d33` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:07.930891 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0228a4a5-3ee2-4044-a523-08190f8ce98d None admin] RBAC: Authorizing `identity:create_grant(project_id=3d3a37cd8fb044539b71f6202165da75, user_id=3592686c34704273a175a9090876e62d, role_id=ac28665f2a2446b8a9c98f0de3126d33)` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:39:07.932360 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0228a4a5-3ee2-4044-a523-08190f8ce98d None admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:39:07.947549 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d3dcdb-5aa4-4275-b503-5cd3f245fdd5 None admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:07.964185 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 79/159] 10.222.0.16 () {58 vars in 1439 bytes} [Thu Jul 14 10:39:07 2022] PUT /identity/v3/projects/3d3a37cd8fb044539b71f6202165da75/users/3592686c34704273a175a9090876e62d/roles/ac28665f2a2446b8a9c98f0de3126d33 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:39:07.965550 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5856dd72-7883-4116-9368-14e191a2f667 None None] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:07.965840 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5856dd72-7883-4116-9368-14e191a2f667 None None] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:07.966119 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5856dd72-7883-4116-9368-14e191a2f667 None None] PATH_INFO: `/` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:07.972984 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 80/160] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jul 14 10:39:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:39:07.977676 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50adec7-67d9-4b40-8d1a-70644ddf7122 None None] REQUEST_METHOD: `POST` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:07.977974 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50adec7-67d9-4b40-8d1a-70644ddf7122 None None] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:07.978384 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50adec7-67d9-4b40-8d1a-70644ddf7122 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:08.014974 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.auth.core [None req-e50adec7-67d9-4b40-8d1a-70644ddf7122 None None] MFA Rules not processed for user `ae4bcdd8106d4bebbdcae96be33505bc`. Rule list: `[]` (Enabled: `True`). {{(pid=86656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:39:08.016120 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-e50adec7-67d9-4b40-8d1a-70644ddf7122 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:39:08.028308 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2d99e5-bae4-4f18-b61e-1808a16031ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:08.029487 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2d99e5-bae4-4f18-b61e-1808a16031ed None admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:08.030068 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2d99e5-bae4-4f18-b61e-1808a16031ed None admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:08.030587 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2d99e5-bae4-4f18-b61e-1808a16031ed None admin] PATH_INFO: `/v3/roles` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:08.032059 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2d99e5-bae4-4f18-b61e-1808a16031ed None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:39:08.032595 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2d99e5-bae4-4f18-b61e-1808a16031ed None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:39:08.034993 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2d99e5-bae4-4f18-b61e-1808a16031ed None admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:39:08.055288 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 81/161] 10.222.0.16 () {56 vars in 1111 bytes} [Thu Jul 14 10:39:07 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 10:39:08.062662 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2d99e5-bae4-4f18-b61e-1808a16031ed None admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:08.083239 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=100 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:39:08.172714 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 81/162] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jul 14 10:39:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 14 10:39:08.210386 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50adec7-67d9-4b40-8d1a-70644ddf7122 None None] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:08.267811 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2d99e5-bae4-4f18-b61e-1808a16031ed None admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:08.296875 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:39:08.349556 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651d5479-79ed-4d2b-88fd-f71e6e348946 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:08.350456 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651d5479-79ed-4d2b-88fd-f71e6e348946 None admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:08.350743 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651d5479-79ed-4d2b-88fd-f71e6e348946 None admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:08.351023 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651d5479-79ed-4d2b-88fd-f71e6e348946 None admin] PATH_INFO: `/v3/users/e58c38e93bc5470c8e1f42d205fe21c2` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:08.352509 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651d5479-79ed-4d2b-88fd-f71e6e348946 None admin] RBAC: Authorizing `identity:get_user(user_id=e58c38e93bc5470c8e1f42d205fe21c2)` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:39:08.354083 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651d5479-79ed-4d2b-88fd-f71e6e348946 None admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:39:08.356332 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 82/163] 10.222.0.16 () {56 vars in 1177 bytes} [Thu Jul 14 10:39:08 2022] GET /identity/v3/users/e58c38e93bc5470c8e1f42d205fe21c2 => generated 275 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 10:39:08.357784 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0d9b66-244d-4c0b-9a38-f4a4aab5086f None None] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:08.358177 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0d9b66-244d-4c0b-9a38-f4a4aab5086f None None] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:08.358464 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0d9b66-244d-4c0b-9a38-f4a4aab5086f None None] PATH_INFO: `/` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:08.359812 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 83/164] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jul 14 10:39:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:39:08.364256 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50adec7-67d9-4b40-8d1a-70644ddf7122 None None] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:08.365191 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0d9b66-244d-4c0b-9a38-f4a4aab5086f None None] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:08.402277 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e79121b-0e06-42e1-8b46-a6e24e18126d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:08.403084 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e79121b-0e06-42e1-8b46-a6e24e18126d None admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:08.403370 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e79121b-0e06-42e1-8b46-a6e24e18126d None admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:08.403641 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e79121b-0e06-42e1-8b46-a6e24e18126d None admin] PATH_INFO: `/v3/roles/member` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:08.414419 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e79121b-0e06-42e1-8b46-a6e24e18126d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 10:39:08.422225 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application [None req-0e79121b-0e06-42e1-8b46-a6e24e18126d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 14 10:39:08.422225 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:39:08.422225 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:39:08.422225 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:39:08.422225 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:39:08.422225 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:39:08.422225 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:39:08.422225 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:39:08.422225 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:39:08.422225 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:39:08.422225 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:39:08.422225 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:39:08.422225 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 10:39:08.422225 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 10:39:08.422225 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 10:39:08.422225 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 10:39:08.423089 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 10:39:08.423089 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 10:39:08.423089 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 10:39:08.423089 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 10:39:08.423089 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:39:08.423089 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:39:08.423089 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:39:08.423089 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:39:08.423089 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:39:08.423089 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:39:08.423089 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:39:08.423089 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application with Lock( Jul 14 10:39:08.423089 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:39:08.423089 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:39:08.423089 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:39:08.423089 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:39:08.423837 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:39:08.423837 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:39:08.423837 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:39:08.423837 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:39:08.423837 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 10:39:08.423837 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 10:39:08.423837 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 10:39:08.423837 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 10:39:08.423837 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 10:39:08.423837 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 10:39:08.423837 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 14 10:39:08.423837 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application Jul 14 10:39:08.423837 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 82/165] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Jul 14 10:39:08 2022] GET /identity/v3/roles/member => generated 84 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:39:08.425305 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965cbd45-5f10-430a-8641-29edc2d25f83 None None] REQUEST_METHOD: `POST` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:08.425823 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965cbd45-5f10-430a-8641-29edc2d25f83 None None] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:08.425983 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965cbd45-5f10-430a-8641-29edc2d25f83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:08.443463 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.auth.core [None req-965cbd45-5f10-430a-8641-29edc2d25f83 None None] MFA Rules not processed for user `ae4bcdd8106d4bebbdcae96be33505bc`. Rule list: `[]` (Enabled: `True`). {{(pid=86656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:39:08.444669 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-965cbd45-5f10-430a-8641-29edc2d25f83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:39:08.462080 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=100 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:39:08.487670 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0d9b66-244d-4c0b-9a38-f4a4aab5086f None None] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:08.516786 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 83/166] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jul 14 10:39:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 10:39:08.517584 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965cbd45-5f10-430a-8641-29edc2d25f83 None None] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:08.529997 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c62140-5720-4b70-a507-1302fe55c7de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:08.530645 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c62140-5720-4b70-a507-1302fe55c7de None admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:08.530934 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c62140-5720-4b70-a507-1302fe55c7de None admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:08.531211 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c62140-5720-4b70-a507-1302fe55c7de None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:08.548032 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=100 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:39:08.623722 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965cbd45-5f10-430a-8641-29edc2d25f83 None None] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:08.631292 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c62140-5720-4b70-a507-1302fe55c7de None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:39:08.632921 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c62140-5720-4b70-a507-1302fe55c7de None admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:39:08.661396 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acca30e-8f43-456a-8c30-6dd748d277bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:08.662180 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acca30e-8f43-456a-8c30-6dd748d277bd None admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:08.662537 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acca30e-8f43-456a-8c30-6dd748d277bd None admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:08.662885 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acca30e-8f43-456a-8c30-6dd748d277bd None admin] PATH_INFO: `/v3/roles` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:08.663722 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0acca30e-8f43-456a-8c30-6dd748d277bd None admin] RBAC: Adding query filter params (name=member) {{(pid=86656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:39:08.664122 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0acca30e-8f43-456a-8c30-6dd748d277bd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:39:08.665657 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0acca30e-8f43-456a-8c30-6dd748d277bd None admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:39:08.674652 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 84/167] 10.222.0.16 () {56 vars in 1101 bytes} [Thu Jul 14 10:39:08 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:39:08.675618 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acca30e-8f43-456a-8c30-6dd748d277bd None admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:08.726056 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=100 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:39:08.752274 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 84/168] 10.222.0.16 () {58 vars in 1282 bytes} [Thu Jul 14 10:39:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 10:39:08.753123 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c62140-5720-4b70-a507-1302fe55c7de None admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:08.774565 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=100 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:39:08.783770 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acca30e-8f43-456a-8c30-6dd748d277bd None admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:08.820327 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3378b0c-4a6a-482e-b249-86957ab406f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:08.821313 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3378b0c-4a6a-482e-b249-86957ab406f5 None admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:08.821674 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3378b0c-4a6a-482e-b249-86957ab406f5 None admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:08.822020 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3378b0c-4a6a-482e-b249-86957ab406f5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:08.847655 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3378b0c-4a6a-482e-b249-86957ab406f5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 10:39:08.855433 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application [None req-e3378b0c-4a6a-482e-b249-86957ab406f5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 10:39:08.855433 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:39:08.855433 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:39:08.855433 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:39:08.855433 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:39:08.855433 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:39:08.855433 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:39:08.855433 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:39:08.855433 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:39:08.855433 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:39:08.855433 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:39:08.855433 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:39:08.855433 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 10:39:08.855433 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 10:39:08.855433 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 10:39:08.855433 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 10:39:08.856367 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 10:39:08.856367 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 10:39:08.856367 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 10:39:08.856367 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 10:39:08.856367 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:39:08.856367 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:39:08.856367 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:39:08.856367 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:39:08.856367 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:39:08.856367 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:39:08.856367 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:39:08.856367 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application with Lock( Jul 14 10:39:08.856367 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:39:08.856367 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:39:08.856367 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:39:08.856367 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:39:08.857160 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:39:08.857160 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:39:08.857160 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:39:08.857160 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:39:08.857160 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 10:39:08.857160 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 10:39:08.857160 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 10:39:08.857160 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 10:39:08.857160 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 10:39:08.857160 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 10:39:08.857160 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 10:39:08.857160 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application Jul 14 10:39:08.857160 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 85/169] 10.222.0.16 () {56 vars in 1096 bytes} [Thu Jul 14 10:39:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:39:08.857805 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3378b0c-4a6a-482e-b249-86957ab406f5 None admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:08.907035 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c62140-5720-4b70-a507-1302fe55c7de None admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:08.961519 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fbff1c-8e8f-448a-a310-c66ea4edb168 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:08.962404 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fbff1c-8e8f-448a-a310-c66ea4edb168 None admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:08.962688 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fbff1c-8e8f-448a-a310-c66ea4edb168 None admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:08.962967 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fbff1c-8e8f-448a-a310-c66ea4edb168 None admin] PATH_INFO: `/v3/users/e58c38e93bc5470c8e1f42d205fe21c2` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:08.965334 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3378b0c-4a6a-482e-b249-86957ab406f5 None admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:08.967435 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4fbff1c-8e8f-448a-a310-c66ea4edb168 None admin] RBAC: Authorizing `identity:get_user(user_id=e58c38e93bc5470c8e1f42d205fe21c2)` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:39:08.968918 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4fbff1c-8e8f-448a-a310-c66ea4edb168 None admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:39:08.970730 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 85/170] 10.222.0.16 () {56 vars in 1177 bytes} [Thu Jul 14 10:39:08 2022] GET /identity/v3/users/e58c38e93bc5470c8e1f42d205fe21c2 => generated 275 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:39:08.971330 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fbff1c-8e8f-448a-a310-c66ea4edb168 None admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:09.058926 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480da630-2f1e-49c6-a272-bd1affed40a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:09.059819 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480da630-2f1e-49c6-a272-bd1affed40a8 None admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:09.060103 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480da630-2f1e-49c6-a272-bd1affed40a8 None admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:09.060379 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480da630-2f1e-49c6-a272-bd1affed40a8 None admin] PATH_INFO: `/v3/projects/3d3a37cd8fb044539b71f6202165da75` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:09.063367 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480da630-2f1e-49c6-a272-bd1affed40a8 None admin] RBAC: Authorizing `identity:get_project(project_id=3d3a37cd8fb044539b71f6202165da75)` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:39:09.064923 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480da630-2f1e-49c6-a272-bd1affed40a8 None admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:39:09.069000 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 86/171] 10.222.0.16 () {56 vars in 1186 bytes} [Thu Jul 14 10:39:08 2022] GET /identity/v3/projects/3d3a37cd8fb044539b71f6202165da75 => generated 298 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:39:09.069675 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480da630-2f1e-49c6-a272-bd1affed40a8 None admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:09.081324 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=100 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:39:09.103355 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=100 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:39:09.165698 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fbff1c-8e8f-448a-a310-c66ea4edb168 None admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:09.227399 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a087303-7d0b-4783-bddd-84fa8346a5d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:09.228089 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a087303-7d0b-4783-bddd-84fa8346a5d8 None admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:09.228377 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a087303-7d0b-4783-bddd-84fa8346a5d8 None admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:09.228654 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a087303-7d0b-4783-bddd-84fa8346a5d8 None admin] PATH_INFO: `/v3/roles` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:09.229460 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a087303-7d0b-4783-bddd-84fa8346a5d8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:39:09.229773 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a087303-7d0b-4783-bddd-84fa8346a5d8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:39:09.231161 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a087303-7d0b-4783-bddd-84fa8346a5d8 None admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:39:09.243543 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480da630-2f1e-49c6-a272-bd1affed40a8 None admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:09.248611 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 86/172] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Jul 14 10:39:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:39:09.249493 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a087303-7d0b-4783-bddd-84fa8346a5d8 None admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:09.325564 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cb65f7-78fb-4dbd-85fe-84366bdf58bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:09.326599 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cb65f7-78fb-4dbd-85fe-84366bdf58bb None admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:09.327192 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cb65f7-78fb-4dbd-85fe-84366bdf58bb None admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:09.327688 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cb65f7-78fb-4dbd-85fe-84366bdf58bb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:09.418622 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a087303-7d0b-4783-bddd-84fa8346a5d8 None admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:09.439247 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=100 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:39:09.455742 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90cb65f7-78fb-4dbd-85fe-84366bdf58bb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:39:09.457579 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90cb65f7-78fb-4dbd-85fe-84366bdf58bb None admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:39:09.493351 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb54b8c-6d41-4ee1-a00c-2664ffc830a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:09.494027 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb54b8c-6d41-4ee1-a00c-2664ffc830a6 None admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:09.494312 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb54b8c-6d41-4ee1-a00c-2664ffc830a6 None admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:09.494590 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb54b8c-6d41-4ee1-a00c-2664ffc830a6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:09.495784 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb54b8c-6d41-4ee1-a00c-2664ffc830a6 None admin] RBAC: Adding query filter params (role.id=64ec6989f4724a8ab1e32d37c186c8f8, scope.project.id=3d3a37cd8fb044539b71f6202165da75, user.id=e58c38e93bc5470c8e1f42d205fe21c2) {{(pid=86655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:39:09.496103 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb54b8c-6d41-4ee1-a00c-2664ffc830a6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:39:09.497591 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb54b8c-6d41-4ee1-a00c-2664ffc830a6 None admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:39:09.501108 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=100 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:39:09.511554 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 87/173] 10.222.0.16 () {56 vars in 1374 bytes} [Thu Jul 14 10:39:09 2022] GET /identity/v3/role_assignments?user.id=e58c38e93bc5470c8e1f42d205fe21c2&scope.project.id=3d3a37cd8fb044539b71f6202165da75&role.id=64ec6989f4724a8ab1e32d37c186c8f8 => generated 608 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:39:09.512269 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb54b8c-6d41-4ee1-a00c-2664ffc830a6 None admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:09.695848 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 87/174] 10.222.0.16 () {58 vars in 1282 bytes} [Thu Jul 14 10:39:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 626 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 10:39:09.701339 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cb65f7-78fb-4dbd-85fe-84366bdf58bb None admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:09.718704 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb54b8c-6d41-4ee1-a00c-2664ffc830a6 None admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:09.795681 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e00e145-dd40-4aa3-b9a8-69c3aad6e36b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:09.795681 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e00e145-dd40-4aa3-b9a8-69c3aad6e36b None admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:09.795681 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e00e145-dd40-4aa3-b9a8-69c3aad6e36b None admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:09.795681 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e00e145-dd40-4aa3-b9a8-69c3aad6e36b None admin] PATH_INFO: `/v3/users/ae4bcdd8106d4bebbdcae96be33505bc` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:09.796972 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e00e145-dd40-4aa3-b9a8-69c3aad6e36b None admin] RBAC: Authorizing `identity:get_user(user_id=ae4bcdd8106d4bebbdcae96be33505bc)` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:39:09.798446 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e00e145-dd40-4aa3-b9a8-69c3aad6e36b None admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:39:09.802215 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 88/175] 10.222.0.16 () {56 vars in 1177 bytes} [Thu Jul 14 10:39:09 2022] GET /identity/v3/users/ae4bcdd8106d4bebbdcae96be33505bc => generated 247 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:39:09.808159 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e00e145-dd40-4aa3-b9a8-69c3aad6e36b None admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:09.879144 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=100 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:39:09.900583 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cb65f7-78fb-4dbd-85fe-84366bdf58bb None admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:09.953545 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=100 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:39:09.975996 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e00e145-dd40-4aa3-b9a8-69c3aad6e36b None admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:09.990480 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ecc079-cf2e-4a60-9af2-2b6ad9a44de1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:09.991757 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ecc079-cf2e-4a60-9af2-2b6ad9a44de1 None admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:09.992248 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ecc079-cf2e-4a60-9af2-2b6ad9a44de1 None admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:09.992717 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ecc079-cf2e-4a60-9af2-2b6ad9a44de1 None admin] PATH_INFO: `/v3/projects/6bf2528ae7564dd9a6b6bafc9559875a` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:09.997505 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ecc079-cf2e-4a60-9af2-2b6ad9a44de1 None admin] RBAC: Authorizing `identity:get_project(project_id=6bf2528ae7564dd9a6b6bafc9559875a)` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:39:09.999202 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ecc079-cf2e-4a60-9af2-2b6ad9a44de1 None admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:39:10.001182 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 88/176] 10.222.0.16 () {56 vars in 1186 bytes} [Thu Jul 14 10:39:09 2022] GET /identity/v3/projects/6bf2528ae7564dd9a6b6bafc9559875a => generated 312 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 10:39:10.007621 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ecc079-cf2e-4a60-9af2-2b6ad9a44de1 None admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:10.026920 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fad1e1d-5bc5-4140-965b-f81b9a60731c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:10.027589 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fad1e1d-5bc5-4140-965b-f81b9a60731c None admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:10.027875 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fad1e1d-5bc5-4140-965b-f81b9a60731c None admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:10.028154 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fad1e1d-5bc5-4140-965b-f81b9a60731c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:10.144225 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fad1e1d-5bc5-4140-965b-f81b9a60731c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:39:10.146304 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fad1e1d-5bc5-4140-965b-f81b9a60731c None admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:39:10.224427 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ecc079-cf2e-4a60-9af2-2b6ad9a44de1 None admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:10.227722 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=100 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:39:10.273895 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad127a17-4fef-45dd-9c21-447ab442cdf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:10.274574 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad127a17-4fef-45dd-9c21-447ab442cdf6 None admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:10.274862 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad127a17-4fef-45dd-9c21-447ab442cdf6 None admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:10.275143 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad127a17-4fef-45dd-9c21-447ab442cdf6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:10.276000 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad127a17-4fef-45dd-9c21-447ab442cdf6 None admin] RBAC: Adding query filter params (role.id=0da46c267d354cce81495dfdd56c1ec2, scope.project.id=6bf2528ae7564dd9a6b6bafc9559875a, user.id=e58c38e93bc5470c8e1f42d205fe21c2) {{(pid=86656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:39:10.276316 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad127a17-4fef-45dd-9c21-447ab442cdf6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:39:10.278077 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad127a17-4fef-45dd-9c21-447ab442cdf6 None admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:39:10.293060 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 89/177] 10.222.0.16 () {56 vars in 1374 bytes} [Thu Jul 14 10:39:10 2022] GET /identity/v3/role_assignments?user.id=e58c38e93bc5470c8e1f42d205fe21c2&scope.project.id=6bf2528ae7564dd9a6b6bafc9559875a&role.id=0da46c267d354cce81495dfdd56c1ec2 => generated 608 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 10:39:10.294851 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0481ba-c00d-45fd-a26c-c72512b6fe1d None None] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:10.300417 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0481ba-c00d-45fd-a26c-c72512b6fe1d None None] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:10.301005 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0481ba-c00d-45fd-a26c-c72512b6fe1d None None] PATH_INFO: `/` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:10.302544 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 90/178] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jul 14 10:39:10 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:39:10.309602 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9181356b-6bee-4031-8339-1a67fbe17fc9 None None] REQUEST_METHOD: `POST` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:10.309886 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9181356b-6bee-4031-8339-1a67fbe17fc9 None None] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:10.310162 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9181356b-6bee-4031-8339-1a67fbe17fc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:10.331831 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.auth.core [None req-9181356b-6bee-4031-8339-1a67fbe17fc9 None None] MFA Rules not processed for user `ae4bcdd8106d4bebbdcae96be33505bc`. Rule list: `[]` (Enabled: `True`). {{(pid=86656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:39:10.333214 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-9181356b-6bee-4031-8339-1a67fbe17fc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:39:10.369119 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 89/179] 10.222.0.16 () {58 vars in 1282 bytes} [Thu Jul 14 10:39:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 561 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 10:39:10.375241 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fad1e1d-5bc5-4140-965b-f81b9a60731c None admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:10.387756 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=100 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:39:10.412113 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 91/180] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jul 14 10:39:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 14 10:39:10.436574 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9181356b-6bee-4031-8339-1a67fbe17fc9 None None] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:10.551774 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9181356b-6bee-4031-8339-1a67fbe17fc9 None None] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:10.575472 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fad1e1d-5bc5-4140-965b-f81b9a60731c None admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:10.590248 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4898a333-99d4-43eb-98aa-694cb1604d53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:10.591410 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4898a333-99d4-43eb-98aa-694cb1604d53 None admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:10.591697 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4898a333-99d4-43eb-98aa-694cb1604d53 None admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:10.591973 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4898a333-99d4-43eb-98aa-694cb1604d53 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:10.605273 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4898a333-99d4-43eb-98aa-694cb1604d53 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 10:39:10.613494 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072711a0-6976-4595-8e87-b265a03df00a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:10.613939 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application [None req-4898a333-99d4-43eb-98aa-694cb1604d53 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 10:39:10.613939 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:39:10.613939 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:39:10.613939 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:39:10.613939 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:39:10.613939 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:39:10.613939 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:39:10.613939 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:39:10.613939 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:39:10.613939 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:39:10.613939 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:39:10.613939 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:39:10.613939 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 10:39:10.613939 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 10:39:10.613939 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 10:39:10.613939 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 10:39:10.614779 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 10:39:10.614779 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 10:39:10.614779 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 10:39:10.614779 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 10:39:10.614779 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:39:10.614779 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:39:10.614779 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:39:10.614779 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:39:10.614779 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:39:10.614779 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:39:10.614779 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:39:10.614779 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application with Lock( Jul 14 10:39:10.614779 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:39:10.614779 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:39:10.614779 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:39:10.614779 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:39:10.615555 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:39:10.615555 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:39:10.615555 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:39:10.615555 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:39:10.615555 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 10:39:10.615555 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 10:39:10.615555 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 10:39:10.615555 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 10:39:10.615555 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 10:39:10.615555 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 10:39:10.615555 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 10:39:10.615555 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application Jul 14 10:39:10.616141 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072711a0-6976-4595-8e87-b265a03df00a None admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:10.616141 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072711a0-6976-4595-8e87-b265a03df00a None admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:10.616141 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072711a0-6976-4595-8e87-b265a03df00a None admin] PATH_INFO: `/v3/projects/3d3a37cd8fb044539b71f6202165da75` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:10.616315 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 92/181] 10.222.0.16 () {56 vars in 1096 bytes} [Thu Jul 14 10:39:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:39:10.620804 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2a48a7-1a78-4950-82fc-6910f262bcdc None None] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:10.620804 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2a48a7-1a78-4950-82fc-6910f262bcdc None None] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:10.620804 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2a48a7-1a78-4950-82fc-6910f262bcdc None None] PATH_INFO: `/` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:10.621325 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072711a0-6976-4595-8e87-b265a03df00a None admin] RBAC: Authorizing `identity:get_project(project_id=3d3a37cd8fb044539b71f6202165da75)` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:39:10.622574 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072711a0-6976-4595-8e87-b265a03df00a None admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:39:10.622888 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 93/182] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jul 14 10:39:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:39:10.623747 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2a48a7-1a78-4950-82fc-6910f262bcdc None None] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:10.624390 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 90/183] 10.222.0.16 () {56 vars in 1186 bytes} [Thu Jul 14 10:39:10 2022] GET /identity/v3/projects/3d3a37cd8fb044539b71f6202165da75 => generated 298 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 10:39:10.635339 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0b3246-0bca-4f0f-a572-89cbc944e5b0 None None] REQUEST_METHOD: `POST` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:10.635656 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0b3246-0bca-4f0f-a572-89cbc944e5b0 None None] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:10.635892 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0b3246-0bca-4f0f-a572-89cbc944e5b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:10.660406 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.auth.core [None req-ee0b3246-0bca-4f0f-a572-89cbc944e5b0 None None] MFA Rules not processed for user `ae4bcdd8106d4bebbdcae96be33505bc`. Rule list: `[]` (Enabled: `True`). {{(pid=86655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:39:10.662406 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-ee0b3246-0bca-4f0f-a572-89cbc944e5b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:39:10.665021 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=100 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:39:10.685994 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=100 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:39:10.763991 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 91/184] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jul 14 10:39:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 14 10:39:10.765544 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0b3246-0bca-4f0f-a572-89cbc944e5b0 None None] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:10.801969 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2a48a7-1a78-4950-82fc-6910f262bcdc None None] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:10.858325 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a40377b-4898-4048-99bb-684de5919fad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:10.861018 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a40377b-4898-4048-99bb-684de5919fad None admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:10.861520 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a40377b-4898-4048-99bb-684de5919fad None admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:10.862599 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a40377b-4898-4048-99bb-684de5919fad None admin] PATH_INFO: `/v3/roles` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:10.863844 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a40377b-4898-4048-99bb-684de5919fad None admin] RBAC: Adding query filter params (name=admin) {{(pid=86656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:39:10.864331 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a40377b-4898-4048-99bb-684de5919fad None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:39:10.867749 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a40377b-4898-4048-99bb-684de5919fad None admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:39:10.878669 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 94/185] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Jul 14 10:39:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:39:10.879515 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a40377b-4898-4048-99bb-684de5919fad None admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:10.905676 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0b3246-0bca-4f0f-a572-89cbc944e5b0 None None] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:10.953534 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca5affb-75af-4d34-bc9c-a9ade7167bb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:10.954977 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca5affb-75af-4d34-bc9c-a9ade7167bb3 None admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:10.956221 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca5affb-75af-4d34-bc9c-a9ade7167bb3 None admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:10.956958 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca5affb-75af-4d34-bc9c-a9ade7167bb3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:10.958999 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca5affb-75af-4d34-bc9c-a9ade7167bb3 None admin] RBAC: Adding query filter params (role.id=153539819e5542df99269d2913bbecfb, scope.project.id=3d3a37cd8fb044539b71f6202165da75, user.id=ae4bcdd8106d4bebbdcae96be33505bc) {{(pid=86655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:39:10.959611 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca5affb-75af-4d34-bc9c-a9ade7167bb3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:39:10.962053 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca5affb-75af-4d34-bc9c-a9ade7167bb3 None admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:39:10.968585 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 92/186] 10.222.0.16 () {56 vars in 1374 bytes} [Thu Jul 14 10:39:10 2022] GET /identity/v3/role_assignments?user.id=ae4bcdd8106d4bebbdcae96be33505bc&scope.project.id=3d3a37cd8fb044539b71f6202165da75&role.id=153539819e5542df99269d2913bbecfb => generated 608 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:39:10.970267 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d431ddb-2812-44ac-8d5f-657e4233a877 None None] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:10.970560 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d431ddb-2812-44ac-8d5f-657e4233a877 None None] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:10.971075 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d431ddb-2812-44ac-8d5f-657e4233a877 None None] PATH_INFO: `/` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:10.973401 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 93/187] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jul 14 10:39:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:39:10.980264 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d431ddb-2812-44ac-8d5f-657e4233a877 None None] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:10.984271 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=100 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:39:11.017860 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a40377b-4898-4048-99bb-684de5919fad None admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:11.024256 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=100 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:39:11.076804 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049dfcfb-8bf6-4e46-847c-c4414dd5831e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:11.078684 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049dfcfb-8bf6-4e46-847c-c4414dd5831e None admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:11.079340 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049dfcfb-8bf6-4e46-847c-c4414dd5831e None admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:11.080428 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049dfcfb-8bf6-4e46-847c-c4414dd5831e None admin] PATH_INFO: `/v3/domains/default` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:11.084897 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049dfcfb-8bf6-4e46-847c-c4414dd5831e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:39:11.088547 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049dfcfb-8bf6-4e46-847c-c4414dd5831e None admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:39:11.091610 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 95/188] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Jul 14 10:39:10 2022] GET /identity/v3/domains/default => generated 199 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:39:11.093160 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6abdc6-99d2-4190-8c9e-19df3093e8e7 None None] REQUEST_METHOD: `POST` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:11.093621 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6abdc6-99d2-4190-8c9e-19df3093e8e7 None None] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:11.094367 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6abdc6-99d2-4190-8c9e-19df3093e8e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:11.117275 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.auth.core [None req-7d6abdc6-99d2-4190-8c9e-19df3093e8e7 None None] MFA Rules not processed for user `ae4bcdd8106d4bebbdcae96be33505bc`. Rule list: `[]` (Enabled: `True`). {{(pid=86656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:39:11.119295 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-7d6abdc6-99d2-4190-8c9e-19df3093e8e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:39:11.163117 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d431ddb-2812-44ac-8d5f-657e4233a877 None None] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:11.212498 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a5f7c6-32f0-4b92-89ba-e99a95958851 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:11.213434 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a5f7c6-32f0-4b92-89ba-e99a95958851 None admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:11.213756 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 96/189] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jul 14 10:39:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 10:39:11.213858 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a5f7c6-32f0-4b92-89ba-e99a95958851 None admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:11.214060 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a5f7c6-32f0-4b92-89ba-e99a95958851 None admin] PATH_INFO: `/v3/users/7ad22452179f4edaa1ae4b7ddb2f464c` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:11.214676 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6abdc6-99d2-4190-8c9e-19df3093e8e7 None None] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:11.241098 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a5f7c6-32f0-4b92-89ba-e99a95958851 None admin] RBAC: Authorizing `identity:get_user(user_id=7ad22452179f4edaa1ae4b7ddb2f464c)` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:39:11.243536 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a5f7c6-32f0-4b92-89ba-e99a95958851 None admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:39:11.246237 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 94/190] 10.222.0.16 () {56 vars in 1177 bytes} [Thu Jul 14 10:39:10 2022] GET /identity/v3/users/7ad22452179f4edaa1ae4b7ddb2f464c => generated 283 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:39:11.247071 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a5f7c6-32f0-4b92-89ba-e99a95958851 None admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:11.328004 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=100 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:39:11.367004 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6abdc6-99d2-4190-8c9e-19df3093e8e7 None None] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:11.368599 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=100 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:39:11.373950 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a5f7c6-32f0-4b92-89ba-e99a95958851 None admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:11.408565 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9bdb09-c8f1-4335-9e7d-03fb4c527175 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:11.409395 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3072039b-a395-4521-9294-c8decaa27368 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:11.410029 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9bdb09-c8f1-4335-9e7d-03fb4c527175 None admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:11.410236 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3072039b-a395-4521-9294-c8decaa27368 None admin] REQUEST_METHOD: `POST` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:11.410389 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9bdb09-c8f1-4335-9e7d-03fb4c527175 None admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:11.410542 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3072039b-a395-4521-9294-c8decaa27368 None admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:11.410684 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9bdb09-c8f1-4335-9e7d-03fb4c527175 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:11.410825 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3072039b-a395-4521-9294-c8decaa27368 None admin] PATH_INFO: `/v3/users` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:11.411419 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3072039b-a395-4521-9294-c8decaa27368 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:39:11.412938 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3072039b-a395-4521-9294-c8decaa27368 None admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:39:11.421998 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9bdb09-c8f1-4335-9e7d-03fb4c527175 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 10:39:11.431283 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application [None req-5e9bdb09-c8f1-4335-9e7d-03fb4c527175 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 14 10:39:11.431283 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:39:11.431283 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:39:11.431283 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:39:11.431283 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:39:11.431283 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:39:11.431283 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:39:11.431283 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:39:11.431283 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:39:11.431283 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:39:11.431283 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:39:11.431283 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:39:11.431283 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 10:39:11.431283 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 10:39:11.431283 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 10:39:11.431283 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 10:39:11.432218 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 10:39:11.432218 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 10:39:11.432218 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 10:39:11.432218 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 10:39:11.432218 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:39:11.432218 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:39:11.432218 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:39:11.432218 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:39:11.432218 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:39:11.432218 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:39:11.432218 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:39:11.432218 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application with Lock( Jul 14 10:39:11.432218 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:39:11.432218 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:39:11.432218 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:39:11.432218 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:39:11.440951 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:39:11.440951 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:39:11.440951 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:39:11.440951 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:39:11.440951 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 10:39:11.440951 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 10:39:11.440951 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 10:39:11.440951 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 10:39:11.440951 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 10:39:11.440951 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 10:39:11.440951 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 14 10:39:11.440951 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application Jul 14 10:39:11.440951 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 95/191] 10.222.0.16 () {56 vars in 1114 bytes} [Thu Jul 14 10:39:11 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:39:11.440951 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9bdb09-c8f1-4335-9e7d-03fb4c527175 None admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:11.442255 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 97/192] 10.222.0.16 () {60 vars in 1132 bytes} [Thu Jul 14 10:39:11 2022] POST /identity/v3/users => generated 297 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:39:11.442255 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e0aa80-0381-4bd9-b7bb-3500e50ab338 None None] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:11.442255 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e0aa80-0381-4bd9-b7bb-3500e50ab338 None None] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:11.442255 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e0aa80-0381-4bd9-b7bb-3500e50ab338 None None] PATH_INFO: `/` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:11.442255 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 98/193] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jul 14 10:39:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:39:11.443675 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e0aa80-0381-4bd9-b7bb-3500e50ab338 None None] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:11.579508 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e0aa80-0381-4bd9-b7bb-3500e50ab338 None None] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:11.586198 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9bdb09-c8f1-4335-9e7d-03fb4c527175 None admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:11.615540 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=100 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:39:11.626526 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670eb252-544f-49d6-9e30-cb436bef9329 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:11.628233 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670eb252-544f-49d6-9e30-cb436bef9329 None admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:11.628233 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670eb252-544f-49d6-9e30-cb436bef9329 None admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:11.628497 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670eb252-544f-49d6-9e30-cb436bef9329 None admin] PATH_INFO: `/v3/roles` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:11.629829 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670eb252-544f-49d6-9e30-cb436bef9329 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:39:11.629829 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670eb252-544f-49d6-9e30-cb436bef9329 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:39:11.631160 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670eb252-544f-49d6-9e30-cb436bef9329 None admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:39:11.638814 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d38b396-7f42-41b7-b98f-0aff172f1894 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:11.638814 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d38b396-7f42-41b7-b98f-0aff172f1894 None admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:11.639286 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d38b396-7f42-41b7-b98f-0aff172f1894 None admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:11.641391 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d38b396-7f42-41b7-b98f-0aff172f1894 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:11.645242 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 99/194] 10.222.0.16 () {56 vars in 1111 bytes} [Thu Jul 14 10:39:11 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:39:11.649824 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67883e4-1c76-463c-b5c6-a1440df83c78 None None] REQUEST_METHOD: `POST` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:11.649824 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67883e4-1c76-463c-b5c6-a1440df83c78 None None] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:11.649824 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67883e4-1c76-463c-b5c6-a1440df83c78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:11.671072 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.auth.core [None req-a67883e4-1c76-463c-b5c6-a1440df83c78 None None] MFA Rules not processed for user `ae4bcdd8106d4bebbdcae96be33505bc`. Rule list: `[]` (Enabled: `True`). {{(pid=86656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:39:11.672362 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-a67883e4-1c76-463c-b5c6-a1440df83c78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:39:11.694182 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:39:11.759078 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d38b396-7f42-41b7-b98f-0aff172f1894 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:39:11.760577 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d38b396-7f42-41b7-b98f-0aff172f1894 None admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:39:11.786254 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 100/195] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jul 14 10:39:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 10:39:11.787181 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67883e4-1c76-463c-b5c6-a1440df83c78 None None] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:11.888607 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 96/196] 10.222.0.16 () {58 vars in 1282 bytes} [Thu Jul 14 10:39:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 455 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 10:39:11.892920 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d38b396-7f42-41b7-b98f-0aff172f1894 None admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:11.912583 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=100 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:39:11.916696 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67883e4-1c76-463c-b5c6-a1440df83c78 None None] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:11.953905 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938493eb-4f6d-4395-93f3-13e3f34e5cf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:11.955086 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938493eb-4f6d-4395-93f3-13e3f34e5cf2 None admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:11.956114 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938493eb-4f6d-4395-93f3-13e3f34e5cf2 None admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:11.956608 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938493eb-4f6d-4395-93f3-13e3f34e5cf2 None admin] PATH_INFO: `/v3/users/7ad22452179f4edaa1ae4b7ddb2f464c` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:11.958258 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938493eb-4f6d-4395-93f3-13e3f34e5cf2 None admin] RBAC: Authorizing `identity:get_user(user_id=7ad22452179f4edaa1ae4b7ddb2f464c)` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:39:11.959935 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938493eb-4f6d-4395-93f3-13e3f34e5cf2 None admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:39:11.962153 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 101/197] 10.222.0.16 () {56 vars in 1177 bytes} [Thu Jul 14 10:39:11 2022] GET /identity/v3/users/7ad22452179f4edaa1ae4b7ddb2f464c => generated 283 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:39:11.963207 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938493eb-4f6d-4395-93f3-13e3f34e5cf2 None admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:11.985005 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=100 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:39:11.998367 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d38b396-7f42-41b7-b98f-0aff172f1894 None admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:12.034638 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f184ad68-1249-4738-9321-3433cdd5d39d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:12.035398 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f184ad68-1249-4738-9321-3433cdd5d39d None admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:12.035685 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f184ad68-1249-4738-9321-3433cdd5d39d None admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:12.035963 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f184ad68-1249-4738-9321-3433cdd5d39d None admin] PATH_INFO: `/v3/roles/reader` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:12.047126 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f184ad68-1249-4738-9321-3433cdd5d39d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 10:39:12.055468 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application [None req-f184ad68-1249-4738-9321-3433cdd5d39d None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 14 10:39:12.055468 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:39:12.055468 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:39:12.055468 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:39:12.055468 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:39:12.055468 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:39:12.055468 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:39:12.055468 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:39:12.055468 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:39:12.055468 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:39:12.055468 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:39:12.055468 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:39:12.055468 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 10:39:12.055468 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 10:39:12.055468 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 10:39:12.055468 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 10:39:12.056359 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 10:39:12.056359 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 10:39:12.056359 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 10:39:12.056359 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 10:39:12.056359 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:39:12.056359 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:39:12.056359 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:39:12.056359 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:39:12.056359 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:39:12.056359 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:39:12.056359 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:39:12.056359 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application with Lock( Jul 14 10:39:12.056359 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:39:12.056359 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:39:12.056359 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:39:12.056359 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:39:12.057171 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:39:12.057171 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:39:12.057171 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:39:12.057171 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:39:12.057171 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 10:39:12.057171 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 10:39:12.057171 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 10:39:12.057171 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 10:39:12.057171 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 10:39:12.057171 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 10:39:12.057171 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 14 10:39:12.057171 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application Jul 14 10:39:12.057171 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 97/198] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Jul 14 10:39:11 2022] GET /identity/v3/roles/reader => generated 84 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:39:12.057804 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f184ad68-1249-4738-9321-3433cdd5d39d None admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:12.089699 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938493eb-4f6d-4395-93f3-13e3f34e5cf2 None admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:12.124287 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065f967e-0f55-4adc-b376-ff1d8636c3de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:12.125211 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065f967e-0f55-4adc-b376-ff1d8636c3de None admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:12.125501 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065f967e-0f55-4adc-b376-ff1d8636c3de None admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:12.125781 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065f967e-0f55-4adc-b376-ff1d8636c3de None admin] PATH_INFO: `/v3/projects/e3cf5b002a1c43f7a02696ed092318ca` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:12.127000 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065f967e-0f55-4adc-b376-ff1d8636c3de None admin] RBAC: Authorizing `identity:get_project(project_id=e3cf5b002a1c43f7a02696ed092318ca)` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:39:12.129109 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065f967e-0f55-4adc-b376-ff1d8636c3de None admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:39:12.130856 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 102/199] 10.222.0.16 () {56 vars in 1186 bytes} [Thu Jul 14 10:39:11 2022] GET /identity/v3/projects/e3cf5b002a1c43f7a02696ed092318ca => generated 302 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:39:12.136952 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065f967e-0f55-4adc-b376-ff1d8636c3de None admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:12.167648 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=100 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:39:12.197726 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f184ad68-1249-4738-9321-3433cdd5d39d None admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:12.234906 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f718a7-39ea-49ff-942d-801d25cf196a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:12.235955 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f718a7-39ea-49ff-942d-801d25cf196a None admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:12.236430 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f718a7-39ea-49ff-942d-801d25cf196a None admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:12.237061 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f718a7-39ea-49ff-942d-801d25cf196a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:12.248300 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=100 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:39:12.269975 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065f967e-0f55-4adc-b376-ff1d8636c3de None admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:12.311200 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f718a7-39ea-49ff-942d-801d25cf196a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:39:12.313728 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f718a7-39ea-49ff-942d-801d25cf196a None admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:39:12.315980 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d6322c-bb58-444b-ba87-f9eaeabae73d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:12.316664 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d6322c-bb58-444b-ba87-f9eaeabae73d None admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:12.316975 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d6322c-bb58-444b-ba87-f9eaeabae73d None admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:12.317251 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d6322c-bb58-444b-ba87-f9eaeabae73d None admin] PATH_INFO: `/v3/roles` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:12.318308 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d6322c-bb58-444b-ba87-f9eaeabae73d None admin] RBAC: Adding query filter params (name=reader) {{(pid=86656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:39:12.318653 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d6322c-bb58-444b-ba87-f9eaeabae73d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:39:12.321002 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d6322c-bb58-444b-ba87-f9eaeabae73d None admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:39:12.331580 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 103/200] 10.222.0.16 () {56 vars in 1101 bytes} [Thu Jul 14 10:39:12 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:39:12.332657 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d6322c-bb58-444b-ba87-f9eaeabae73d None admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:12.431231 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=100 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:39:12.438597 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d6322c-bb58-444b-ba87-f9eaeabae73d None admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:12.457828 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 98/201] 10.222.0.16 () {58 vars in 1282 bytes} [Thu Jul 14 10:39:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 10:39:12.459091 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f718a7-39ea-49ff-942d-801d25cf196a None admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:12.477485 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbcf24b-5ae6-4907-9160-b408076b7b5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:12.478442 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbcf24b-5ae6-4907-9160-b408076b7b5e None admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:12.478918 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbcf24b-5ae6-4907-9160-b408076b7b5e None admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:12.479386 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbcf24b-5ae6-4907-9160-b408076b7b5e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:12.480598 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdbcf24b-5ae6-4907-9160-b408076b7b5e None admin] RBAC: Adding query filter params (role.id=153539819e5542df99269d2913bbecfb, scope.project.id=e3cf5b002a1c43f7a02696ed092318ca, user.id=7ad22452179f4edaa1ae4b7ddb2f464c) {{(pid=86656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:39:12.481147 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdbcf24b-5ae6-4907-9160-b408076b7b5e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:39:12.482794 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdbcf24b-5ae6-4907-9160-b408076b7b5e None admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:39:12.493213 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 104/202] 10.222.0.16 () {56 vars in 1374 bytes} [Thu Jul 14 10:39:12 2022] GET /identity/v3/role_assignments?user.id=7ad22452179f4edaa1ae4b7ddb2f464c&scope.project.id=e3cf5b002a1c43f7a02696ed092318ca&role.id=153539819e5542df99269d2913bbecfb => generated 259 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:39:12.494420 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbcf24b-5ae6-4907-9160-b408076b7b5e None admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:12.526866 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=100 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:39:12.581225 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f718a7-39ea-49ff-942d-801d25cf196a None admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:12.624338 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664ccc39-3dc9-4257-a114-89889ba70c22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:12.625524 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664ccc39-3dc9-4257-a114-89889ba70c22 None admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:12.625819 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664ccc39-3dc9-4257-a114-89889ba70c22 None admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:12.626531 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664ccc39-3dc9-4257-a114-89889ba70c22 None admin] PATH_INFO: `/v3/users/3592686c34704273a175a9090876e62d` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:12.628551 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664ccc39-3dc9-4257-a114-89889ba70c22 None admin] RBAC: Authorizing `identity:get_user(user_id=3592686c34704273a175a9090876e62d)` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:39:12.630829 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664ccc39-3dc9-4257-a114-89889ba70c22 None admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:39:12.632962 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 99/203] 10.222.0.16 () {56 vars in 1177 bytes} [Thu Jul 14 10:39:12 2022] GET /identity/v3/users/3592686c34704273a175a9090876e62d => generated 289 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:39:12.638466 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664ccc39-3dc9-4257-a114-89889ba70c22 None admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:12.696202 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbcf24b-5ae6-4907-9160-b408076b7b5e None admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:12.743128 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=100 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:39:12.746772 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db38b5b8-cfc2-4cc1-bdfd-4032fd94af9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:12.748805 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db38b5b8-cfc2-4cc1-bdfd-4032fd94af9d None admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:12.749107 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db38b5b8-cfc2-4cc1-bdfd-4032fd94af9d None admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:12.749391 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db38b5b8-cfc2-4cc1-bdfd-4032fd94af9d None admin] PATH_INFO: `/v3/projects/e3cf5b002a1c43f7a02696ed092318ca` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:12.750782 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db38b5b8-cfc2-4cc1-bdfd-4032fd94af9d None admin] RBAC: Authorizing `identity:get_project(project_id=e3cf5b002a1c43f7a02696ed092318ca)` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:39:12.752442 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db38b5b8-cfc2-4cc1-bdfd-4032fd94af9d None admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:39:12.755586 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 105/204] 10.222.0.16 () {56 vars in 1186 bytes} [Thu Jul 14 10:39:12 2022] GET /identity/v3/projects/e3cf5b002a1c43f7a02696ed092318ca => generated 302 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:39:12.762284 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db38b5b8-cfc2-4cc1-bdfd-4032fd94af9d None admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:12.875148 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=100 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:39:12.894605 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db38b5b8-cfc2-4cc1-bdfd-4032fd94af9d None admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:12.911330 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664ccc39-3dc9-4257-a114-89889ba70c22 None admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:12.931302 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4328ccb2-b275-4df5-adb6-33d1bdf0c9ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:12.932171 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4328ccb2-b275-4df5-adb6-33d1bdf0c9ba None admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:12.932550 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4328ccb2-b275-4df5-adb6-33d1bdf0c9ba None admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:12.932951 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4328ccb2-b275-4df5-adb6-33d1bdf0c9ba None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:12.933909 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4328ccb2-b275-4df5-adb6-33d1bdf0c9ba None admin] RBAC: Adding query filter params (role.id=64ec6989f4724a8ab1e32d37c186c8f8, scope.project.id=e3cf5b002a1c43f7a02696ed092318ca, user.id=7ad22452179f4edaa1ae4b7ddb2f464c) {{(pid=86656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:39:12.934322 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4328ccb2-b275-4df5-adb6-33d1bdf0c9ba None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:39:12.935973 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4328ccb2-b275-4df5-adb6-33d1bdf0c9ba None admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:39:12.942971 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 106/205] 10.222.0.16 () {56 vars in 1374 bytes} [Thu Jul 14 10:39:12 2022] GET /identity/v3/role_assignments?user.id=7ad22452179f4edaa1ae4b7ddb2f464c&scope.project.id=e3cf5b002a1c43f7a02696ed092318ca&role.id=64ec6989f4724a8ab1e32d37c186c8f8 => generated 259 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:39:12.984353 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b1e983-70a3-480a-9146-660ebc85ed48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:12.984966 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b1e983-70a3-480a-9146-660ebc85ed48 None admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:12.985250 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b1e983-70a3-480a-9146-660ebc85ed48 None admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:12.985524 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b1e983-70a3-480a-9146-660ebc85ed48 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:13.088587 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b1e983-70a3-480a-9146-660ebc85ed48 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:39:13.090094 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b1e983-70a3-480a-9146-660ebc85ed48 None admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:39:13.167400 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=100 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:39:13.238869 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 100/206] 10.222.0.16 () {58 vars in 1282 bytes} [Thu Jul 14 10:39:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 601 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 14 10:39:13.244392 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4328ccb2-b275-4df5-adb6-33d1bdf0c9ba None admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:13.474913 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4328ccb2-b275-4df5-adb6-33d1bdf0c9ba None admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:13.522233 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d764e347-40f7-45f0-8db8-b38dbaa84952 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:13.523034 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d764e347-40f7-45f0-8db8-b38dbaa84952 None admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:13.523318 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d764e347-40f7-45f0-8db8-b38dbaa84952 None admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:13.523596 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d764e347-40f7-45f0-8db8-b38dbaa84952 None admin] PATH_INFO: `/v3/projects/3d3a37cd8fb044539b71f6202165da75` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:13.524809 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d764e347-40f7-45f0-8db8-b38dbaa84952 None admin] RBAC: Authorizing `identity:get_project(project_id=3d3a37cd8fb044539b71f6202165da75)` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:39:13.526275 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d764e347-40f7-45f0-8db8-b38dbaa84952 None admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:39:13.528108 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 107/207] 10.222.0.16 () {56 vars in 1186 bytes} [Thu Jul 14 10:39:13 2022] GET /identity/v3/projects/3d3a37cd8fb044539b71f6202165da75 => generated 298 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:39:13.534329 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b1e983-70a3-480a-9146-660ebc85ed48 None admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:13.673056 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b1e983-70a3-480a-9146-660ebc85ed48 None admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:13.712017 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a13d4d-24eb-4ac5-a1fe-d762a9c06346 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:13.713102 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a13d4d-24eb-4ac5-a1fe-d762a9c06346 None admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:13.713589 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a13d4d-24eb-4ac5-a1fe-d762a9c06346 None admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:13.714079 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a13d4d-24eb-4ac5-a1fe-d762a9c06346 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:13.715124 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a13d4d-24eb-4ac5-a1fe-d762a9c06346 None admin] RBAC: Adding query filter params (role.id=ac28665f2a2446b8a9c98f0de3126d33, scope.project.id=3d3a37cd8fb044539b71f6202165da75, user.id=3592686c34704273a175a9090876e62d) {{(pid=86655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:39:13.715648 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a13d4d-24eb-4ac5-a1fe-d762a9c06346 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:39:13.717346 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a13d4d-24eb-4ac5-a1fe-d762a9c06346 None admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:39:13.723758 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 101/208] 10.222.0.16 () {56 vars in 1374 bytes} [Thu Jul 14 10:39:13 2022] GET /identity/v3/role_assignments?user.id=3592686c34704273a175a9090876e62d&scope.project.id=3d3a37cd8fb044539b71f6202165da75&role.id=ac28665f2a2446b8a9c98f0de3126d33 => generated 608 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:39:13.772140 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e0bab7-6f94-4f50-aec7-f1f8c9d7a4f6 None None] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:13.772482 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e0bab7-6f94-4f50-aec7-f1f8c9d7a4f6 None None] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:13.772712 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e0bab7-6f94-4f50-aec7-f1f8c9d7a4f6 None None] PATH_INFO: `/` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:13.774150 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 108/209] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jul 14 10:39:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:39:13.779582 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cf652c-462b-4223-8ae3-2b58e1322484 None None] REQUEST_METHOD: `POST` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:13.780162 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cf652c-462b-4223-8ae3-2b58e1322484 None None] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:13.780694 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cf652c-462b-4223-8ae3-2b58e1322484 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:13.810056 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.auth.core [None req-31cf652c-462b-4223-8ae3-2b58e1322484 None None] MFA Rules not processed for user `ae4bcdd8106d4bebbdcae96be33505bc`. Rule list: `[]` (Enabled: `True`). {{(pid=86655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:39:13.811288 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-31cf652c-462b-4223-8ae3-2b58e1322484 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:39:13.820762 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=100 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:39:13.916317 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 102/210] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jul 14 10:39:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 10:39:13.942066 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb62d4e3-70fe-4cd8-abe8-813057b32a54 None None] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:13.942405 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31cf652c-462b-4223-8ae3-2b58e1322484 None None] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:13.942886 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb62d4e3-70fe-4cd8-abe8-813057b32a54 None None] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:13.943362 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb62d4e3-70fe-4cd8-abe8-813057b32a54 None None] PATH_INFO: `/` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:13.945258 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 109/211] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jul 14 10:39:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:39:13.959321 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a2bae3-7b11-4975-93a2-656ba50c1480 None None] REQUEST_METHOD: `POST` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:13.960034 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a2bae3-7b11-4975-93a2-656ba50c1480 None None] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:13.960538 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a2bae3-7b11-4975-93a2-656ba50c1480 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:13.985853 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.auth.core [None req-e5a2bae3-7b11-4975-93a2-656ba50c1480 None None] MFA Rules not processed for user `ae4bcdd8106d4bebbdcae96be33505bc`. Rule list: `[]` (Enabled: `True`). {{(pid=86656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:39:13.988122 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-e5a2bae3-7b11-4975-93a2-656ba50c1480 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:39:13.997008 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=100 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:39:14.067189 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 110/212] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jul 14 10:39:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 14 10:39:14.072978 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31cf652c-462b-4223-8ae3-2b58e1322484 None None] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:14.094354 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a2bae3-7b11-4975-93a2-656ba50c1480 None None] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:14.116334 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8e4ba7-9844-4e35-a61b-973ae8e91b4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:14.117293 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8e4ba7-9844-4e35-a61b-973ae8e91b4c None admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:14.117581 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8e4ba7-9844-4e35-a61b-973ae8e91b4c None admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:14.117859 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8e4ba7-9844-4e35-a61b-973ae8e91b4c None admin] PATH_INFO: `/v3/domains/default` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:14.119228 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8e4ba7-9844-4e35-a61b-973ae8e91b4c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:39:14.121000 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8e4ba7-9844-4e35-a61b-973ae8e91b4c None admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:39:14.124795 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 103/213] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Jul 14 10:39:13 2022] GET /identity/v3/domains/default => generated 199 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 10:39:14.131070 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8e4ba7-9844-4e35-a61b-973ae8e91b4c None admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:14.148413 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=100 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:39:14.237565 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a2bae3-7b11-4975-93a2-656ba50c1480 None None] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:14.253751 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8e4ba7-9844-4e35-a61b-973ae8e91b4c None admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:14.288830 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635e85d2-2eca-43ee-8205-dce926db73ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:14.290067 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635e85d2-2eca-43ee-8205-dce926db73ed None admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:14.290561 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635e85d2-2eca-43ee-8205-dce926db73ed None admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:14.290943 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635e85d2-2eca-43ee-8205-dce926db73ed None admin] PATH_INFO: `/v3/roles/member` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:14.291895 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10b6a29-0ed0-45c3-843c-42bff935f27a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:14.292804 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10b6a29-0ed0-45c3-843c-42bff935f27a None admin] REQUEST_METHOD: `POST` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:14.293232 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10b6a29-0ed0-45c3-843c-42bff935f27a None admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:14.293764 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10b6a29-0ed0-45c3-843c-42bff935f27a None admin] PATH_INFO: `/v3/users` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:14.294676 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10b6a29-0ed0-45c3-843c-42bff935f27a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:39:14.296288 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10b6a29-0ed0-45c3-843c-42bff935f27a None admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:39:14.303042 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635e85d2-2eca-43ee-8205-dce926db73ed None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 10:39:14.314265 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application [None req-635e85d2-2eca-43ee-8205-dce926db73ed None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 14 10:39:14.314265 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:39:14.314265 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:39:14.314265 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:39:14.314265 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:39:14.314265 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:39:14.314265 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:39:14.314265 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:39:14.314265 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:39:14.314265 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:39:14.314265 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:39:14.314265 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:39:14.314265 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 10:39:14.314265 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 10:39:14.314265 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 10:39:14.314265 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 10:39:14.315360 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 10:39:14.315360 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 10:39:14.315360 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 10:39:14.315360 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 10:39:14.315360 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:39:14.315360 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:39:14.315360 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:39:14.315360 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:39:14.315360 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:39:14.315360 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:39:14.315360 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:39:14.315360 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application with Lock( Jul 14 10:39:14.315360 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:39:14.315360 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:39:14.315360 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:39:14.315360 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:39:14.316561 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:39:14.316561 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:39:14.316561 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:39:14.316561 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:39:14.316561 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 10:39:14.316561 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 10:39:14.316561 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 10:39:14.316561 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 10:39:14.316561 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 10:39:14.316561 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 10:39:14.316561 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 14 10:39:14.316561 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application Jul 14 10:39:14.316561 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 111/214] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Jul 14 10:39:14 2022] GET /identity/v3/roles/member => generated 84 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:39:14.321557 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635e85d2-2eca-43ee-8205-dce926db73ed None admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:14.324517 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=100 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:39:14.326438 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 104/215] 10.222.0.16 () {60 vars in 1132 bytes} [Thu Jul 14 10:39:14 2022] POST /identity/v3/users => generated 297 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 10:39:14.441480 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635e85d2-2eca-43ee-8205-dce926db73ed None admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:14.484169 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e617ee3d-5af6-488c-81e4-079bdb5bab0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:14.484809 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e617ee3d-5af6-488c-81e4-079bdb5bab0b None admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:14.484809 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e617ee3d-5af6-488c-81e4-079bdb5bab0b None admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:14.484939 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e617ee3d-5af6-488c-81e4-079bdb5bab0b None admin] PATH_INFO: `/v3/roles` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:14.485613 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e617ee3d-5af6-488c-81e4-079bdb5bab0b None admin] RBAC: Adding query filter params (name=member) {{(pid=86656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:39:14.486204 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e617ee3d-5af6-488c-81e4-079bdb5bab0b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:39:14.488078 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e617ee3d-5af6-488c-81e4-079bdb5bab0b None admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:39:14.497736 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 112/216] 10.222.0.16 () {56 vars in 1101 bytes} [Thu Jul 14 10:39:14 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 10:39:14.503796 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10b6a29-0ed0-45c3-843c-42bff935f27a None admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:14.581464 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:39:14.621701 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10b6a29-0ed0-45c3-843c-42bff935f27a None admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:14.661160 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1791a359-964e-4d5b-a99d-7582f7fd9c21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:14.662183 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1791a359-964e-4d5b-a99d-7582f7fd9c21 None admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:14.662361 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1791a359-964e-4d5b-a99d-7582f7fd9c21 None admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:14.662615 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1791a359-964e-4d5b-a99d-7582f7fd9c21 None admin] PATH_INFO: `/v3/users/0a224a2fe3564a139251a43e0a4768a0` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:14.677129 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1791a359-964e-4d5b-a99d-7582f7fd9c21 None admin] RBAC: Authorizing `identity:get_user(user_id=0a224a2fe3564a139251a43e0a4768a0)` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:39:14.678614 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1791a359-964e-4d5b-a99d-7582f7fd9c21 None admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:39:14.680360 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 105/217] 10.222.0.16 () {56 vars in 1177 bytes} [Thu Jul 14 10:39:14 2022] GET /identity/v3/users/0a224a2fe3564a139251a43e0a4768a0 => generated 297 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:39:14.685879 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e617ee3d-5af6-488c-81e4-079bdb5bab0b None admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:14.751278 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=100 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:39:14.803831 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e617ee3d-5af6-488c-81e4-079bdb5bab0b None admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:14.842963 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3e8e5c-f317-4294-9298-3a28116769dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:14.844080 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3e8e5c-f317-4294-9298-3a28116769dc None admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:14.844563 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3e8e5c-f317-4294-9298-3a28116769dc None admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:14.845131 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3e8e5c-f317-4294-9298-3a28116769dc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:14.929666 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3e8e5c-f317-4294-9298-3a28116769dc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:39:14.931535 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3e8e5c-f317-4294-9298-3a28116769dc None admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:39:14.933768 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df744c5-1857-40a3-97ea-10d29873b379 None None] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:14.934266 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df744c5-1857-40a3-97ea-10d29873b379 None None] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:14.934810 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df744c5-1857-40a3-97ea-10d29873b379 None None] PATH_INFO: `/` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:14.936758 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 106/218] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jul 14 10:39:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:39:14.954659 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97d637d-1bfb-4783-86f6-a95da171fce9 None None] REQUEST_METHOD: `POST` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:14.955317 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97d637d-1bfb-4783-86f6-a95da171fce9 None None] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:14.956083 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97d637d-1bfb-4783-86f6-a95da171fce9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:14.999782 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.auth.core [None req-a97d637d-1bfb-4783-86f6-a95da171fce9 None None] MFA Rules not processed for user `ae4bcdd8106d4bebbdcae96be33505bc`. Rule list: `[]` (Enabled: `True`). {{(pid=86655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:39:15.001029 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-a97d637d-1bfb-4783-86f6-a95da171fce9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:39:15.041126 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=100 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:39:15.126984 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 113/219] 10.222.0.16 () {58 vars in 1282 bytes} [Thu Jul 14 10:39:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 441 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 14 10:39:15.128352 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3e8e5c-f317-4294-9298-3a28116769dc None admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:15.157414 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 107/220] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jul 14 10:39:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 10:39:15.191874 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97d637d-1bfb-4783-86f6-a95da171fce9 None None] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:15.257739 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=100 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:39:15.313715 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97d637d-1bfb-4783-86f6-a95da171fce9 None None] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:15.357026 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4bf2b7-ed65-41f1-a45a-7e2e5a3818b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:15.358425 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4bf2b7-ed65-41f1-a45a-7e2e5a3818b8 None admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:15.359003 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4bf2b7-ed65-41f1-a45a-7e2e5a3818b8 None admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:15.359581 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4bf2b7-ed65-41f1-a45a-7e2e5a3818b8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:15.371793 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4bf2b7-ed65-41f1-a45a-7e2e5a3818b8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 10:39:15.379449 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3e8e5c-f317-4294-9298-3a28116769dc None admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:15.381631 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application [None req-1a4bf2b7-ed65-41f1-a45a-7e2e5a3818b8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 10:39:15.381631 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:39:15.381631 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:39:15.381631 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:39:15.381631 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:39:15.381631 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:39:15.381631 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:39:15.381631 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:39:15.381631 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:39:15.381631 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:39:15.381631 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:39:15.381631 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:39:15.381631 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 10:39:15.381631 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 10:39:15.381631 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 10:39:15.381631 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 10:39:15.382501 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 10:39:15.382501 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 10:39:15.382501 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 10:39:15.382501 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 10:39:15.382501 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:39:15.382501 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:39:15.382501 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:39:15.382501 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:39:15.382501 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:39:15.382501 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:39:15.382501 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:39:15.382501 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application with Lock( Jul 14 10:39:15.382501 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:39:15.382501 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:39:15.382501 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:39:15.382501 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:39:15.383282 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:39:15.383282 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:39:15.383282 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:39:15.383282 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:39:15.383282 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 10:39:15.383282 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 10:39:15.383282 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 10:39:15.383282 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 10:39:15.383282 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 10:39:15.383282 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 10:39:15.383282 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 10:39:15.383282 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application Jul 14 10:39:15.385231 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 108/221] 10.222.0.16 () {56 vars in 1096 bytes} [Thu Jul 14 10:39:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:39:15.391649 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4bf2b7-ed65-41f1-a45a-7e2e5a3818b8 None admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:15.432550 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fe1f6b-62e5-4181-bd07-f36039b3c452 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:15.433344 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fe1f6b-62e5-4181-bd07-f36039b3c452 None admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:15.433635 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fe1f6b-62e5-4181-bd07-f36039b3c452 None admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:15.433917 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fe1f6b-62e5-4181-bd07-f36039b3c452 None admin] PATH_INFO: `/v3/projects/e3cf5b002a1c43f7a02696ed092318ca` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:15.437770 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6fe1f6b-62e5-4181-bd07-f36039b3c452 None admin] RBAC: Authorizing `identity:get_project(project_id=e3cf5b002a1c43f7a02696ed092318ca)` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:39:15.439242 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6fe1f6b-62e5-4181-bd07-f36039b3c452 None admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:39:15.441984 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 114/222] 10.222.0.16 () {56 vars in 1186 bytes} [Thu Jul 14 10:39:15 2022] GET /identity/v3/projects/e3cf5b002a1c43f7a02696ed092318ca => generated 302 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:39:15.443242 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed25a74-39f9-49dc-8768-52b2e2b279b5 None None] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:15.443529 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed25a74-39f9-49dc-8768-52b2e2b279b5 None None] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:15.443817 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed25a74-39f9-49dc-8768-52b2e2b279b5 None None] PATH_INFO: `/` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:15.449431 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 115/223] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jul 14 10:39:15 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:39:15.450867 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed25a74-39f9-49dc-8768-52b2e2b279b5 None None] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:15.483918 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=100 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:39:15.505522 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4bf2b7-ed65-41f1-a45a-7e2e5a3818b8 None admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:15.520093 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=100 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:39:15.542130 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58580dbe-860a-4401-af0a-518c95b2dd12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:15.542989 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58580dbe-860a-4401-af0a-518c95b2dd12 None admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:15.543106 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58580dbe-860a-4401-af0a-518c95b2dd12 None admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:15.543359 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58580dbe-860a-4401-af0a-518c95b2dd12 None admin] PATH_INFO: `/v3/roles` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:15.544147 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58580dbe-860a-4401-af0a-518c95b2dd12 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:39:15.544439 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58580dbe-860a-4401-af0a-518c95b2dd12 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:39:15.545860 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58580dbe-860a-4401-af0a-518c95b2dd12 None admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:39:15.555255 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 109/224] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Jul 14 10:39:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:39:15.556702 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8946858-997f-40df-892d-648dd600ddc3 None None] REQUEST_METHOD: `POST` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:15.557024 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8946858-997f-40df-892d-648dd600ddc3 None None] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:15.557311 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8946858-997f-40df-892d-648dd600ddc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:15.566532 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed25a74-39f9-49dc-8768-52b2e2b279b5 None None] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:15.578987 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.auth.core [None req-a8946858-997f-40df-892d-648dd600ddc3 None None] MFA Rules not processed for user `ae4bcdd8106d4bebbdcae96be33505bc`. Rule list: `[]` (Enabled: `True`). {{(pid=86655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:39:15.580216 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-a8946858-997f-40df-892d-648dd600ddc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:39:15.608670 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfda511-f597-4bc8-a94a-ec462726a52d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:15.609841 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfda511-f597-4bc8-a94a-ec462726a52d None admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:15.610336 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfda511-f597-4bc8-a94a-ec462726a52d None admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:15.610809 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfda511-f597-4bc8-a94a-ec462726a52d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:15.612077 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcfda511-f597-4bc8-a94a-ec462726a52d None admin] RBAC: Adding query filter params (role.id=0da46c267d354cce81495dfdd56c1ec2, scope.project.id=e3cf5b002a1c43f7a02696ed092318ca, user.id=0a224a2fe3564a139251a43e0a4768a0) {{(pid=86656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:39:15.612841 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcfda511-f597-4bc8-a94a-ec462726a52d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:39:15.614735 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcfda511-f597-4bc8-a94a-ec462726a52d None admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:39:15.629122 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 116/225] 10.222.0.16 () {56 vars in 1374 bytes} [Thu Jul 14 10:39:15 2022] GET /identity/v3/role_assignments?user.id=0a224a2fe3564a139251a43e0a4768a0&scope.project.id=e3cf5b002a1c43f7a02696ed092318ca&role.id=0da46c267d354cce81495dfdd56c1ec2 => generated 259 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:39:15.630517 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfda511-f597-4bc8-a94a-ec462726a52d None admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:15.654388 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 110/226] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jul 14 10:39:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 10:39:15.677170 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8946858-997f-40df-892d-648dd600ddc3 None None] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:15.762053 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=100 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:39:15.770735 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfda511-f597-4bc8-a94a-ec462726a52d None admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:15.788804 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8946858-997f-40df-892d-648dd600ddc3 None None] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:15.824961 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62352a3-c03b-4434-aed8-6fd3b7af43f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:15.825813 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62352a3-c03b-4434-aed8-6fd3b7af43f9 None admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:15.826109 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62352a3-c03b-4434-aed8-6fd3b7af43f9 None admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:15.826396 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62352a3-c03b-4434-aed8-6fd3b7af43f9 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:15.837141 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=100 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:39:15.844579 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f3d460-9960-4d23-8474-08e433264078 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:15.845518 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f3d460-9960-4d23-8474-08e433264078 None admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:15.845807 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f3d460-9960-4d23-8474-08e433264078 None admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:15.846872 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f3d460-9960-4d23-8474-08e433264078 None admin] PATH_INFO: `/v3/users/7ad22452179f4edaa1ae4b7ddb2f464c` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:15.851911 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f3d460-9960-4d23-8474-08e433264078 None admin] RBAC: Authorizing `identity:get_user(user_id=7ad22452179f4edaa1ae4b7ddb2f464c)` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:39:15.853421 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f3d460-9960-4d23-8474-08e433264078 None admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:39:15.856093 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62352a3-c03b-4434-aed8-6fd3b7af43f9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 10:39:15.860000 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 117/227] 10.222.0.16 () {56 vars in 1177 bytes} [Thu Jul 14 10:39:15 2022] GET /identity/v3/users/7ad22452179f4edaa1ae4b7ddb2f464c => generated 283 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:39:15.860837 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f3d460-9960-4d23-8474-08e433264078 None admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:15.866759 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application [None req-d62352a3-c03b-4434-aed8-6fd3b7af43f9 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 14 10:39:15.866759 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:39:15.866759 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:39:15.866759 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:39:15.866759 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:39:15.866759 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:39:15.866759 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:39:15.866759 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:39:15.866759 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:39:15.866759 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:39:15.866759 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:39:15.866759 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:39:15.866759 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 10:39:15.866759 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 10:39:15.866759 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 10:39:15.866759 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 10:39:15.867631 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 10:39:15.867631 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 10:39:15.867631 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 10:39:15.867631 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 10:39:15.867631 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:39:15.867631 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:39:15.867631 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:39:15.867631 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:39:15.867631 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:39:15.867631 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:39:15.867631 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:39:15.867631 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application with Lock( Jul 14 10:39:15.867631 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:39:15.867631 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:39:15.867631 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:39:15.867631 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:39:15.868830 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:39:15.868830 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:39:15.868830 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:39:15.868830 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:39:15.868830 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 10:39:15.868830 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 10:39:15.868830 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 10:39:15.868830 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 10:39:15.868830 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 10:39:15.868830 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 10:39:15.868830 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 14 10:39:15.868830 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application Jul 14 10:39:15.868830 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 111/228] 10.222.0.16 () {56 vars in 1114 bytes} [Thu Jul 14 10:39:15 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:39:15.874211 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62352a3-c03b-4434-aed8-6fd3b7af43f9 None admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:15.980372 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62352a3-c03b-4434-aed8-6fd3b7af43f9 None admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:15.985437 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f3d460-9960-4d23-8474-08e433264078 None admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:16.017732 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c904ef-693e-4b74-b1e0-2d7ec3d0cadf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:16.018722 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c904ef-693e-4b74-b1e0-2d7ec3d0cadf None admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:16.019161 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c904ef-693e-4b74-b1e0-2d7ec3d0cadf None admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:16.019985 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c904ef-693e-4b74-b1e0-2d7ec3d0cadf None admin] PATH_INFO: `/v3/roles` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:16.020895 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c904ef-693e-4b74-b1e0-2d7ec3d0cadf None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:39:16.021321 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c904ef-693e-4b74-b1e0-2d7ec3d0cadf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:39:16.023009 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a191ec06-023a-4b8b-99ed-5a9c6417c8a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:16.023148 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c904ef-693e-4b74-b1e0-2d7ec3d0cadf None admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:39:16.023958 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a191ec06-023a-4b8b-99ed-5a9c6417c8a0 None admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:16.024245 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a191ec06-023a-4b8b-99ed-5a9c6417c8a0 None admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:16.024689 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a191ec06-023a-4b8b-99ed-5a9c6417c8a0 None admin] PATH_INFO: `/v3/projects/e3cf5b002a1c43f7a02696ed092318ca` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:16.026150 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a191ec06-023a-4b8b-99ed-5a9c6417c8a0 None admin] RBAC: Authorizing `identity:get_project(project_id=e3cf5b002a1c43f7a02696ed092318ca)` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:39:16.027648 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a191ec06-023a-4b8b-99ed-5a9c6417c8a0 None admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:39:16.037119 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 112/229] 10.222.0.16 () {56 vars in 1111 bytes} [Thu Jul 14 10:39:15 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 10:39:16.037692 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 118/230] 10.222.0.16 () {56 vars in 1186 bytes} [Thu Jul 14 10:39:15 2022] GET /identity/v3/projects/e3cf5b002a1c43f7a02696ed092318ca => generated 302 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:39:16.039795 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c904ef-693e-4b74-b1e0-2d7ec3d0cadf None admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:16.043060 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a191ec06-023a-4b8b-99ed-5a9c6417c8a0 None admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:16.076566 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=100 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:39:16.125186 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=100 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:39:16.148400 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c904ef-693e-4b74-b1e0-2d7ec3d0cadf None admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:16.183154 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33488d93-f652-46de-92ab-ffbbed924bd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:16.184111 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33488d93-f652-46de-92ab-ffbbed924bd5 None admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:16.184403 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33488d93-f652-46de-92ab-ffbbed924bd5 None admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:16.184734 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33488d93-f652-46de-92ab-ffbbed924bd5 None admin] PATH_INFO: `/v3/users/7ad22452179f4edaa1ae4b7ddb2f464c` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:16.185980 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33488d93-f652-46de-92ab-ffbbed924bd5 None admin] RBAC: Authorizing `identity:get_user(user_id=7ad22452179f4edaa1ae4b7ddb2f464c)` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:39:16.187858 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33488d93-f652-46de-92ab-ffbbed924bd5 None admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:39:16.190385 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 113/231] 10.222.0.16 () {56 vars in 1177 bytes} [Thu Jul 14 10:39:16 2022] GET /identity/v3/users/7ad22452179f4edaa1ae4b7ddb2f464c => generated 283 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:39:16.195813 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33488d93-f652-46de-92ab-ffbbed924bd5 None admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:16.267758 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a191ec06-023a-4b8b-99ed-5a9c6417c8a0 None admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:16.301154 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=100 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:39:16.303600 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33488d93-f652-46de-92ab-ffbbed924bd5 None admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:16.339769 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de8d3de-03a6-494c-84a6-43fda0d8692c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:16.340390 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de8d3de-03a6-494c-84a6-43fda0d8692c None admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:16.341007 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de8d3de-03a6-494c-84a6-43fda0d8692c None admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:16.341364 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de8d3de-03a6-494c-84a6-43fda0d8692c None admin] PATH_INFO: `/v3/projects/e3cf5b002a1c43f7a02696ed092318ca` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:16.342770 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de8d3de-03a6-494c-84a6-43fda0d8692c None admin] RBAC: Authorizing `identity:get_project(project_id=e3cf5b002a1c43f7a02696ed092318ca)` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:39:16.344420 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de8d3de-03a6-494c-84a6-43fda0d8692c None admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:39:16.346908 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 114/232] 10.222.0.16 () {56 vars in 1186 bytes} [Thu Jul 14 10:39:16 2022] GET /identity/v3/projects/e3cf5b002a1c43f7a02696ed092318ca => generated 302 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:39:16.352348 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de8d3de-03a6-494c-84a6-43fda0d8692c None admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:16.355618 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783de9ce-177f-4759-a691-84a8059da06f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:16.356838 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783de9ce-177f-4759-a691-84a8059da06f None admin] REQUEST_METHOD: `PUT` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:16.357289 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783de9ce-177f-4759-a691-84a8059da06f None admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:16.357711 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783de9ce-177f-4759-a691-84a8059da06f None admin] PATH_INFO: `/v3/projects/e3cf5b002a1c43f7a02696ed092318ca/users/7ad22452179f4edaa1ae4b7ddb2f464c/roles/153539819e5542df99269d2913bbecfb` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:16.364017 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783de9ce-177f-4759-a691-84a8059da06f None admin] RBAC: Authorizing `identity:create_grant(project_id=e3cf5b002a1c43f7a02696ed092318ca, user_id=7ad22452179f4edaa1ae4b7ddb2f464c, role_id=153539819e5542df99269d2913bbecfb)` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:39:16.365812 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783de9ce-177f-4759-a691-84a8059da06f None admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:39:16.388214 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 119/233] 10.222.0.16 () {58 vars in 1439 bytes} [Thu Jul 14 10:39:16 2022] PUT /identity/v3/projects/e3cf5b002a1c43f7a02696ed092318ca/users/7ad22452179f4edaa1ae4b7ddb2f464c/roles/153539819e5542df99269d2913bbecfb => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:39:16.467953 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de8d3de-03a6-494c-84a6-43fda0d8692c None admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:16.513578 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80cefb2-924b-4d69-80e1-0ce646310777 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:16.514551 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80cefb2-924b-4d69-80e1-0ce646310777 None admin] REQUEST_METHOD: `PUT` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:16.514843 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80cefb2-924b-4d69-80e1-0ce646310777 None admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:16.515172 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80cefb2-924b-4d69-80e1-0ce646310777 None admin] PATH_INFO: `/v3/projects/e3cf5b002a1c43f7a02696ed092318ca/users/7ad22452179f4edaa1ae4b7ddb2f464c/roles/64ec6989f4724a8ab1e32d37c186c8f8` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:16.517453 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80cefb2-924b-4d69-80e1-0ce646310777 None admin] RBAC: Authorizing `identity:create_grant(project_id=e3cf5b002a1c43f7a02696ed092318ca, user_id=7ad22452179f4edaa1ae4b7ddb2f464c, role_id=64ec6989f4724a8ab1e32d37c186c8f8)` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:39:16.519057 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80cefb2-924b-4d69-80e1-0ce646310777 None admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:39:16.542789 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 115/234] 10.222.0.16 () {58 vars in 1439 bytes} [Thu Jul 14 10:39:16 2022] PUT /identity/v3/projects/e3cf5b002a1c43f7a02696ed092318ca/users/7ad22452179f4edaa1ae4b7ddb2f464c/roles/64ec6989f4724a8ab1e32d37c186c8f8 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 10:39:17.122974 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d4b48e-34e2-48c0-92c8-0ad194d0c506 None None] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:17.123514 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d4b48e-34e2-48c0-92c8-0ad194d0c506 None None] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:17.123514 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d4b48e-34e2-48c0-92c8-0ad194d0c506 None None] PATH_INFO: `/` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:17.125060 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 120/235] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jul 14 10:39:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:39:17.130828 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c756047a-e299-4770-a6bd-57d7af96b7d4 None None] REQUEST_METHOD: `POST` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:17.131666 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c756047a-e299-4770-a6bd-57d7af96b7d4 None None] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:17.132177 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c756047a-e299-4770-a6bd-57d7af96b7d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:17.139585 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23d1295-1a95-401b-b554-d4b932ed9544 None None] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:17.140129 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23d1295-1a95-401b-b554-d4b932ed9544 None None] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:17.140603 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23d1295-1a95-401b-b554-d4b932ed9544 None None] PATH_INFO: `/` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:17.142459 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 121/236] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jul 14 10:39:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:39:17.147787 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cc13c4-13ff-4832-b85d-4bcd9e1da1ee None None] REQUEST_METHOD: `POST` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:17.148329 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cc13c4-13ff-4832-b85d-4bcd9e1da1ee None None] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:17.148838 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cc13c4-13ff-4832-b85d-4bcd9e1da1ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:17.169242 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.auth.core [None req-c756047a-e299-4770-a6bd-57d7af96b7d4 None None] MFA Rules not processed for user `ae4bcdd8106d4bebbdcae96be33505bc`. Rule list: `[]` (Enabled: `True`). {{(pid=86655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:39:17.173517 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-c756047a-e299-4770-a6bd-57d7af96b7d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:39:17.175374 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.auth.core [None req-b7cc13c4-13ff-4832-b85d-4bcd9e1da1ee None None] MFA Rules not processed for user `ae4bcdd8106d4bebbdcae96be33505bc`. Rule list: `[]` (Enabled: `True`). {{(pid=86656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:39:17.178795 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-b7cc13c4-13ff-4832-b85d-4bcd9e1da1ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:39:17.211575 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:39:17.288563 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 122/237] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jul 14 10:39:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 10:39:17.315859 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7cc13c4-13ff-4832-b85d-4bcd9e1da1ee None None] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:17.318785 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 116/238] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jul 14 10:39:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 14 10:39:17.339986 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:39:17.353165 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c756047a-e299-4770-a6bd-57d7af96b7d4 None None] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:17.498095 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7cc13c4-13ff-4832-b85d-4bcd9e1da1ee None None] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:17.540373 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c756047a-e299-4770-a6bd-57d7af96b7d4 None None] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:17.573088 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa43796-ee62-4bbc-89a8-8ef90057b3f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:17.574913 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa43796-ee62-4bbc-89a8-8ef90057b3f9 None admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:17.576853 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa43796-ee62-4bbc-89a8-8ef90057b3f9 None admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:17.578612 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa43796-ee62-4bbc-89a8-8ef90057b3f9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:17.580036 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa43796-ee62-4bbc-89a8-8ef90057b3f9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:39:17.582661 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa43796-ee62-4bbc-89a8-8ef90057b3f9 None admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:39:17.587570 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 123/239] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Jul 14 10:39:17 2022] GET /identity/v3/domains/default => generated 199 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 10:39:17.592965 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa43796-ee62-4bbc-89a8-8ef90057b3f9 None admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:17.617933 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4581ae6e-dbf3-4ebd-be9d-894db3232f39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:17.619218 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4581ae6e-dbf3-4ebd-be9d-894db3232f39 None admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:17.620363 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4581ae6e-dbf3-4ebd-be9d-894db3232f39 None admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:17.621057 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4581ae6e-dbf3-4ebd-be9d-894db3232f39 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:17.643461 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4581ae6e-dbf3-4ebd-be9d-894db3232f39 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 10:39:17.652027 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application [None req-4581ae6e-dbf3-4ebd-be9d-894db3232f39 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 14 10:39:17.652027 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:39:17.652027 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:39:17.652027 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:39:17.652027 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:39:17.652027 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:39:17.652027 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:39:17.652027 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:39:17.652027 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:39:17.652027 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:39:17.652027 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:39:17.652027 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:39:17.652027 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 10:39:17.652027 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 10:39:17.652027 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 10:39:17.652027 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 10:39:17.652934 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 10:39:17.652934 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 10:39:17.652934 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 10:39:17.652934 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 10:39:17.652934 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:39:17.652934 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:39:17.652934 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:39:17.652934 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:39:17.652934 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:39:17.652934 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:39:17.652934 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:39:17.652934 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application with Lock( Jul 14 10:39:17.652934 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:39:17.652934 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:39:17.652934 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:39:17.652934 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:39:17.653709 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:39:17.653709 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:39:17.653709 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:39:17.653709 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:39:17.653709 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 10:39:17.653709 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 10:39:17.653709 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 10:39:17.653709 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 10:39:17.653709 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 10:39:17.653709 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 10:39:17.653709 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 14 10:39:17.653709 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application Jul 14 10:39:17.656530 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 117/240] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Jul 14 10:39:17 2022] GET /identity/v3/roles/reader => generated 84 bytes in 304 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 10:39:17.665824 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4581ae6e-dbf3-4ebd-be9d-894db3232f39 None admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:17.697369 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=100 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:39:17.717001 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=100 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:39:17.742833 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa43796-ee62-4bbc-89a8-8ef90057b3f9 None admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:17.821496 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5c0815-18b7-4472-8537-b63a906339c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:17.823073 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5c0815-18b7-4472-8537-b63a906339c2 None admin] REQUEST_METHOD: `POST` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:17.823770 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5c0815-18b7-4472-8537-b63a906339c2 None admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:17.824510 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5c0815-18b7-4472-8537-b63a906339c2 None admin] PATH_INFO: `/v3/users` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:17.825633 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5c0815-18b7-4472-8537-b63a906339c2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:39:17.827297 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5c0815-18b7-4472-8537-b63a906339c2 None admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:39:17.870342 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 124/241] 10.222.0.16 () {60 vars in 1132 bytes} [Thu Jul 14 10:39:17 2022] POST /identity/v3/users => generated 293 bytes in 277 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:39:17.871163 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4581ae6e-dbf3-4ebd-be9d-894db3232f39 None admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:17.917775 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8da0128-c14d-4bee-9660-9750b72118ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:17.918895 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8da0128-c14d-4bee-9660-9750b72118ec None admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:17.919395 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8da0128-c14d-4bee-9660-9750b72118ec None admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:17.919913 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8da0128-c14d-4bee-9660-9750b72118ec None admin] PATH_INFO: `/v3/roles` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:17.921174 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8da0128-c14d-4bee-9660-9750b72118ec None admin] RBAC: Adding query filter params (name=reader) {{(pid=86655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:39:17.921734 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8da0128-c14d-4bee-9660-9750b72118ec None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:39:17.923456 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8da0128-c14d-4bee-9660-9750b72118ec None admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:39:17.939076 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 118/242] 10.222.0.16 () {56 vars in 1101 bytes} [Thu Jul 14 10:39:17 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:39:17.946000 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5c0815-18b7-4472-8537-b63a906339c2 None admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:18.072128 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5c0815-18b7-4472-8537-b63a906339c2 None admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:18.111614 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ea6ed5-3c7d-4c6a-9b89-6c8795fc75a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:18.112569 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ea6ed5-3c7d-4c6a-9b89-6c8795fc75a4 None admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:18.112888 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ea6ed5-3c7d-4c6a-9b89-6c8795fc75a4 None admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:18.113169 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ea6ed5-3c7d-4c6a-9b89-6c8795fc75a4 None admin] PATH_INFO: `/v3/users/3cd90079970b40f5ba0ee0adc97d52b8` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:18.127731 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ea6ed5-3c7d-4c6a-9b89-6c8795fc75a4 None admin] RBAC: Authorizing `identity:get_user(user_id=3cd90079970b40f5ba0ee0adc97d52b8)` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:39:18.129252 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ea6ed5-3c7d-4c6a-9b89-6c8795fc75a4 None admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:39:18.130968 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 125/243] 10.222.0.16 () {56 vars in 1177 bytes} [Thu Jul 14 10:39:17 2022] GET /identity/v3/users/3cd90079970b40f5ba0ee0adc97d52b8 => generated 297 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:39:18.136811 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8da0128-c14d-4bee-9660-9750b72118ec None admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:18.147186 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391baf63-418d-4247-bd5d-75bafc3bc237 None None] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:18.147186 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391baf63-418d-4247-bd5d-75bafc3bc237 None None] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:18.147421 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391baf63-418d-4247-bd5d-75bafc3bc237 None None] PATH_INFO: `/` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:18.148991 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 126/244] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jul 14 10:39:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:39:18.154755 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756e194a-b8b4-40b8-b9e6-9acbd6218ccd None None] REQUEST_METHOD: `POST` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:18.155046 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756e194a-b8b4-40b8-b9e6-9acbd6218ccd None None] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:18.155329 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756e194a-b8b4-40b8-b9e6-9acbd6218ccd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:18.162181 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:39:18.174256 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.auth.core [None req-756e194a-b8b4-40b8-b9e6-9acbd6218ccd None None] MFA Rules not processed for user `ae4bcdd8106d4bebbdcae96be33505bc`. Rule list: `[]` (Enabled: `True`). {{(pid=86656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:39:18.175785 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-756e194a-b8b4-40b8-b9e6-9acbd6218ccd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:39:18.269182 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=100 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:39:18.273398 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 127/245] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jul 14 10:39:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 14 10:39:18.274028 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8da0128-c14d-4bee-9660-9750b72118ec None admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:18.303658 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756e194a-b8b4-40b8-b9e6-9acbd6218ccd None None] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:18.316468 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e174916-480d-45cc-b9fb-8df78ef55923 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:18.317258 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e174916-480d-45cc-b9fb-8df78ef55923 None admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:18.317622 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e174916-480d-45cc-b9fb-8df78ef55923 None admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:18.317971 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e174916-480d-45cc-b9fb-8df78ef55923 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:18.424600 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e174916-480d-45cc-b9fb-8df78ef55923 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:39:18.426785 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e174916-480d-45cc-b9fb-8df78ef55923 None admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:39:18.453857 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756e194a-b8b4-40b8-b9e6-9acbd6218ccd None None] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:18.497407 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346b854b-6347-4526-9b6e-7d0e97624525 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:18.498220 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346b854b-6347-4526-9b6e-7d0e97624525 None admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:18.498508 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346b854b-6347-4526-9b6e-7d0e97624525 None admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:18.498790 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346b854b-6347-4526-9b6e-7d0e97624525 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:18.501203 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=100 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:39:18.512651 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346b854b-6347-4526-9b6e-7d0e97624525 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 10:39:18.527941 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application [None req-346b854b-6347-4526-9b6e-7d0e97624525 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 14 10:39:18.527941 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:39:18.527941 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:39:18.527941 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:39:18.527941 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:39:18.527941 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:39:18.527941 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:39:18.527941 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:39:18.527941 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:39:18.527941 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:39:18.527941 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:39:18.527941 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:39:18.527941 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 10:39:18.527941 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 10:39:18.527941 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 10:39:18.527941 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 10:39:18.529061 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 10:39:18.529061 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 10:39:18.529061 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 10:39:18.529061 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 10:39:18.529061 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:39:18.529061 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:39:18.529061 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:39:18.529061 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:39:18.529061 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:39:18.529061 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:39:18.529061 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:39:18.529061 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application with Lock( Jul 14 10:39:18.529061 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:39:18.529061 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:39:18.529061 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:39:18.529061 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:39:18.529987 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:39:18.529987 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:39:18.529987 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:39:18.529987 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:39:18.529987 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 10:39:18.529987 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 10:39:18.529987 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 10:39:18.529987 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 10:39:18.529987 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 10:39:18.529987 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 10:39:18.529987 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 14 10:39:18.529987 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application Jul 14 10:39:18.529987 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 128/246] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Jul 14 10:39:18 2022] GET /identity/v3/roles/member => generated 84 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 10:39:18.537709 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346b854b-6347-4526-9b6e-7d0e97624525 None admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:18.542182 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=100 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:39:18.573741 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 119/247] 10.222.0.16 () {58 vars in 1282 bytes} [Thu Jul 14 10:39:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 437 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 10:39:18.581421 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e174916-480d-45cc-b9fb-8df78ef55923 None admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:18.681619 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346b854b-6347-4526-9b6e-7d0e97624525 None admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:18.686541 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e174916-480d-45cc-b9fb-8df78ef55923 None admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:18.717439 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e67adb-5021-49c5-87da-ef7e35fc2a59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:18.718263 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e67adb-5021-49c5-87da-ef7e35fc2a59 None admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:18.718676 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e67adb-5021-49c5-87da-ef7e35fc2a59 None admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:18.719062 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e67adb-5021-49c5-87da-ef7e35fc2a59 None admin] PATH_INFO: `/v3/roles` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:18.719926 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e67adb-5021-49c5-87da-ef7e35fc2a59 None admin] RBAC: Adding query filter params (name=member) {{(pid=86656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:39:18.720343 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e67adb-5021-49c5-87da-ef7e35fc2a59 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:39:18.722274 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e67adb-5021-49c5-87da-ef7e35fc2a59 None admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:39:18.724200 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e03c90-25da-4d82-896b-8e8fd7022c4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:18.725205 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e03c90-25da-4d82-896b-8e8fd7022c4b None admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:18.725491 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e03c90-25da-4d82-896b-8e8fd7022c4b None admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:18.725770 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e03c90-25da-4d82-896b-8e8fd7022c4b None admin] PATH_INFO: `/v3/projects/e3cf5b002a1c43f7a02696ed092318ca` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:18.727078 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e03c90-25da-4d82-896b-8e8fd7022c4b None admin] RBAC: Authorizing `identity:get_project(project_id=e3cf5b002a1c43f7a02696ed092318ca)` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:39:18.728868 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e03c90-25da-4d82-896b-8e8fd7022c4b None admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:39:18.730608 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 120/248] 10.222.0.16 () {56 vars in 1186 bytes} [Thu Jul 14 10:39:18 2022] GET /identity/v3/projects/e3cf5b002a1c43f7a02696ed092318ca => generated 302 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 10:39:18.732028 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 129/249] 10.222.0.16 () {56 vars in 1101 bytes} [Thu Jul 14 10:39:18 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 10:39:18.741175 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e03c90-25da-4d82-896b-8e8fd7022c4b None admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:18.741348 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e67adb-5021-49c5-87da-ef7e35fc2a59 None admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:18.809398 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=100 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:39:18.852043 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=100 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:39:18.871571 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e03c90-25da-4d82-896b-8e8fd7022c4b None admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:18.908020 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acbe373-7e9d-4b6f-958a-f8aa50b1792b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:18.909674 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acbe373-7e9d-4b6f-958a-f8aa50b1792b None admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:18.909963 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acbe373-7e9d-4b6f-958a-f8aa50b1792b None admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:18.910238 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acbe373-7e9d-4b6f-958a-f8aa50b1792b None admin] PATH_INFO: `/v3/users/0a224a2fe3564a139251a43e0a4768a0` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:18.911491 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0acbe373-7e9d-4b6f-958a-f8aa50b1792b None admin] RBAC: Authorizing `identity:get_user(user_id=0a224a2fe3564a139251a43e0a4768a0)` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:39:18.913315 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0acbe373-7e9d-4b6f-958a-f8aa50b1792b None admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:39:18.914774 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 121/250] 10.222.0.16 () {56 vars in 1177 bytes} [Thu Jul 14 10:39:18 2022] GET /identity/v3/users/0a224a2fe3564a139251a43e0a4768a0 => generated 297 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:39:18.920352 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acbe373-7e9d-4b6f-958a-f8aa50b1792b None admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:18.932746 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e67adb-5021-49c5-87da-ef7e35fc2a59 None admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:18.990029 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09354e97-c97f-41bd-bfbb-6352b26619af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:18.991037 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09354e97-c97f-41bd-bfbb-6352b26619af None admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:18.991539 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09354e97-c97f-41bd-bfbb-6352b26619af None admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:18.992008 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09354e97-c97f-41bd-bfbb-6352b26619af None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:18.993095 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09354e97-c97f-41bd-bfbb-6352b26619af None admin] RBAC: Adding query filter params (role.id=ac28665f2a2446b8a9c98f0de3126d33, scope.project.id=e3cf5b002a1c43f7a02696ed092318ca, user.id=3cd90079970b40f5ba0ee0adc97d52b8) {{(pid=86656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:39:18.993605 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09354e97-c97f-41bd-bfbb-6352b26619af None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:39:18.995237 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09354e97-c97f-41bd-bfbb-6352b26619af None admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:39:19.009688 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 130/251] 10.222.0.16 () {56 vars in 1374 bytes} [Thu Jul 14 10:39:18 2022] GET /identity/v3/role_assignments?user.id=3cd90079970b40f5ba0ee0adc97d52b8&scope.project.id=e3cf5b002a1c43f7a02696ed092318ca&role.id=ac28665f2a2446b8a9c98f0de3126d33 => generated 259 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 10:39:19.038516 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acbe373-7e9d-4b6f-958a-f8aa50b1792b None admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:19.058959 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=100 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:39:19.092286 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4cec46c-4280-4699-b1c4-7dd9f4f0efa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:19.093207 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cec46c-4280-4699-b1c4-7dd9f4f0efa6 None admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:19.093498 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cec46c-4280-4699-b1c4-7dd9f4f0efa6 None admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:19.093779 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cec46c-4280-4699-b1c4-7dd9f4f0efa6 None admin] PATH_INFO: `/v3/projects/e3cf5b002a1c43f7a02696ed092318ca` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:19.097691 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4cec46c-4280-4699-b1c4-7dd9f4f0efa6 None admin] RBAC: Authorizing `identity:get_project(project_id=e3cf5b002a1c43f7a02696ed092318ca)` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:39:19.099335 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4cec46c-4280-4699-b1c4-7dd9f4f0efa6 None admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:39:19.101492 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 122/252] 10.222.0.16 () {56 vars in 1186 bytes} [Thu Jul 14 10:39:18 2022] GET /identity/v3/projects/e3cf5b002a1c43f7a02696ed092318ca => generated 302 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 10:39:19.107629 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09354e97-c97f-41bd-bfbb-6352b26619af None admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:19.251815 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09354e97-c97f-41bd-bfbb-6352b26619af None admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:19.270948 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee708827-5019-4c2b-bf71-d52425f84525 None None] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:19.271444 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee708827-5019-4c2b-bf71-d52425f84525 None None] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:19.271516 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee708827-5019-4c2b-bf71-d52425f84525 None None] PATH_INFO: `/` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:19.272981 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 123/253] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jul 14 10:39:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 14 10:39:19.277151 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=100 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:39:19.286560 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957f31b0-af8f-4e72-88cf-5f4867e9555d None None] REQUEST_METHOD: `POST` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:19.286941 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957f31b0-af8f-4e72-88cf-5f4867e9555d None None] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:19.287330 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957f31b0-af8f-4e72-88cf-5f4867e9555d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:19.289102 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826c5fc5-00d7-4b3a-9e43-3f39b388fd3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:19.290009 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826c5fc5-00d7-4b3a-9e43-3f39b388fd3a None admin] REQUEST_METHOD: `PUT` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:19.290302 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826c5fc5-00d7-4b3a-9e43-3f39b388fd3a None admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:19.290584 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826c5fc5-00d7-4b3a-9e43-3f39b388fd3a None admin] PATH_INFO: `/v3/projects/e3cf5b002a1c43f7a02696ed092318ca/users/0a224a2fe3564a139251a43e0a4768a0/roles/0da46c267d354cce81495dfdd56c1ec2` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:19.292610 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826c5fc5-00d7-4b3a-9e43-3f39b388fd3a None admin] RBAC: Authorizing `identity:create_grant(project_id=e3cf5b002a1c43f7a02696ed092318ca, user_id=0a224a2fe3564a139251a43e0a4768a0, role_id=0da46c267d354cce81495dfdd56c1ec2)` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:39:19.294105 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826c5fc5-00d7-4b3a-9e43-3f39b388fd3a None admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:39:19.309110 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 131/254] 10.222.0.16 () {58 vars in 1439 bytes} [Thu Jul 14 10:39:19 2022] PUT /identity/v3/projects/e3cf5b002a1c43f7a02696ed092318ca/users/0a224a2fe3564a139251a43e0a4768a0/roles/0da46c267d354cce81495dfdd56c1ec2 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:39:19.315220 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89d2fd1-e15b-4290-97dc-da4c0b92a88e None None] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:19.315617 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89d2fd1-e15b-4290-97dc-da4c0b92a88e None None] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:19.315895 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89d2fd1-e15b-4290-97dc-da4c0b92a88e None None] PATH_INFO: `/` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:19.317418 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 132/255] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jul 14 10:39:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 14 10:39:19.327229 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.auth.core [None req-957f31b0-af8f-4e72-88cf-5f4867e9555d None None] MFA Rules not processed for user `ae4bcdd8106d4bebbdcae96be33505bc`. Rule list: `[]` (Enabled: `True`). {{(pid=86655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:39:19.328974 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-957f31b0-af8f-4e72-88cf-5f4867e9555d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:39:19.330355 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9642f4f-8a1d-469a-a599-860ba170a312 None None] REQUEST_METHOD: `POST` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:19.330668 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9642f4f-8a1d-469a-a599-860ba170a312 None None] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:19.330934 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9642f4f-8a1d-469a-a599-860ba170a312 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:19.391239 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.auth.core [None req-d9642f4f-8a1d-469a-a599-860ba170a312 None None] MFA Rules not processed for user `ae4bcdd8106d4bebbdcae96be33505bc`. Rule list: `[]` (Enabled: `True`). {{(pid=86656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:39:19.393893 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-d9642f4f-8a1d-469a-a599-860ba170a312 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:39:19.499225 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 124/256] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jul 14 10:39:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 10:39:19.524811 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 133/257] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jul 14 10:39:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 10:39:19.561647 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957f31b0-af8f-4e72-88cf-5f4867e9555d None None] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:19.597573 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9642f4f-8a1d-469a-a599-860ba170a312 None None] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:19.681458 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957f31b0-af8f-4e72-88cf-5f4867e9555d None None] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:19.693523 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=100 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:39:19.725994 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb19cd38-ed9d-43d1-a106-f0351118734a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:19.726801 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb19cd38-ed9d-43d1-a106-f0351118734a None admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:19.727080 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb19cd38-ed9d-43d1-a106-f0351118734a None admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:19.727348 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb19cd38-ed9d-43d1-a106-f0351118734a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:19.753685 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb19cd38-ed9d-43d1-a106-f0351118734a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 10:39:19.762472 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application [None req-fb19cd38-ed9d-43d1-a106-f0351118734a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 10:39:19.762472 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:39:19.762472 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:39:19.762472 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:39:19.762472 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:39:19.762472 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:39:19.762472 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:39:19.762472 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:39:19.762472 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:39:19.762472 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:39:19.762472 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:39:19.762472 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:39:19.762472 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 10:39:19.762472 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 10:39:19.762472 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 10:39:19.762472 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 10:39:19.763362 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 10:39:19.763362 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 10:39:19.763362 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 10:39:19.763362 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 10:39:19.763362 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:39:19.763362 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:39:19.763362 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:39:19.763362 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:39:19.763362 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:39:19.763362 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:39:19.763362 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:39:19.763362 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application with Lock( Jul 14 10:39:19.763362 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:39:19.763362 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:39:19.763362 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:39:19.763362 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:39:19.764133 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:39:19.764133 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:39:19.764133 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:39:19.764133 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:39:19.764133 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 10:39:19.764133 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 10:39:19.764133 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 10:39:19.764133 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 10:39:19.764133 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 10:39:19.764133 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 10:39:19.764133 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 10:39:19.764133 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application Jul 14 10:39:19.764133 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 125/258] 10.222.0.16 () {56 vars in 1096 bytes} [Thu Jul 14 10:39:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:39:19.771211 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb19cd38-ed9d-43d1-a106-f0351118734a None admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:19.847777 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9642f4f-8a1d-469a-a599-860ba170a312 None None] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:19.868115 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:39:19.938317 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426bf79f-1bf9-45bd-ab10-a075fc2adf79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:19.939545 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426bf79f-1bf9-45bd-ab10-a075fc2adf79 None admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:19.939865 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426bf79f-1bf9-45bd-ab10-a075fc2adf79 None admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:19.940145 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426bf79f-1bf9-45bd-ab10-a075fc2adf79 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:19.973740 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426bf79f-1bf9-45bd-ab10-a075fc2adf79 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 10:39:19.981819 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application [None req-426bf79f-1bf9-45bd-ab10-a075fc2adf79 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 14 10:39:19.981819 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:39:19.981819 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:39:19.981819 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:39:19.981819 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:39:19.981819 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:39:19.981819 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:39:19.981819 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:39:19.981819 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:39:19.981819 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:39:19.981819 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:39:19.981819 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:39:19.981819 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 10:39:19.981819 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 10:39:19.981819 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 10:39:19.981819 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 10:39:19.982676 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 10:39:19.982676 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 10:39:19.982676 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 10:39:19.982676 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 10:39:19.982676 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:39:19.982676 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:39:19.982676 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:39:19.982676 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:39:19.982676 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:39:19.982676 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:39:19.982676 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:39:19.982676 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application with Lock( Jul 14 10:39:19.982676 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:39:19.982676 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:39:19.982676 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:39:19.982676 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:39:19.983448 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:39:19.983448 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:39:19.983448 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:39:19.983448 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:39:19.983448 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 10:39:19.983448 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 10:39:19.983448 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 10:39:19.983448 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 10:39:19.983448 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 10:39:19.983448 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 10:39:19.983448 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 14 10:39:19.983448 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application Jul 14 10:39:19.990170 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 134/259] 10.222.0.16 () {56 vars in 1114 bytes} [Thu Jul 14 10:39:19 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 393 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:39:19.996387 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426bf79f-1bf9-45bd-ab10-a075fc2adf79 None admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:19.997497 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb19cd38-ed9d-43d1-a106-f0351118734a None admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:20.071879 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b92d27-dbce-4639-b7d2-cf5d9182d5e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:20.072566 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b92d27-dbce-4639-b7d2-cf5d9182d5e3 None admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:20.072871 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b92d27-dbce-4639-b7d2-cf5d9182d5e3 None admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:20.073147 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b92d27-dbce-4639-b7d2-cf5d9182d5e3 None admin] PATH_INFO: `/v3/roles` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:20.074468 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b92d27-dbce-4639-b7d2-cf5d9182d5e3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:39:20.074942 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b92d27-dbce-4639-b7d2-cf5d9182d5e3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:39:20.076361 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b92d27-dbce-4639-b7d2-cf5d9182d5e3 None admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:39:20.093485 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 126/260] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Jul 14 10:39:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 323 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 10:39:20.099524 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b92d27-dbce-4639-b7d2-cf5d9182d5e3 None admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:20.177119 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=100 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:39:20.235418 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426bf79f-1bf9-45bd-ab10-a075fc2adf79 None admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:20.316758 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427207f8-d38b-4ea9-9a03-438ed99540ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:20.317560 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427207f8-d38b-4ea9-9a03-438ed99540ca None admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:20.317726 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427207f8-d38b-4ea9-9a03-438ed99540ca None admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:20.317993 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427207f8-d38b-4ea9-9a03-438ed99540ca None admin] PATH_INFO: `/v3/roles` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:20.318744 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427207f8-d38b-4ea9-9a03-438ed99540ca None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:39:20.319047 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427207f8-d38b-4ea9-9a03-438ed99540ca None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:39:20.320417 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427207f8-d38b-4ea9-9a03-438ed99540ca None admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:39:20.329694 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b92d27-dbce-4639-b7d2-cf5d9182d5e3 None admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:20.342848 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 135/261] 10.222.0.16 () {56 vars in 1111 bytes} [Thu Jul 14 10:39:19 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 347 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 10:39:20.349435 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427207f8-d38b-4ea9-9a03-438ed99540ca None admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:20.398923 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=100 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:39:20.425491 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0909ec-7fc8-46f3-8d51-355d01515f0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:20.426386 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0909ec-7fc8-46f3-8d51-355d01515f0f None admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:20.426671 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0909ec-7fc8-46f3-8d51-355d01515f0f None admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:20.426949 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0909ec-7fc8-46f3-8d51-355d01515f0f None admin] PATH_INFO: `/v3/users/7ad22452179f4edaa1ae4b7ddb2f464c` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:20.428177 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0909ec-7fc8-46f3-8d51-355d01515f0f None admin] RBAC: Authorizing `identity:get_user(user_id=7ad22452179f4edaa1ae4b7ddb2f464c)` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:39:20.429653 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0909ec-7fc8-46f3-8d51-355d01515f0f None admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:39:20.431456 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 127/262] 10.222.0.16 () {56 vars in 1177 bytes} [Thu Jul 14 10:39:20 2022] GET /identity/v3/users/7ad22452179f4edaa1ae4b7ddb2f464c => generated 283 bytes in 332 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:39:20.436905 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0909ec-7fc8-46f3-8d51-355d01515f0f None admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:20.504373 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427207f8-d38b-4ea9-9a03-438ed99540ca None admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:20.547466 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9047332-dd30-4fd2-958e-715bf8e58782 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:20.548345 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9047332-dd30-4fd2-958e-715bf8e58782 None admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:20.548626 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9047332-dd30-4fd2-958e-715bf8e58782 None admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:20.549092 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9047332-dd30-4fd2-958e-715bf8e58782 None admin] PATH_INFO: `/v3/users/7ad22452179f4edaa1ae4b7ddb2f464c` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:20.550485 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9047332-dd30-4fd2-958e-715bf8e58782 None admin] RBAC: Authorizing `identity:get_user(user_id=7ad22452179f4edaa1ae4b7ddb2f464c)` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:39:20.551953 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9047332-dd30-4fd2-958e-715bf8e58782 None admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:39:20.555984 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 136/263] 10.222.0.16 () {56 vars in 1177 bytes} [Thu Jul 14 10:39:20 2022] GET /identity/v3/users/7ad22452179f4edaa1ae4b7ddb2f464c => generated 283 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 10:39:20.563353 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9047332-dd30-4fd2-958e-715bf8e58782 None admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:20.673101 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=100 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:39:20.677586 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0909ec-7fc8-46f3-8d51-355d01515f0f None admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:20.755845 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6aeb30-e34b-470a-968f-6f8cf35921c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:20.756523 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6aeb30-e34b-470a-968f-6f8cf35921c1 None admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:20.756829 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6aeb30-e34b-470a-968f-6f8cf35921c1 None admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:20.757111 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6aeb30-e34b-470a-968f-6f8cf35921c1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:20.779035 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=100 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:39:20.790742 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9047332-dd30-4fd2-958e-715bf8e58782 None admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:20.871319 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6aeb30-e34b-470a-968f-6f8cf35921c1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:39:20.872807 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6aeb30-e34b-470a-968f-6f8cf35921c1 None admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:39:20.909517 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2bc38e-4ff3-4103-b474-511f4f622186 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:20.910190 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2bc38e-4ff3-4103-b474-511f4f622186 None admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:20.910474 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2bc38e-4ff3-4103-b474-511f4f622186 None admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:20.910748 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2bc38e-4ff3-4103-b474-511f4f622186 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:20.981138 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=100 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:39:20.987106 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 128/264] 10.222.0.16 () {58 vars in 1282 bytes} [Thu Jul 14 10:39:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 550 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 10:39:20.992947 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6aeb30-e34b-470a-968f-6f8cf35921c1 None admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:20.998532 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2bc38e-4ff3-4103-b474-511f4f622186 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:39:21.000323 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2bc38e-4ff3-4103-b474-511f4f622186 None admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:39:21.101141 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=100 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:39:21.106356 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 137/265] 10.222.0.16 () {58 vars in 1282 bytes} [Thu Jul 14 10:39:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 543 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 10:39:21.111906 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2bc38e-4ff3-4103-b474-511f4f622186 None admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:21.169193 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6aeb30-e34b-470a-968f-6f8cf35921c1 None admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:21.224357 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9552439-00e6-49ef-a633-fa855db2e4aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:21.225272 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9552439-00e6-49ef-a633-fa855db2e4aa None admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:21.225560 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9552439-00e6-49ef-a633-fa855db2e4aa None admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:21.225848 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9552439-00e6-49ef-a633-fa855db2e4aa None admin] PATH_INFO: `/v3/projects/e3cf5b002a1c43f7a02696ed092318ca` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:21.227863 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9552439-00e6-49ef-a633-fa855db2e4aa None admin] RBAC: Authorizing `identity:get_project(project_id=e3cf5b002a1c43f7a02696ed092318ca)` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:39:21.229669 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9552439-00e6-49ef-a633-fa855db2e4aa None admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:39:21.233032 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 129/266] 10.222.0.16 () {56 vars in 1186 bytes} [Thu Jul 14 10:39:20 2022] GET /identity/v3/projects/e3cf5b002a1c43f7a02696ed092318ca => generated 302 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:39:21.234328 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059b7350-bc95-4000-8b0c-d8f271af321a None None] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:21.234682 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059b7350-bc95-4000-8b0c-d8f271af321a None None] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:21.235025 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059b7350-bc95-4000-8b0c-d8f271af321a None None] PATH_INFO: `/` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:21.236962 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 130/267] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jul 14 10:39:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:39:21.241797 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69885e24-2dac-41b1-aa79-82ec56fdf16c None None] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:21.242290 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69885e24-2dac-41b1-aa79-82ec56fdf16c None None] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:21.243302 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69885e24-2dac-41b1-aa79-82ec56fdf16c None None] PATH_INFO: `/` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:21.245557 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 131/268] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jul 14 10:39:21 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:39:21.246525 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69885e24-2dac-41b1-aa79-82ec56fdf16c None None] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:21.273964 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2bc38e-4ff3-4103-b474-511f4f622186 None admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:21.320292 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bef8e2f-6b96-4856-ac6a-69b44512dc4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:21.322204 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bef8e2f-6b96-4856-ac6a-69b44512dc4a None admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:21.322988 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bef8e2f-6b96-4856-ac6a-69b44512dc4a None admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:21.323703 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bef8e2f-6b96-4856-ac6a-69b44512dc4a None admin] PATH_INFO: `/v3/projects/e3cf5b002a1c43f7a02696ed092318ca` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:21.325639 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bef8e2f-6b96-4856-ac6a-69b44512dc4a None admin] RBAC: Authorizing `identity:get_project(project_id=e3cf5b002a1c43f7a02696ed092318ca)` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:39:21.327322 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=100 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:39:21.327711 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bef8e2f-6b96-4856-ac6a-69b44512dc4a None admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:39:21.330975 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 138/269] 10.222.0.16 () {56 vars in 1186 bytes} [Thu Jul 14 10:39:21 2022] GET /identity/v3/projects/e3cf5b002a1c43f7a02696ed092318ca => generated 302 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:39:21.332673 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9d74c3-04fd-465e-b19d-a4b964a5ad94 None None] REQUEST_METHOD: `POST` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:21.333211 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9d74c3-04fd-465e-b19d-a4b964a5ad94 None None] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:21.334487 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9d74c3-04fd-465e-b19d-a4b964a5ad94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:21.355251 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.auth.core [None req-9b9d74c3-04fd-465e-b19d-a4b964a5ad94 None None] MFA Rules not processed for user `ae4bcdd8106d4bebbdcae96be33505bc`. Rule list: `[]` (Enabled: `True`). {{(pid=86656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:39:21.357437 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-9b9d74c3-04fd-465e-b19d-a4b964a5ad94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:39:21.371631 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69885e24-2dac-41b1-aa79-82ec56fdf16c None None] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:21.418480 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91384fea-6aa5-4cfc-afa0-fecdc34ae940 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:21.419769 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91384fea-6aa5-4cfc-afa0-fecdc34ae940 None admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:21.420494 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91384fea-6aa5-4cfc-afa0-fecdc34ae940 None admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:21.421018 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91384fea-6aa5-4cfc-afa0-fecdc34ae940 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:21.422646 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91384fea-6aa5-4cfc-afa0-fecdc34ae940 None admin] RBAC: Adding query filter params (role.id=153539819e5542df99269d2913bbecfb, scope.project.id=e3cf5b002a1c43f7a02696ed092318ca, user.id=7ad22452179f4edaa1ae4b7ddb2f464c) {{(pid=86655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:39:21.423152 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91384fea-6aa5-4cfc-afa0-fecdc34ae940 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:39:21.426267 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91384fea-6aa5-4cfc-afa0-fecdc34ae940 None admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:39:21.427447 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=100 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:39:21.435605 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 132/271] 10.222.0.16 () {56 vars in 1374 bytes} [Thu Jul 14 10:39:21 2022] GET /identity/v3/role_assignments?user.id=7ad22452179f4edaa1ae4b7ddb2f464c&scope.project.id=e3cf5b002a1c43f7a02696ed092318ca&role.id=153539819e5542df99269d2913bbecfb => generated 608 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:39:21.437407 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c7742f-e8b1-425e-8adf-050193d1b6c9 None None] REQUEST_METHOD: `POST` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:21.437877 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c7742f-e8b1-425e-8adf-050193d1b6c9 None None] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:21.438310 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c7742f-e8b1-425e-8adf-050193d1b6c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:21.440179 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 139/271] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jul 14 10:39:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 10:39:21.441315 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9d74c3-04fd-465e-b19d-a4b964a5ad94 None None] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:21.462250 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.auth.core [None req-55c7742f-e8b1-425e-8adf-050193d1b6c9 None None] MFA Rules not processed for user `ae4bcdd8106d4bebbdcae96be33505bc`. Rule list: `[]` (Enabled: `True`). {{(pid=86655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:39:21.465469 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-55c7742f-e8b1-425e-8adf-050193d1b6c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:39:21.585219 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 133/272] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jul 14 10:39:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 10:39:21.588032 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c7742f-e8b1-425e-8adf-050193d1b6c9 None None] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:21.641736 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9d74c3-04fd-465e-b19d-a4b964a5ad94 None None] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:21.699878 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1094282-8522-4a40-aa57-904f65d69d10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:21.701136 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1094282-8522-4a40-aa57-904f65d69d10 None admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:21.701873 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1094282-8522-4a40-aa57-904f65d69d10 None admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:21.702383 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1094282-8522-4a40-aa57-904f65d69d10 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:21.703870 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1094282-8522-4a40-aa57-904f65d69d10 None admin] RBAC: Adding query filter params (role.id=64ec6989f4724a8ab1e32d37c186c8f8, scope.project.id=e3cf5b002a1c43f7a02696ed092318ca, user.id=7ad22452179f4edaa1ae4b7ddb2f464c) {{(pid=86656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:39:21.704573 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1094282-8522-4a40-aa57-904f65d69d10 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:39:21.708986 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1094282-8522-4a40-aa57-904f65d69d10 None admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:39:21.710147 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=100 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:39:21.719744 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 140/273] 10.222.0.16 () {56 vars in 1374 bytes} [Thu Jul 14 10:39:21 2022] GET /identity/v3/role_assignments?user.id=7ad22452179f4edaa1ae4b7ddb2f464c&scope.project.id=e3cf5b002a1c43f7a02696ed092318ca&role.id=64ec6989f4724a8ab1e32d37c186c8f8 => generated 608 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:39:21.722900 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1094282-8522-4a40-aa57-904f65d69d10 None admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:21.772528 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c7742f-e8b1-425e-8adf-050193d1b6c9 None None] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:21.812941 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=100 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:39:21.819164 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a2885f-cd0b-4b6f-b5d3-cf6c3cb20ccd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:21.819997 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a2885f-cd0b-4b6f-b5d3-cf6c3cb20ccd None admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:21.820279 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a2885f-cd0b-4b6f-b5d3-cf6c3cb20ccd None admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:21.820554 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a2885f-cd0b-4b6f-b5d3-cf6c3cb20ccd None admin] PATH_INFO: `/v3/domains/default` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:21.822137 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a2885f-cd0b-4b6f-b5d3-cf6c3cb20ccd None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:39:21.824412 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a2885f-cd0b-4b6f-b5d3-cf6c3cb20ccd None admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:39:21.832630 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 134/274] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Jul 14 10:39:21 2022] GET /identity/v3/domains/default => generated 199 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:39:21.834108 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a2885f-cd0b-4b6f-b5d3-cf6c3cb20ccd None admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:21.880959 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1094282-8522-4a40-aa57-904f65d69d10 None admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:21.925122 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93996199-6599-40f4-84e8-39da4069ab97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:21.926299 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93996199-6599-40f4-84e8-39da4069ab97 None admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:21.926781 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93996199-6599-40f4-84e8-39da4069ab97 None admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:21.927254 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93996199-6599-40f4-84e8-39da4069ab97 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:21.942105 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93996199-6599-40f4-84e8-39da4069ab97 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 10:39:21.950675 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application [None req-93996199-6599-40f4-84e8-39da4069ab97 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 14 10:39:21.950675 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:39:21.950675 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:39:21.950675 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:39:21.950675 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:39:21.950675 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:39:21.950675 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:39:21.950675 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:39:21.950675 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:39:21.950675 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:39:21.950675 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:39:21.950675 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:39:21.950675 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 10:39:21.950675 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 10:39:21.950675 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 10:39:21.950675 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 10:39:21.951575 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 10:39:21.951575 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 10:39:21.951575 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 10:39:21.951575 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 10:39:21.951575 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:39:21.951575 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:39:21.951575 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:39:21.951575 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:39:21.951575 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:39:21.951575 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:39:21.951575 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:39:21.951575 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application with Lock( Jul 14 10:39:21.951575 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:39:21.951575 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:39:21.951575 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:39:21.951575 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:39:21.952359 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:39:21.952359 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:39:21.952359 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:39:21.952359 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:39:21.952359 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 10:39:21.952359 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 10:39:21.952359 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 10:39:21.952359 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 10:39:21.952359 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 10:39:21.952359 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 10:39:21.952359 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 14 10:39:21.952359 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application Jul 14 10:39:21.954970 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 141/275] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Jul 14 10:39:21 2022] GET /identity/v3/roles/member => generated 84 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:39:21.963646 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93996199-6599-40f4-84e8-39da4069ab97 None admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:22.027162 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a2885f-cd0b-4b6f-b5d3-cf6c3cb20ccd None admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:22.068306 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=100 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:39:22.081659 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298680d8-503d-4a65-a10d-215cbb6a2078 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:22.082347 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298680d8-503d-4a65-a10d-215cbb6a2078 None admin] REQUEST_METHOD: `POST` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:22.082638 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298680d8-503d-4a65-a10d-215cbb6a2078 None admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:22.083254 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298680d8-503d-4a65-a10d-215cbb6a2078 None admin] PATH_INFO: `/v3/users` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:22.083641 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298680d8-503d-4a65-a10d-215cbb6a2078 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:39:22.085133 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298680d8-503d-4a65-a10d-215cbb6a2078 None admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:39:22.099389 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93996199-6599-40f4-84e8-39da4069ab97 None admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:22.113815 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 135/276] 10.222.0.16 () {60 vars in 1132 bytes} [Thu Jul 14 10:39:21 2022] POST /identity/v3/users => generated 293 bytes in 278 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:39:22.140641 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=100 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:39:22.164150 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ef07c0-5ec7-46be-9eac-64e7688917bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:22.164874 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ef07c0-5ec7-46be-9eac-64e7688917bd None admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:22.165162 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ef07c0-5ec7-46be-9eac-64e7688917bd None admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:22.166133 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ef07c0-5ec7-46be-9eac-64e7688917bd None admin] PATH_INFO: `/v3/roles` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:22.166242 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ef07c0-5ec7-46be-9eac-64e7688917bd None admin] RBAC: Adding query filter params (name=member) {{(pid=86656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:39:22.166502 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ef07c0-5ec7-46be-9eac-64e7688917bd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:39:22.167935 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ef07c0-5ec7-46be-9eac-64e7688917bd None admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:39:22.180024 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 142/277] 10.222.0.16 () {56 vars in 1101 bytes} [Thu Jul 14 10:39:21 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:39:22.185466 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298680d8-503d-4a65-a10d-215cbb6a2078 None admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:22.194170 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5accbd71-2a5c-47e8-95f4-01da0793314a None None] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:22.194478 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5accbd71-2a5c-47e8-95f4-01da0793314a None None] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:22.194728 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5accbd71-2a5c-47e8-95f4-01da0793314a None None] PATH_INFO: `/` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:22.196236 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 143/278] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jul 14 10:39:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 14 10:39:22.201999 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc588c8-92e9-4132-9bc7-2fda0d89939a None None] REQUEST_METHOD: `POST` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:22.202603 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc588c8-92e9-4132-9bc7-2fda0d89939a None None] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:22.203205 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc588c8-92e9-4132-9bc7-2fda0d89939a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:22.222520 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.auth.core [None req-3fc588c8-92e9-4132-9bc7-2fda0d89939a None None] MFA Rules not processed for user `ae4bcdd8106d4bebbdcae96be33505bc`. Rule list: `[]` (Enabled: `True`). {{(pid=86656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:39:22.224063 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-3fc588c8-92e9-4132-9bc7-2fda0d89939a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:39:22.305490 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 144/279] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jul 14 10:39:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 14 10:39:22.309833 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db99c91-4b6f-4379-a67b-64d1ae36d1cb None None] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:22.310127 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db99c91-4b6f-4379-a67b-64d1ae36d1cb None None] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:22.310405 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db99c91-4b6f-4379-a67b-64d1ae36d1cb None None] PATH_INFO: `/` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:22.311726 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 145/280] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jul 14 10:39:22 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:39:22.317343 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298680d8-503d-4a65-a10d-215cbb6a2078 None admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:22.318325 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc3de91-d74a-428a-b62a-d35d98439113 None None] REQUEST_METHOD: `POST` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:22.318613 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc3de91-d74a-428a-b62a-d35d98439113 None None] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:22.319150 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc3de91-d74a-428a-b62a-d35d98439113 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:22.340499 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.auth.core [None req-5cc3de91-d74a-428a-b62a-d35d98439113 None None] MFA Rules not processed for user `ae4bcdd8106d4bebbdcae96be33505bc`. Rule list: `[]` (Enabled: `True`). {{(pid=86656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:39:22.341666 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-5cc3de91-d74a-428a-b62a-d35d98439113 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:39:22.358378 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8907a19f-44a7-4632-af56-dcab6cea7774 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:22.359270 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8907a19f-44a7-4632-af56-dcab6cea7774 None admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:22.359556 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8907a19f-44a7-4632-af56-dcab6cea7774 None admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:22.359832 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8907a19f-44a7-4632-af56-dcab6cea7774 None admin] PATH_INFO: `/v3/users/a63e10341b0743179365c75dc0018702` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:22.377503 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8907a19f-44a7-4632-af56-dcab6cea7774 None admin] RBAC: Authorizing `identity:get_user(user_id=a63e10341b0743179365c75dc0018702)` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:39:22.379000 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8907a19f-44a7-4632-af56-dcab6cea7774 None admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:39:22.380744 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 136/281] 10.222.0.16 () {56 vars in 1177 bytes} [Thu Jul 14 10:39:22 2022] GET /identity/v3/users/a63e10341b0743179365c75dc0018702 => generated 293 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:39:22.381533 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8907a19f-44a7-4632-af56-dcab6cea7774 None admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:22.425937 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 146/282] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jul 14 10:39:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 14 10:39:22.427072 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc3de91-d74a-428a-b62a-d35d98439113 None None] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:22.439016 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:39:22.482633 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=100 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:39:22.513367 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8907a19f-44a7-4632-af56-dcab6cea7774 None admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:22.549797 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc3de91-d74a-428a-b62a-d35d98439113 None None] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:22.556562 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68c5c9b-0fd9-4f35-be57-80ab6804e2f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:22.557618 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68c5c9b-0fd9-4f35-be57-80ab6804e2f8 None admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:22.558081 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68c5c9b-0fd9-4f35-be57-80ab6804e2f8 None admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:22.558489 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68c5c9b-0fd9-4f35-be57-80ab6804e2f8 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:22.573125 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68c5c9b-0fd9-4f35-be57-80ab6804e2f8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 10:39:22.584733 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application [None req-b68c5c9b-0fd9-4f35-be57-80ab6804e2f8 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 14 10:39:22.584733 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:39:22.584733 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:39:22.584733 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:39:22.584733 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:39:22.584733 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:39:22.584733 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:39:22.584733 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:39:22.584733 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:39:22.584733 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:39:22.584733 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:39:22.584733 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:39:22.584733 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 10:39:22.584733 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 10:39:22.584733 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 10:39:22.584733 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 10:39:22.585850 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 10:39:22.585850 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 10:39:22.585850 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 10:39:22.585850 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 10:39:22.585850 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:39:22.585850 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:39:22.585850 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:39:22.585850 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:39:22.585850 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:39:22.585850 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:39:22.585850 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:39:22.585850 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application with Lock( Jul 14 10:39:22.585850 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:39:22.585850 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:39:22.585850 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:39:22.585850 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:39:22.586831 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:39:22.586831 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:39:22.586831 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:39:22.586831 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:39:22.586831 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 10:39:22.586831 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 10:39:22.586831 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 10:39:22.586831 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 10:39:22.586831 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 10:39:22.586831 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 10:39:22.586831 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 14 10:39:22.586831 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application Jul 14 10:39:22.588905 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 137/283] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Jul 14 10:39:22 2022] GET /identity/v3/roles/reader => generated 84 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:39:22.594379 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68c5c9b-0fd9-4f35-be57-80ab6804e2f8 None admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:22.594506 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2713a33f-b6d4-4dfe-b49a-215364801f38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:22.594506 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2713a33f-b6d4-4dfe-b49a-215364801f38 None admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:22.594506 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2713a33f-b6d4-4dfe-b49a-215364801f38 None admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:22.594506 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2713a33f-b6d4-4dfe-b49a-215364801f38 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:22.594804 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2713a33f-b6d4-4dfe-b49a-215364801f38 None admin] RBAC: Adding query filter params (role.id=0da46c267d354cce81495dfdd56c1ec2, user.id=a63e10341b0743179365c75dc0018702, scope.system=all) {{(pid=86656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:39:22.594804 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2713a33f-b6d4-4dfe-b49a-215364801f38 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:39:22.594804 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2713a33f-b6d4-4dfe-b49a-215364801f38 None admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:39:22.602052 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 147/284] 10.222.0.16 () {56 vars in 1308 bytes} [Thu Jul 14 10:39:22 2022] GET /identity/v3/role_assignments?user.id=a63e10341b0743179365c75dc0018702&scope.system=all&role.id=0da46c267d354cce81495dfdd56c1ec2 => generated 226 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:39:22.602883 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2713a33f-b6d4-4dfe-b49a-215364801f38 None admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:22.728468 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2713a33f-b6d4-4dfe-b49a-215364801f38 None admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:22.741205 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=100 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:39:22.771731 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a27d7fb-1c21-43d3-991e-c039546f967a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:22.772409 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a27d7fb-1c21-43d3-991e-c039546f967a None admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:22.772694 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a27d7fb-1c21-43d3-991e-c039546f967a None admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:22.772999 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a27d7fb-1c21-43d3-991e-c039546f967a None admin] PATH_INFO: `/v3/roles` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:22.773766 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a27d7fb-1c21-43d3-991e-c039546f967a None admin] RBAC: Adding query filter params (name=reader) {{(pid=86656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:39:22.774076 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a27d7fb-1c21-43d3-991e-c039546f967a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:39:22.780825 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a27d7fb-1c21-43d3-991e-c039546f967a None admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:39:22.786757 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 148/285] 10.222.0.16 () {56 vars in 1101 bytes} [Thu Jul 14 10:39:22 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:39:22.798063 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a27d7fb-1c21-43d3-991e-c039546f967a None admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:22.829566 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68c5c9b-0fd9-4f35-be57-80ab6804e2f8 None admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:22.841582 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=100 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:39:22.895170 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a313720-4d33-4aa5-899b-c14401fe559f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:22.895970 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a313720-4d33-4aa5-899b-c14401fe559f None admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:22.896251 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a313720-4d33-4aa5-899b-c14401fe559f None admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:22.896522 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a313720-4d33-4aa5-899b-c14401fe559f None admin] PATH_INFO: `/v3/roles/member` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:22.915530 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a313720-4d33-4aa5-899b-c14401fe559f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 10:39:22.923789 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application [None req-2a313720-4d33-4aa5-899b-c14401fe559f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 14 10:39:22.923789 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:39:22.923789 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:39:22.923789 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:39:22.923789 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:39:22.923789 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:39:22.923789 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:39:22.923789 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:39:22.923789 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:39:22.923789 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:39:22.923789 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:39:22.923789 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:39:22.923789 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 10:39:22.923789 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 10:39:22.923789 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 10:39:22.923789 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 10:39:22.924826 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 10:39:22.924826 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 10:39:22.924826 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 10:39:22.924826 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 10:39:22.924826 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:39:22.924826 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:39:22.924826 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:39:22.924826 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:39:22.924826 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:39:22.924826 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:39:22.924826 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:39:22.924826 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application with Lock( Jul 14 10:39:22.924826 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:39:22.924826 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:39:22.924826 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:39:22.924826 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:39:22.925649 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:39:22.925649 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:39:22.925649 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:39:22.925649 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:39:22.925649 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 10:39:22.925649 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 10:39:22.925649 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 10:39:22.925649 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 10:39:22.925649 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 10:39:22.925649 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 10:39:22.925649 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 14 10:39:22.925649 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application Jul 14 10:39:22.925649 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 138/286] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Jul 14 10:39:22 2022] GET /identity/v3/roles/member => generated 84 bytes in 336 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:39:22.930756 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a313720-4d33-4aa5-899b-c14401fe559f None admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:23.000476 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a27d7fb-1c21-43d3-991e-c039546f967a None admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:23.079007 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7e2970-ffe5-497a-9a0f-83550213804e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:23.079906 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7e2970-ffe5-497a-9a0f-83550213804e None admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:23.080985 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7e2970-ffe5-497a-9a0f-83550213804e None admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:23.081277 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7e2970-ffe5-497a-9a0f-83550213804e None admin] PATH_INFO: `/v3/users/3cd90079970b40f5ba0ee0adc97d52b8` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:23.087557 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7e2970-ffe5-497a-9a0f-83550213804e None admin] RBAC: Authorizing `identity:get_user(user_id=3cd90079970b40f5ba0ee0adc97d52b8)` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:39:23.089076 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7e2970-ffe5-497a-9a0f-83550213804e None admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:39:23.090899 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 149/287] 10.222.0.16 () {56 vars in 1177 bytes} [Thu Jul 14 10:39:22 2022] GET /identity/v3/users/3cd90079970b40f5ba0ee0adc97d52b8 => generated 297 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:39:23.097694 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7e2970-ffe5-497a-9a0f-83550213804e None admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:23.146943 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a313720-4d33-4aa5-899b-c14401fe559f None admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:23.156592 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=100 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:39:23.219774 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc320e5-92c3-4d09-93dc-90bce292ac7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:23.220454 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc320e5-92c3-4d09-93dc-90bce292ac7f None admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:23.220840 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc320e5-92c3-4d09-93dc-90bce292ac7f None admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:23.221171 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc320e5-92c3-4d09-93dc-90bce292ac7f None admin] PATH_INFO: `/v3/roles` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:23.221976 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc320e5-92c3-4d09-93dc-90bce292ac7f None admin] RBAC: Adding query filter params (name=member) {{(pid=86655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:39:23.222283 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc320e5-92c3-4d09-93dc-90bce292ac7f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:39:23.223682 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc320e5-92c3-4d09-93dc-90bce292ac7f None admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:39:23.241834 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 139/288] 10.222.0.16 () {56 vars in 1101 bytes} [Thu Jul 14 10:39:22 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 10:39:23.247285 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc320e5-92c3-4d09-93dc-90bce292ac7f None admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:23.269267 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7e2970-ffe5-497a-9a0f-83550213804e None admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:23.279891 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=100 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:39:23.320292 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24bbaaef-b201-4911-ae0f-68487e8e3894 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:23.321220 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bbaaef-b201-4911-ae0f-68487e8e3894 None admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:23.321509 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bbaaef-b201-4911-ae0f-68487e8e3894 None admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:23.321789 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bbaaef-b201-4911-ae0f-68487e8e3894 None admin] PATH_INFO: `/v3/projects/e3cf5b002a1c43f7a02696ed092318ca` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:23.323051 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24bbaaef-b201-4911-ae0f-68487e8e3894 None admin] RBAC: Authorizing `identity:get_project(project_id=e3cf5b002a1c43f7a02696ed092318ca)` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:39:23.324515 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24bbaaef-b201-4911-ae0f-68487e8e3894 None admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:39:23.326283 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 150/289] 10.222.0.16 () {56 vars in 1186 bytes} [Thu Jul 14 10:39:23 2022] GET /identity/v3/projects/e3cf5b002a1c43f7a02696ed092318ca => generated 302 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:39:23.332052 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24bbaaef-b201-4911-ae0f-68487e8e3894 None admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:23.435530 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24bbaaef-b201-4911-ae0f-68487e8e3894 None admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:23.461128 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=100 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:39:23.465938 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc320e5-92c3-4d09-93dc-90bce292ac7f None admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:23.477958 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e0993f-b912-4e04-8078-4c8d6ca45f1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:23.478986 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e0993f-b912-4e04-8078-4c8d6ca45f1c None admin] REQUEST_METHOD: `PUT` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:23.480269 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e0993f-b912-4e04-8078-4c8d6ca45f1c None admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:23.480556 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e0993f-b912-4e04-8078-4c8d6ca45f1c None admin] PATH_INFO: `/v3/projects/e3cf5b002a1c43f7a02696ed092318ca/users/3cd90079970b40f5ba0ee0adc97d52b8/roles/ac28665f2a2446b8a9c98f0de3126d33` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:23.482829 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e0993f-b912-4e04-8078-4c8d6ca45f1c None admin] RBAC: Authorizing `identity:create_grant(project_id=e3cf5b002a1c43f7a02696ed092318ca, user_id=3cd90079970b40f5ba0ee0adc97d52b8, role_id=ac28665f2a2446b8a9c98f0de3126d33)` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:39:23.485520 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e0993f-b912-4e04-8078-4c8d6ca45f1c None admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:39:23.516947 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 151/290] 10.222.0.16 () {58 vars in 1439 bytes} [Thu Jul 14 10:39:23 2022] PUT /identity/v3/projects/e3cf5b002a1c43f7a02696ed092318ca/users/3cd90079970b40f5ba0ee0adc97d52b8/roles/ac28665f2a2446b8a9c98f0de3126d33 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 10:39:23.539230 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678c925f-30d5-452f-9ca3-71d86a1be527 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:23.540045 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678c925f-30d5-452f-9ca3-71d86a1be527 None admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:23.540381 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678c925f-30d5-452f-9ca3-71d86a1be527 None admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:23.540664 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678c925f-30d5-452f-9ca3-71d86a1be527 None admin] PATH_INFO: `/v3/users/0a224a2fe3564a139251a43e0a4768a0` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:23.541920 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678c925f-30d5-452f-9ca3-71d86a1be527 None admin] RBAC: Authorizing `identity:get_user(user_id=0a224a2fe3564a139251a43e0a4768a0)` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:39:23.543394 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678c925f-30d5-452f-9ca3-71d86a1be527 None admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:39:23.546522 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 140/291] 10.222.0.16 () {56 vars in 1177 bytes} [Thu Jul 14 10:39:23 2022] GET /identity/v3/users/0a224a2fe3564a139251a43e0a4768a0 => generated 297 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 10:39:23.551436 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e0993f-b912-4e04-8078-4c8d6ca45f1c None admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:23.672029 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e0993f-b912-4e04-8078-4c8d6ca45f1c None admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:23.710392 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ff2e0f-7c44-47a7-a13c-d0ced3392bc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:23.711068 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ff2e0f-7c44-47a7-a13c-d0ced3392bc9 None admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:23.711356 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ff2e0f-7c44-47a7-a13c-d0ced3392bc9 None admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:23.711634 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ff2e0f-7c44-47a7-a13c-d0ced3392bc9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:23.746771 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:39:23.788830 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ff2e0f-7c44-47a7-a13c-d0ced3392bc9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:39:23.788830 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ff2e0f-7c44-47a7-a13c-d0ced3392bc9 None admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:39:23.893290 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 152/292] 10.222.0.16 () {58 vars in 1282 bytes} [Thu Jul 14 10:39:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 10:39:23.896209 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678c925f-30d5-452f-9ca3-71d86a1be527 None admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:24.029572 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=100 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:39:24.037732 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678c925f-30d5-452f-9ca3-71d86a1be527 None admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:24.083323 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a489e472-44b3-4e31-a3ee-81786c45bfbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:24.084200 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a489e472-44b3-4e31-a3ee-81786c45bfbd None admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:24.084485 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a489e472-44b3-4e31-a3ee-81786c45bfbd None admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:24.084764 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a489e472-44b3-4e31-a3ee-81786c45bfbd None admin] PATH_INFO: `/v3/projects/e3cf5b002a1c43f7a02696ed092318ca` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:24.086005 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a489e472-44b3-4e31-a3ee-81786c45bfbd None admin] RBAC: Authorizing `identity:get_project(project_id=e3cf5b002a1c43f7a02696ed092318ca)` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:39:24.087912 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a489e472-44b3-4e31-a3ee-81786c45bfbd None admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:39:24.089841 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 141/293] 10.222.0.16 () {56 vars in 1186 bytes} [Thu Jul 14 10:39:23 2022] GET /identity/v3/projects/e3cf5b002a1c43f7a02696ed092318ca => generated 302 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:39:24.096660 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ff2e0f-7c44-47a7-a13c-d0ced3392bc9 None admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:24.185927 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=100 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:39:24.223526 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ff2e0f-7c44-47a7-a13c-d0ced3392bc9 None admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:24.258453 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd4a01d-95ff-44e6-8341-98a9d62bbee7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:24.259121 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd4a01d-95ff-44e6-8341-98a9d62bbee7 None admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:24.259407 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd4a01d-95ff-44e6-8341-98a9d62bbee7 None admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:24.259687 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd4a01d-95ff-44e6-8341-98a9d62bbee7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:24.260642 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd4a01d-95ff-44e6-8341-98a9d62bbee7 None admin] RBAC: Adding query filter params (role.id=0da46c267d354cce81495dfdd56c1ec2, scope.project.id=e3cf5b002a1c43f7a02696ed092318ca, user.id=0a224a2fe3564a139251a43e0a4768a0) {{(pid=86656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:39:24.260993 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd4a01d-95ff-44e6-8341-98a9d62bbee7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:39:24.262433 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd4a01d-95ff-44e6-8341-98a9d62bbee7 None admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:39:24.268636 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 153/294] 10.222.0.16 () {56 vars in 1374 bytes} [Thu Jul 14 10:39:24 2022] GET /identity/v3/role_assignments?user.id=0a224a2fe3564a139251a43e0a4768a0&scope.project.id=e3cf5b002a1c43f7a02696ed092318ca&role.id=0da46c267d354cce81495dfdd56c1ec2 => generated 608 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:39:24.674226 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4eb547-1df0-427d-aebe-f970cd5cb82e None None] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:24.674731 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4eb547-1df0-427d-aebe-f970cd5cb82e None None] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:24.674835 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4eb547-1df0-427d-aebe-f970cd5cb82e None None] PATH_INFO: `/` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:24.676418 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 142/295] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jul 14 10:39:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:39:24.683237 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573db5a6-c27e-4160-9032-8949a5782d11 None None] REQUEST_METHOD: `POST` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:24.684160 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573db5a6-c27e-4160-9032-8949a5782d11 None None] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:24.684785 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573db5a6-c27e-4160-9032-8949a5782d11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:24.703216 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.auth.core [None req-573db5a6-c27e-4160-9032-8949a5782d11 None None] MFA Rules not processed for user `ae4bcdd8106d4bebbdcae96be33505bc`. Rule list: `[]` (Enabled: `True`). {{(pid=86656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:39:24.704762 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-573db5a6-c27e-4160-9032-8949a5782d11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:39:24.768708 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18f8761-166c-4001-a3d3-796d7d0c5bf7 None None] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:24.769064 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18f8761-166c-4001-a3d3-796d7d0c5bf7 None None] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:24.769307 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18f8761-166c-4001-a3d3-796d7d0c5bf7 None None] PATH_INFO: `/` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:24.770817 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 143/296] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jul 14 10:39:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 14 10:39:24.775898 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467ccaa5-6e13-4e0d-b6e1-54386957b06c None None] REQUEST_METHOD: `POST` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:24.776457 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467ccaa5-6e13-4e0d-b6e1-54386957b06c None None] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:24.776457 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467ccaa5-6e13-4e0d-b6e1-54386957b06c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:24.792047 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 154/297] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jul 14 10:39:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 14 10:39:24.797608 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.auth.core [None req-467ccaa5-6e13-4e0d-b6e1-54386957b06c None None] MFA Rules not processed for user `ae4bcdd8106d4bebbdcae96be33505bc`. Rule list: `[]` (Enabled: `True`). {{(pid=86655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:39:24.798935 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-467ccaa5-6e13-4e0d-b6e1-54386957b06c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:39:24.822326 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573db5a6-c27e-4160-9032-8949a5782d11 None None] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:24.886849 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 144/298] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jul 14 10:39:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 10:39:24.902294 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=100 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:39:24.914945 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467ccaa5-6e13-4e0d-b6e1-54386957b06c None None] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:24.952547 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573db5a6-c27e-4160-9032-8949a5782d11 None None] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:24.994703 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a3c060-f33f-482a-a67b-a2eb358f9942 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:24.995876 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a3c060-f33f-482a-a67b-a2eb358f9942 None admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:24.996472 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a3c060-f33f-482a-a67b-a2eb358f9942 None admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:24.997106 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a3c060-f33f-482a-a67b-a2eb358f9942 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:25.009497 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a3c060-f33f-482a-a67b-a2eb358f9942 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 10:39:25.018836 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application [None req-96a3c060-f33f-482a-a67b-a2eb358f9942 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 14 10:39:25.018836 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:39:25.018836 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:39:25.018836 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:39:25.018836 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:39:25.018836 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:39:25.018836 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:39:25.018836 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:39:25.018836 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:39:25.018836 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:39:25.018836 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:39:25.018836 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:39:25.018836 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 10:39:25.018836 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 10:39:25.018836 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 10:39:25.018836 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 10:39:25.019719 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 10:39:25.019719 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 10:39:25.019719 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 10:39:25.019719 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 10:39:25.019719 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:39:25.019719 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:39:25.019719 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:39:25.019719 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:39:25.019719 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:39:25.019719 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:39:25.019719 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:39:25.019719 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application with Lock( Jul 14 10:39:25.019719 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:39:25.019719 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:39:25.019719 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:39:25.019719 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:39:25.020523 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:39:25.020523 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:39:25.020523 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:39:25.020523 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:39:25.020523 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 10:39:25.020523 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 10:39:25.020523 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 10:39:25.020523 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 10:39:25.020523 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 10:39:25.020523 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 10:39:25.020523 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 14 10:39:25.020523 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application Jul 14 10:39:25.022305 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=100 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:39:25.024498 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 155/299] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Jul 14 10:39:24 2022] GET /identity/v3/roles/reader => generated 84 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 10:39:25.030843 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a3c060-f33f-482a-a67b-a2eb358f9942 None admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:25.035586 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467ccaa5-6e13-4e0d-b6e1-54386957b06c None None] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:25.073758 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f1923a-05bf-41f4-87f4-16615d41c8d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:25.074894 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f1923a-05bf-41f4-87f4-16615d41c8d2 None admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:25.075422 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f1923a-05bf-41f4-87f4-16615d41c8d2 None admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:25.075987 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f1923a-05bf-41f4-87f4-16615d41c8d2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:25.077400 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f1923a-05bf-41f4-87f4-16615d41c8d2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:39:25.078978 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f1923a-05bf-41f4-87f4-16615d41c8d2 None admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:39:25.085859 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 145/300] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Jul 14 10:39:24 2022] GET /identity/v3/domains/default => generated 199 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 10:39:25.087291 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0b9f8a-58f5-4081-9d4a-429f34b1c4c6 None None] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:25.087722 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0b9f8a-58f5-4081-9d4a-429f34b1c4c6 None None] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:25.088160 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0b9f8a-58f5-4081-9d4a-429f34b1c4c6 None None] PATH_INFO: `/` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:25.089556 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 146/301] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jul 14 10:39:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:39:25.093645 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0b9f8a-58f5-4081-9d4a-429f34b1c4c6 None None] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:25.145326 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a3c060-f33f-482a-a67b-a2eb358f9942 None admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:25.165894 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=100 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:39:25.181416 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc33844-4fcf-4d64-9e07-16ce6702ca1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:25.182084 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc33844-4fcf-4d64-9e07-16ce6702ca1e None admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:25.182367 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc33844-4fcf-4d64-9e07-16ce6702ca1e None admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:25.182644 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc33844-4fcf-4d64-9e07-16ce6702ca1e None admin] PATH_INFO: `/v3/roles` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:25.183394 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc33844-4fcf-4d64-9e07-16ce6702ca1e None admin] RBAC: Adding query filter params (name=reader) {{(pid=86656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:39:25.183700 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc33844-4fcf-4d64-9e07-16ce6702ca1e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:39:25.185095 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc33844-4fcf-4d64-9e07-16ce6702ca1e None admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:39:25.194743 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 156/302] 10.222.0.16 () {56 vars in 1101 bytes} [Thu Jul 14 10:39:25 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 10:39:25.196310 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baaed66c-0981-42ac-bf7b-35a9cd2d5062 None None] REQUEST_METHOD: `POST` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:25.196611 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baaed66c-0981-42ac-bf7b-35a9cd2d5062 None None] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:25.196925 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baaed66c-0981-42ac-bf7b-35a9cd2d5062 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:25.202862 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0b9f8a-58f5-4081-9d4a-429f34b1c4c6 None None] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:25.214176 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.auth.core [None req-baaed66c-0981-42ac-bf7b-35a9cd2d5062 None None] MFA Rules not processed for user `ae4bcdd8106d4bebbdcae96be33505bc`. Rule list: `[]` (Enabled: `True`). {{(pid=86656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:39:25.215372 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-baaed66c-0981-42ac-bf7b-35a9cd2d5062 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:39:25.240579 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8164d122-e2b9-47dd-8709-294ad7040e20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:25.241274 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8164d122-e2b9-47dd-8709-294ad7040e20 None admin] REQUEST_METHOD: `POST` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:25.241702 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8164d122-e2b9-47dd-8709-294ad7040e20 None admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:25.241978 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8164d122-e2b9-47dd-8709-294ad7040e20 None admin] PATH_INFO: `/v3/groups` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:25.242835 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8164d122-e2b9-47dd-8709-294ad7040e20 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:39:25.244389 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8164d122-e2b9-47dd-8709-294ad7040e20 None admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:39:25.259944 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 147/303] 10.222.0.16 () {60 vars in 1134 bytes} [Thu Jul 14 10:39:25 2022] POST /identity/v3/groups => generated 229 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:39:25.260947 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8164d122-e2b9-47dd-8709-294ad7040e20 None admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:25.298033 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:39:25.299774 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 157/304] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jul 14 10:39:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 10:39:25.323850 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baaed66c-0981-42ac-bf7b-35a9cd2d5062 None None] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:25.414861 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8164d122-e2b9-47dd-8709-294ad7040e20 None admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:25.447194 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baaed66c-0981-42ac-bf7b-35a9cd2d5062 None None] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:25.459697 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c39328-e3dc-4d71-a622-8401eccabc9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:25.460520 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c39328-e3dc-4d71-a622-8401eccabc9e None admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:25.460837 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c39328-e3dc-4d71-a622-8401eccabc9e None admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:25.461121 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c39328-e3dc-4d71-a622-8401eccabc9e None admin] PATH_INFO: `/v3/users/e285915ce58c4d5bb995dceb9678d29c` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:25.463430 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=100 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:39:25.478651 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c39328-e3dc-4d71-a622-8401eccabc9e None admin] RBAC: Authorizing `identity:get_user(user_id=e285915ce58c4d5bb995dceb9678d29c)` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:39:25.480551 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c39328-e3dc-4d71-a622-8401eccabc9e None admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:39:25.487949 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 148/305] 10.222.0.16 () {56 vars in 1177 bytes} [Thu Jul 14 10:39:25 2022] GET /identity/v3/users/e285915ce58c4d5bb995dceb9678d29c => generated 293 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:39:25.489185 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c39328-e3dc-4d71-a622-8401eccabc9e None admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:25.497692 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d229f2-3c17-4444-a1d9-66d92aaf418a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:25.498507 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d229f2-3c17-4444-a1d9-66d92aaf418a None admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:25.498832 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d229f2-3c17-4444-a1d9-66d92aaf418a None admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:25.499117 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d229f2-3c17-4444-a1d9-66d92aaf418a None admin] PATH_INFO: `/v3/roles/member` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:25.513067 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d229f2-3c17-4444-a1d9-66d92aaf418a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 10:39:25.521546 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application [None req-69d229f2-3c17-4444-a1d9-66d92aaf418a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 14 10:39:25.521546 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:39:25.521546 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:39:25.521546 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:39:25.521546 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:39:25.521546 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:39:25.521546 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:39:25.521546 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:39:25.521546 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:39:25.521546 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:39:25.521546 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:39:25.521546 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:39:25.521546 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 10:39:25.521546 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 10:39:25.521546 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 10:39:25.521546 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 10:39:25.522701 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 10:39:25.522701 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 10:39:25.522701 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 10:39:25.522701 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 10:39:25.522701 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:39:25.522701 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:39:25.522701 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:39:25.522701 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:39:25.522701 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:39:25.522701 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:39:25.522701 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:39:25.522701 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application with Lock( Jul 14 10:39:25.522701 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:39:25.522701 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:39:25.522701 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:39:25.522701 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:39:25.523482 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:39:25.523482 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:39:25.523482 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:39:25.523482 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:39:25.523482 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 10:39:25.523482 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 10:39:25.523482 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 10:39:25.523482 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 10:39:25.523482 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 10:39:25.523482 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 10:39:25.523482 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 14 10:39:25.523482 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application Jul 14 10:39:25.523482 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 158/306] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Jul 14 10:39:25 2022] GET /identity/v3/roles/member => generated 84 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 10:39:25.528530 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d229f2-3c17-4444-a1d9-66d92aaf418a None admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:25.587787 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=100 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:39:25.615609 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c39328-e3dc-4d71-a622-8401eccabc9e None admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:25.656106 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf4f6b2-e10f-43cb-a0ba-cee78ca0a405 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:25.657015 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf4f6b2-e10f-43cb-a0ba-cee78ca0a405 None admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:25.657309 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf4f6b2-e10f-43cb-a0ba-cee78ca0a405 None admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:25.657592 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf4f6b2-e10f-43cb-a0ba-cee78ca0a405 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:25.658972 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf4f6b2-e10f-43cb-a0ba-cee78ca0a405 None admin] RBAC: Adding query filter params (role.id=ac28665f2a2446b8a9c98f0de3126d33, user.id=e285915ce58c4d5bb995dceb9678d29c, scope.system=all) {{(pid=86655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:39:25.659630 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf4f6b2-e10f-43cb-a0ba-cee78ca0a405 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:39:25.661814 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf4f6b2-e10f-43cb-a0ba-cee78ca0a405 None admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:39:25.669560 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 149/307] 10.222.0.16 () {56 vars in 1308 bytes} [Thu Jul 14 10:39:25 2022] GET /identity/v3/role_assignments?user.id=e285915ce58c4d5bb995dceb9678d29c&scope.system=all&role.id=ac28665f2a2446b8a9c98f0de3126d33 => generated 226 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 10:39:25.669966 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d229f2-3c17-4444-a1d9-66d92aaf418a None admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:25.714743 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f455b6a8-e89d-427b-927f-802a787d6ec6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:25.716266 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f455b6a8-e89d-427b-927f-802a787d6ec6 None admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:25.716810 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f455b6a8-e89d-427b-927f-802a787d6ec6 None admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:25.717291 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f455b6a8-e89d-427b-927f-802a787d6ec6 None admin] PATH_INFO: `/v3/roles` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:25.718307 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f455b6a8-e89d-427b-927f-802a787d6ec6 None admin] RBAC: Adding query filter params (name=member) {{(pid=86656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:39:25.718834 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f455b6a8-e89d-427b-927f-802a787d6ec6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:39:25.721130 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f455b6a8-e89d-427b-927f-802a787d6ec6 None admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:39:25.736527 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 159/308] 10.222.0.16 () {56 vars in 1101 bytes} [Thu Jul 14 10:39:25 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 10:39:25.738321 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf4f6b2-e10f-43cb-a0ba-cee78ca0a405 None admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:25.859935 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf4f6b2-e10f-43cb-a0ba-cee78ca0a405 None admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:25.876425 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a4ff3a-9860-4909-b160-edec1cb1e42b None None] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:25.877327 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a4ff3a-9860-4909-b160-edec1cb1e42b None None] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:25.877545 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a4ff3a-9860-4909-b160-edec1cb1e42b None None] PATH_INFO: `/` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:25.880154 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 160/309] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jul 14 10:39:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 14 10:39:25.884183 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f766e8b-3791-4424-b2ce-6d2482838249 None None] REQUEST_METHOD: `POST` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:25.884472 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f766e8b-3791-4424-b2ce-6d2482838249 None None] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:25.884788 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f766e8b-3791-4424-b2ce-6d2482838249 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:25.899111 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3db43dc-b201-4a45-aeb5-068178d52e42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:25.899994 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3db43dc-b201-4a45-aeb5-068178d52e42 None admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:25.900281 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3db43dc-b201-4a45-aeb5-068178d52e42 None admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:25.900561 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3db43dc-b201-4a45-aeb5-068178d52e42 None admin] PATH_INFO: `/v3/users/a63e10341b0743179365c75dc0018702` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:25.901794 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3db43dc-b201-4a45-aeb5-068178d52e42 None admin] RBAC: Authorizing `identity:get_user(user_id=a63e10341b0743179365c75dc0018702)` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:39:25.903251 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3db43dc-b201-4a45-aeb5-068178d52e42 None admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:39:25.904808 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.auth.core [None req-3f766e8b-3791-4424-b2ce-6d2482838249 None None] MFA Rules not processed for user `ae4bcdd8106d4bebbdcae96be33505bc`. Rule list: `[]` (Enabled: `True`). {{(pid=86656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:39:25.905211 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 150/310] 10.222.0.16 () {56 vars in 1177 bytes} [Thu Jul 14 10:39:25 2022] GET /identity/v3/users/a63e10341b0743179365c75dc0018702 => generated 293 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:39:25.909941 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-3f766e8b-3791-4424-b2ce-6d2482838249 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:39:25.911472 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3db43dc-b201-4a45-aeb5-068178d52e42 None admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:25.928247 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=100 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:39:25.947701 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=100 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:39:26.002743 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 161/311] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jul 14 10:39:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 14 10:39:26.026725 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f766e8b-3791-4424-b2ce-6d2482838249 None None] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:26.039567 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3db43dc-b201-4a45-aeb5-068178d52e42 None admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:26.078073 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cb5023-79c0-4834-a818-69fb6f1c315b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:26.079283 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cb5023-79c0-4834-a818-69fb6f1c315b None admin] REQUEST_METHOD: `PUT` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:26.079730 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cb5023-79c0-4834-a818-69fb6f1c315b None admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:26.080875 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cb5023-79c0-4834-a818-69fb6f1c315b None admin] PATH_INFO: `/v3/system/users/a63e10341b0743179365c75dc0018702/roles/0da46c267d354cce81495dfdd56c1ec2` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:26.082697 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3cb5023-79c0-4834-a818-69fb6f1c315b None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=a63e10341b0743179365c75dc0018702, role_id=0da46c267d354cce81495dfdd56c1ec2)` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:39:26.084239 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3cb5023-79c0-4834-a818-69fb6f1c315b None admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:39:26.096461 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 151/312] 10.222.0.16 () {58 vars in 1334 bytes} [Thu Jul 14 10:39:25 2022] PUT /identity/v3/system/users/a63e10341b0743179365c75dc0018702/roles/0da46c267d354cce81495dfdd56c1ec2 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 10:39:26.148272 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f766e8b-3791-4424-b2ce-6d2482838249 None None] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:26.194618 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a459d71-a4cc-4cfe-adda-f9c05655ad2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:26.195846 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a459d71-a4cc-4cfe-adda-f9c05655ad2c None admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:26.196353 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a459d71-a4cc-4cfe-adda-f9c05655ad2c None admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:26.196858 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a459d71-a4cc-4cfe-adda-f9c05655ad2c None admin] PATH_INFO: `/v3/roles/reader` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:26.209474 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a459d71-a4cc-4cfe-adda-f9c05655ad2c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 10:39:26.218024 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application [None req-3a459d71-a4cc-4cfe-adda-f9c05655ad2c None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 14 10:39:26.218024 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:39:26.218024 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:39:26.218024 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:39:26.218024 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:39:26.218024 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:39:26.218024 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:39:26.218024 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:39:26.218024 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:39:26.218024 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:39:26.218024 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:39:26.218024 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:39:26.218024 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 10:39:26.218024 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 10:39:26.218024 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 10:39:26.218024 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 10:39:26.218981 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 10:39:26.218981 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 10:39:26.218981 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 10:39:26.218981 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 10:39:26.218981 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:39:26.218981 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:39:26.218981 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:39:26.218981 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:39:26.218981 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:39:26.218981 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:39:26.218981 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:39:26.218981 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application with Lock( Jul 14 10:39:26.218981 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:39:26.218981 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:39:26.218981 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:39:26.218981 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:39:26.219762 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:39:26.219762 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:39:26.219762 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:39:26.219762 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:39:26.219762 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 10:39:26.219762 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 10:39:26.219762 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 10:39:26.219762 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 10:39:26.219762 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 10:39:26.219762 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 10:39:26.219762 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 14 10:39:26.219762 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application Jul 14 10:39:26.222671 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 162/313] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Jul 14 10:39:26 2022] GET /identity/v3/roles/reader => generated 84 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 10:39:26.232816 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cb5023-79c0-4834-a818-69fb6f1c315b None admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:26.311103 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:39:26.339704 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cb5023-79c0-4834-a818-69fb6f1c315b None admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:26.389809 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc9e23f-5255-4ad3-a13e-5ad15e14e813 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:26.391184 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc9e23f-5255-4ad3-a13e-5ad15e14e813 None admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:26.391813 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc9e23f-5255-4ad3-a13e-5ad15e14e813 None admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:26.393076 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc9e23f-5255-4ad3-a13e-5ad15e14e813 None admin] PATH_INFO: `/v3/roles` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:26.394485 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc9e23f-5255-4ad3-a13e-5ad15e14e813 None admin] RBAC: Adding query filter params (name=reader) {{(pid=86655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:39:26.395199 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc9e23f-5255-4ad3-a13e-5ad15e14e813 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:39:26.397179 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc9e23f-5255-4ad3-a13e-5ad15e14e813 None admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:39:26.411107 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 152/314] 10.222.0.16 () {56 vars in 1101 bytes} [Thu Jul 14 10:39:26 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:39:26.419135 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a459d71-a4cc-4cfe-adda-f9c05655ad2c None admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:26.448018 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=100 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:39:26.531259 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a459d71-a4cc-4cfe-adda-f9c05655ad2c None admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:26.567956 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ccf6780-226f-409b-88b6-e24de8c4487a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:26.569197 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccf6780-226f-409b-88b6-e24de8c4487a None admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:26.569682 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccf6780-226f-409b-88b6-e24de8c4487a None admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:26.570171 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccf6780-226f-409b-88b6-e24de8c4487a None admin] PATH_INFO: `/v3/users/3cd90079970b40f5ba0ee0adc97d52b8` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:26.571582 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ccf6780-226f-409b-88b6-e24de8c4487a None admin] RBAC: Authorizing `identity:get_user(user_id=3cd90079970b40f5ba0ee0adc97d52b8)` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:39:26.573253 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ccf6780-226f-409b-88b6-e24de8c4487a None admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:39:26.575113 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 163/315] 10.222.0.16 () {56 vars in 1177 bytes} [Thu Jul 14 10:39:26 2022] GET /identity/v3/users/3cd90079970b40f5ba0ee0adc97d52b8 => generated 297 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:39:26.586034 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc9e23f-5255-4ad3-a13e-5ad15e14e813 None admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:26.699554 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc9e23f-5255-4ad3-a13e-5ad15e14e813 None admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:26.734601 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2daa1014-484f-48a9-8c05-d17e2bcc2187 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:26.735260 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2daa1014-484f-48a9-8c05-d17e2bcc2187 None admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:26.735547 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2daa1014-484f-48a9-8c05-d17e2bcc2187 None admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:26.735828 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2daa1014-484f-48a9-8c05-d17e2bcc2187 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:26.741108 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=100 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:39:26.832588 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2daa1014-484f-48a9-8c05-d17e2bcc2187 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:39:26.833999 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2daa1014-484f-48a9-8c05-d17e2bcc2187 None admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:39:26.938075 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 153/316] 10.222.0.16 () {58 vars in 1282 bytes} [Thu Jul 14 10:39:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 10:39:26.945816 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ccf6780-226f-409b-88b6-e24de8c4487a None admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:27.069158 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=100 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:39:27.071556 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ccf6780-226f-409b-88b6-e24de8c4487a None admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:27.106890 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59320b58-0d81-4518-8354-b1572c590cd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:27.107682 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59320b58-0d81-4518-8354-b1572c590cd3 None admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:27.107975 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59320b58-0d81-4518-8354-b1572c590cd3 None admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:27.108254 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59320b58-0d81-4518-8354-b1572c590cd3 None admin] PATH_INFO: `/v3/projects/e3cf5b002a1c43f7a02696ed092318ca` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:27.109488 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59320b58-0d81-4518-8354-b1572c590cd3 None admin] RBAC: Authorizing `identity:get_project(project_id=e3cf5b002a1c43f7a02696ed092318ca)` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:39:27.111133 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59320b58-0d81-4518-8354-b1572c590cd3 None admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:39:27.113189 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 164/317] 10.222.0.16 () {56 vars in 1186 bytes} [Thu Jul 14 10:39:26 2022] GET /identity/v3/projects/e3cf5b002a1c43f7a02696ed092318ca => generated 302 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:39:27.118799 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2daa1014-484f-48a9-8c05-d17e2bcc2187 None admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:27.155195 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=100 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:39:27.225307 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2daa1014-484f-48a9-8c05-d17e2bcc2187 None admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:27.262279 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d42353-4c5a-4e21-bb4d-3be290836df8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:27.262945 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d42353-4c5a-4e21-bb4d-3be290836df8 None admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:27.263227 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d42353-4c5a-4e21-bb4d-3be290836df8 None admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:27.263504 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d42353-4c5a-4e21-bb4d-3be290836df8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:27.264386 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d42353-4c5a-4e21-bb4d-3be290836df8 None admin] RBAC: Adding query filter params (role.id=ac28665f2a2446b8a9c98f0de3126d33, scope.project.id=e3cf5b002a1c43f7a02696ed092318ca, user.id=3cd90079970b40f5ba0ee0adc97d52b8) {{(pid=86655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:39:27.264698 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d42353-4c5a-4e21-bb4d-3be290836df8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:39:27.266186 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d42353-4c5a-4e21-bb4d-3be290836df8 None admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:39:27.272949 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 154/318] 10.222.0.16 () {56 vars in 1374 bytes} [Thu Jul 14 10:39:27 2022] GET /identity/v3/role_assignments?user.id=3cd90079970b40f5ba0ee0adc97d52b8&scope.project.id=e3cf5b002a1c43f7a02696ed092318ca&role.id=ac28665f2a2446b8a9c98f0de3126d33 => generated 608 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:39:27.538093 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e5659d-f5c7-49a8-ab64-23b39fd89086 None None] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:27.538431 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e5659d-f5c7-49a8-ab64-23b39fd89086 None None] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:27.538610 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e5659d-f5c7-49a8-ab64-23b39fd89086 None None] PATH_INFO: `/` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:27.540089 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 165/319] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jul 14 10:39:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:39:27.545056 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382206ff-13d6-4037-9597-ad564ea414e7 None None] REQUEST_METHOD: `POST` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:27.545346 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382206ff-13d6-4037-9597-ad564ea414e7 None None] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:27.545622 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382206ff-13d6-4037-9597-ad564ea414e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:27.563244 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.auth.core [None req-382206ff-13d6-4037-9597-ad564ea414e7 None None] MFA Rules not processed for user `ae4bcdd8106d4bebbdcae96be33505bc`. Rule list: `[]` (Enabled: `True`). {{(pid=86655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:39:27.564996 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-382206ff-13d6-4037-9597-ad564ea414e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:39:27.632223 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 155/320] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jul 14 10:39:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 10:39:27.654302 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e5659d-f5c7-49a8-ab64-23b39fd89086 None None] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:27.755294 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e5659d-f5c7-49a8-ab64-23b39fd89086 None None] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:27.786309 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e83cde-866f-4b6f-aaeb-737eb6770cb7 None None] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:27.786781 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e83cde-866f-4b6f-aaeb-737eb6770cb7 None None] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:27.786887 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e83cde-866f-4b6f-aaeb-737eb6770cb7 None None] PATH_INFO: `/` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:27.788419 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 156/321] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jul 14 10:39:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:39:27.792843 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c4a6c2-ee53-46cd-aac5-6c6deb9a7e23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:27.793154 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb070c7-1b50-44e2-ac17-a8bd382f1490 None None] REQUEST_METHOD: `POST` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:27.793449 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb070c7-1b50-44e2-ac17-a8bd382f1490 None None] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:27.793658 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c4a6c2-ee53-46cd-aac5-6c6deb9a7e23 None admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:27.793753 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb070c7-1b50-44e2-ac17-a8bd382f1490 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:27.793913 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c4a6c2-ee53-46cd-aac5-6c6deb9a7e23 None admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:27.794193 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c4a6c2-ee53-46cd-aac5-6c6deb9a7e23 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:27.797660 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c4a6c2-ee53-46cd-aac5-6c6deb9a7e23 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:39:27.799149 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c4a6c2-ee53-46cd-aac5-6c6deb9a7e23 None admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:39:27.800974 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 166/322] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Jul 14 10:39:27 2022] GET /identity/v3/domains/default => generated 199 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:39:27.806025 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c4a6c2-ee53-46cd-aac5-6c6deb9a7e23 None admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:27.818900 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.auth.core [None req-aeb070c7-1b50-44e2-ac17-a8bd382f1490 None None] MFA Rules not processed for user `ae4bcdd8106d4bebbdcae96be33505bc`. Rule list: `[]` (Enabled: `True`). {{(pid=86655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:39:27.820106 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-aeb070c7-1b50-44e2-ac17-a8bd382f1490 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:39:27.839501 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=100 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:39:27.851715 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=100 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:39:27.900504 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 157/323] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jul 14 10:39:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 14 10:39:27.916803 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c4a6c2-ee53-46cd-aac5-6c6deb9a7e23 None admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:27.922906 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb070c7-1b50-44e2-ac17-a8bd382f1490 None None] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:27.954761 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71e00b8-afbd-4e4b-9e16-bdbef0b04b22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:27.956410 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71e00b8-afbd-4e4b-9e16-bdbef0b04b22 None admin] REQUEST_METHOD: `POST` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:27.956410 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71e00b8-afbd-4e4b-9e16-bdbef0b04b22 None admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:27.956745 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71e00b8-afbd-4e4b-9e16-bdbef0b04b22 None admin] PATH_INFO: `/v3/groups` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:27.957378 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71e00b8-afbd-4e4b-9e16-bdbef0b04b22 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:39:27.958836 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71e00b8-afbd-4e4b-9e16-bdbef0b04b22 None admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:39:27.981009 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 167/324] 10.222.0.16 () {60 vars in 1134 bytes} [Thu Jul 14 10:39:27 2022] POST /identity/v3/groups => generated 226 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 10:39:28.039719 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb070c7-1b50-44e2-ac17-a8bd382f1490 None None] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:28.081634 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfffe9cd-fa5f-45e5-9f9e-cb9fadbe62d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:28.082461 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfffe9cd-fa5f-45e5-9f9e-cb9fadbe62d3 None admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:28.082750 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfffe9cd-fa5f-45e5-9f9e-cb9fadbe62d3 None admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:28.083028 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfffe9cd-fa5f-45e5-9f9e-cb9fadbe62d3 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:28.094750 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfffe9cd-fa5f-45e5-9f9e-cb9fadbe62d3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 10:39:28.103201 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application [None req-bfffe9cd-fa5f-45e5-9f9e-cb9fadbe62d3 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 14 10:39:28.103201 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:39:28.103201 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:39:28.103201 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:39:28.103201 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:39:28.103201 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:39:28.103201 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:39:28.103201 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:39:28.103201 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:39:28.103201 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:39:28.103201 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:39:28.103201 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:39:28.103201 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 10:39:28.103201 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 10:39:28.103201 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 10:39:28.103201 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 10:39:28.104138 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 10:39:28.104138 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 10:39:28.104138 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 10:39:28.104138 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 10:39:28.104138 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:39:28.104138 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:39:28.104138 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:39:28.104138 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:39:28.104138 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:39:28.104138 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:39:28.104138 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:39:28.104138 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application with Lock( Jul 14 10:39:28.104138 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:39:28.104138 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:39:28.104138 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:39:28.104138 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:39:28.105355 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:39:28.105355 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:39:28.105355 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:39:28.105355 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:39:28.105355 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 10:39:28.105355 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 10:39:28.105355 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 10:39:28.105355 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 10:39:28.105355 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 10:39:28.105355 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 10:39:28.105355 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 14 10:39:28.105355 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application Jul 14 10:39:28.109151 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 158/325] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Jul 14 10:39:27 2022] GET /identity/v3/roles/reader => generated 84 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 10:39:28.110579 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71e00b8-afbd-4e4b-9e16-bdbef0b04b22 None admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:28.214112 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:39:28.228424 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71e00b8-afbd-4e4b-9e16-bdbef0b04b22 None admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:28.268297 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c0e1a8-d60e-4e0e-9151-e1a42cd38344 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:28.269011 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c0e1a8-d60e-4e0e-9151-e1a42cd38344 None admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:28.269309 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c0e1a8-d60e-4e0e-9151-e1a42cd38344 None admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:28.269590 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c0e1a8-d60e-4e0e-9151-e1a42cd38344 None admin] PATH_INFO: `/v3/roles` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:28.270364 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c0e1a8-d60e-4e0e-9151-e1a42cd38344 None admin] RBAC: Adding query filter params (name=reader) {{(pid=86656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:39:28.270678 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c0e1a8-d60e-4e0e-9151-e1a42cd38344 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:39:28.272080 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c0e1a8-d60e-4e0e-9151-e1a42cd38344 None admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:39:28.282382 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 168/326] 10.222.0.16 () {56 vars in 1101 bytes} [Thu Jul 14 10:39:28 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 10:39:28.288927 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfffe9cd-fa5f-45e5-9f9e-cb9fadbe62d3 None admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:28.313353 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=100 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:39:28.402861 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfffe9cd-fa5f-45e5-9f9e-cb9fadbe62d3 None admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:28.430649 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e9206a-bca9-4a2c-99dc-f7b65ac9760c None None] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:28.431424 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e9206a-bca9-4a2c-99dc-f7b65ac9760c None None] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:28.431424 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e9206a-bca9-4a2c-99dc-f7b65ac9760c None None] PATH_INFO: `/` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:28.432651 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 169/327] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jul 14 10:39:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 14 10:39:28.441274 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce78c1a9-d1a6-426b-a6ec-512d70f62635 None None] REQUEST_METHOD: `POST` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:28.441566 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce78c1a9-d1a6-426b-a6ec-512d70f62635 None None] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:28.441851 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce78c1a9-d1a6-426b-a6ec-512d70f62635 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:28.450921 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45dac40c-e51b-4d9b-87f2-b3a8e07fb09f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:28.451830 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45dac40c-e51b-4d9b-87f2-b3a8e07fb09f None admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:28.452122 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45dac40c-e51b-4d9b-87f2-b3a8e07fb09f None admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:28.452403 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45dac40c-e51b-4d9b-87f2-b3a8e07fb09f None admin] PATH_INFO: `/v3/users/e285915ce58c4d5bb995dceb9678d29c` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:28.453694 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45dac40c-e51b-4d9b-87f2-b3a8e07fb09f None admin] RBAC: Authorizing `identity:get_user(user_id=e285915ce58c4d5bb995dceb9678d29c)` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:39:28.457292 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45dac40c-e51b-4d9b-87f2-b3a8e07fb09f None admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:39:28.460470 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 159/328] 10.222.0.16 () {56 vars in 1177 bytes} [Thu Jul 14 10:39:28 2022] GET /identity/v3/users/e285915ce58c4d5bb995dceb9678d29c => generated 293 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:39:28.468255 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45dac40c-e51b-4d9b-87f2-b3a8e07fb09f None admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:28.471217 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.auth.core [None req-ce78c1a9-d1a6-426b-a6ec-512d70f62635 None None] MFA Rules not processed for user `ae4bcdd8106d4bebbdcae96be33505bc`. Rule list: `[]` (Enabled: `True`). {{(pid=86656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:39:28.472995 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-ce78c1a9-d1a6-426b-a6ec-512d70f62635 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:39:28.564875 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 170/329] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jul 14 10:39:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 14 10:39:28.585654 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce78c1a9-d1a6-426b-a6ec-512d70f62635 None None] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:28.603626 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=100 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:39:28.619415 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45dac40c-e51b-4d9b-87f2-b3a8e07fb09f None admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:28.680243 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb0c26b-c6f3-4014-8fbc-264a8b5aaa41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:28.681450 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb0c26b-c6f3-4014-8fbc-264a8b5aaa41 None admin] REQUEST_METHOD: `PUT` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:28.681739 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb0c26b-c6f3-4014-8fbc-264a8b5aaa41 None admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:28.682019 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb0c26b-c6f3-4014-8fbc-264a8b5aaa41 None admin] PATH_INFO: `/v3/system/users/e285915ce58c4d5bb995dceb9678d29c/roles/ac28665f2a2446b8a9c98f0de3126d33` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:28.683590 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb0c26b-c6f3-4014-8fbc-264a8b5aaa41 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=e285915ce58c4d5bb995dceb9678d29c, role_id=ac28665f2a2446b8a9c98f0de3126d33)` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:39:28.686288 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb0c26b-c6f3-4014-8fbc-264a8b5aaa41 None admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:39:28.697320 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 160/330] 10.222.0.16 () {58 vars in 1334 bytes} [Thu Jul 14 10:39:28 2022] PUT /identity/v3/system/users/e285915ce58c4d5bb995dceb9678d29c/roles/ac28665f2a2446b8a9c98f0de3126d33 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 10:39:28.706310 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=100 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:39:28.731664 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce78c1a9-d1a6-426b-a6ec-512d70f62635 None None] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:28.771515 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1248ad-898e-439e-90a1-d88071b7a0ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:28.772329 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1248ad-898e-439e-90a1-d88071b7a0ef None admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:28.772615 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1248ad-898e-439e-90a1-d88071b7a0ef None admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:28.772926 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1248ad-898e-439e-90a1-d88071b7a0ef None admin] PATH_INFO: `/v3/roles/member` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:28.786695 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1248ad-898e-439e-90a1-d88071b7a0ef None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 10:39:28.795709 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application [None req-cf1248ad-898e-439e-90a1-d88071b7a0ef None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 14 10:39:28.795709 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:39:28.795709 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:39:28.795709 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:39:28.795709 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:39:28.795709 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:39:28.795709 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:39:28.795709 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:39:28.795709 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:39:28.795709 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:39:28.795709 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:39:28.795709 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:39:28.795709 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 10:39:28.795709 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 10:39:28.795709 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 10:39:28.795709 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 10:39:28.797114 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 10:39:28.797114 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 10:39:28.797114 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 10:39:28.797114 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 10:39:28.797114 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:39:28.797114 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:39:28.797114 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:39:28.797114 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:39:28.797114 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:39:28.797114 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:39:28.797114 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:39:28.797114 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application with Lock( Jul 14 10:39:28.797114 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:39:28.797114 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:39:28.797114 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:39:28.797114 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:39:28.798304 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:39:28.798304 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:39:28.798304 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:39:28.798304 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:39:28.798304 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 10:39:28.798304 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 10:39:28.798304 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 10:39:28.798304 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 10:39:28.798304 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 10:39:28.798304 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 10:39:28.798304 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 14 10:39:28.798304 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application Jul 14 10:39:28.798304 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 171/331] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Jul 14 10:39:28 2022] GET /identity/v3/roles/member => generated 84 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:39:28.803617 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb0c26b-c6f3-4014-8fbc-264a8b5aaa41 None admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:28.933311 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb0c26b-c6f3-4014-8fbc-264a8b5aaa41 None admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:28.980500 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a567fb06-61d8-4856-bb5a-33ff1fbb92bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:28.981248 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a567fb06-61d8-4856-bb5a-33ff1fbb92bb None admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:28.981541 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a567fb06-61d8-4856-bb5a-33ff1fbb92bb None admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:28.981870 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a567fb06-61d8-4856-bb5a-33ff1fbb92bb None admin] PATH_INFO: `/v3/roles` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:28.982650 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a567fb06-61d8-4856-bb5a-33ff1fbb92bb None admin] RBAC: Adding query filter params (name=member) {{(pid=86655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:39:28.982956 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a567fb06-61d8-4856-bb5a-33ff1fbb92bb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:39:28.984708 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a567fb06-61d8-4856-bb5a-33ff1fbb92bb None admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:39:28.995708 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 161/332] 10.222.0.16 () {56 vars in 1101 bytes} [Thu Jul 14 10:39:28 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:39:29.001420 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1248ad-898e-439e-90a1-d88071b7a0ef None admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:29.115045 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1248ad-898e-439e-90a1-d88071b7a0ef None admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:29.161157 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79a4b05-afcc-4efa-884c-b00efa34c86f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:29.162054 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79a4b05-afcc-4efa-884c-b00efa34c86f None admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:29.162420 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79a4b05-afcc-4efa-884c-b00efa34c86f None admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:29.162708 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79a4b05-afcc-4efa-884c-b00efa34c86f None admin] PATH_INFO: `/v3/users/a63e10341b0743179365c75dc0018702` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:29.163948 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79a4b05-afcc-4efa-884c-b00efa34c86f None admin] RBAC: Authorizing `identity:get_user(user_id=a63e10341b0743179365c75dc0018702)` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:39:29.165468 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79a4b05-afcc-4efa-884c-b00efa34c86f None admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:39:29.167570 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 172/333] 10.222.0.16 () {56 vars in 1177 bytes} [Thu Jul 14 10:39:29 2022] GET /identity/v3/users/a63e10341b0743179365c75dc0018702 => generated 293 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:39:29.173263 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a567fb06-61d8-4856-bb5a-33ff1fbb92bb None admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:29.192489 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:39:29.303212 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a567fb06-61d8-4856-bb5a-33ff1fbb92bb None admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:29.351642 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32da9b3-f361-4ba2-b80a-cc10d68e2b0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:29.352311 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32da9b3-f361-4ba2-b80a-cc10d68e2b0d None admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:29.352594 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32da9b3-f361-4ba2-b80a-cc10d68e2b0d None admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:29.352908 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32da9b3-f361-4ba2-b80a-cc10d68e2b0d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:29.353760 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32da9b3-f361-4ba2-b80a-cc10d68e2b0d None admin] RBAC: Adding query filter params (role.id=0da46c267d354cce81495dfdd56c1ec2, user.id=a63e10341b0743179365c75dc0018702, scope.system=all) {{(pid=86655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:39:29.354078 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32da9b3-f361-4ba2-b80a-cc10d68e2b0d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:39:29.355534 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32da9b3-f361-4ba2-b80a-cc10d68e2b0d None admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:39:29.372643 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 162/334] 10.222.0.16 () {56 vars in 1308 bytes} [Thu Jul 14 10:39:29 2022] GET /identity/v3/role_assignments?user.id=a63e10341b0743179365c75dc0018702&scope.system=all&role.id=0da46c267d354cce81495dfdd56c1ec2 => generated 510 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:39:30.568248 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d513f62-6972-4c56-b3e0-b81ea432ea05 None None] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:30.568762 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d513f62-6972-4c56-b3e0-b81ea432ea05 None None] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:30.568874 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d513f62-6972-4c56-b3e0-b81ea432ea05 None None] PATH_INFO: `/` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:30.570494 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 173/335] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jul 14 10:39:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:39:30.576513 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902bef1e-ff87-49ba-8a21-85ca0b8980e9 None None] REQUEST_METHOD: `POST` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:30.577047 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902bef1e-ff87-49ba-8a21-85ca0b8980e9 None None] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:30.577120 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902bef1e-ff87-49ba-8a21-85ca0b8980e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:30.600904 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.auth.core [None req-902bef1e-ff87-49ba-8a21-85ca0b8980e9 None None] MFA Rules not processed for user `ae4bcdd8106d4bebbdcae96be33505bc`. Rule list: `[]` (Enabled: `True`). {{(pid=86655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:39:30.602220 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-902bef1e-ff87-49ba-8a21-85ca0b8980e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:39:30.700683 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 163/336] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jul 14 10:39:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 14 10:39:30.742261 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d513f62-6972-4c56-b3e0-b81ea432ea05 None None] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:30.755211 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=100 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:39:30.882400 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d513f62-6972-4c56-b3e0-b81ea432ea05 None None] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:30.924385 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2b8560-73b4-4d28-8c3c-c1b28cc08b3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:30.925234 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2b8560-73b4-4d28-8c3c-c1b28cc08b3f None admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:30.925518 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2b8560-73b4-4d28-8c3c-c1b28cc08b3f None admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:30.925794 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2b8560-73b4-4d28-8c3c-c1b28cc08b3f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:30.942445 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2b8560-73b4-4d28-8c3c-c1b28cc08b3f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 10:39:30.950836 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application [None req-4b2b8560-73b4-4d28-8c3c-c1b28cc08b3f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 14 10:39:30.950836 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:39:30.950836 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:39:30.950836 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:39:30.950836 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:39:30.950836 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:39:30.950836 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:39:30.950836 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:39:30.950836 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:39:30.950836 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:39:30.950836 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:39:30.950836 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:39:30.950836 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 10:39:30.950836 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 10:39:30.950836 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 10:39:30.950836 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 10:39:30.951721 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 10:39:30.951721 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 10:39:30.951721 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 10:39:30.951721 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 10:39:30.951721 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:39:30.951721 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:39:30.951721 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:39:30.951721 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:39:30.951721 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:39:30.951721 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:39:30.951721 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:39:30.951721 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application with Lock( Jul 14 10:39:30.951721 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:39:30.951721 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:39:30.951721 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:39:30.951721 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:39:30.952691 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:39:30.952691 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:39:30.952691 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:39:30.952691 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:39:30.952691 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 10:39:30.952691 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 10:39:30.952691 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 10:39:30.952691 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 10:39:30.952691 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 10:39:30.952691 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 10:39:30.952691 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 14 10:39:30.952691 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application Jul 14 10:39:30.956263 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 174/337] 10.222.0.16 () {56 vars in 1114 bytes} [Thu Jul 14 10:39:30 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:39:30.966148 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902bef1e-ff87-49ba-8a21-85ca0b8980e9 None None] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:30.997232 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=100 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:39:31.071597 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cec2aa-30b3-4194-8a09-8e05b908ab73 None None] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:31.071866 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cec2aa-30b3-4194-8a09-8e05b908ab73 None None] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:31.072155 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cec2aa-30b3-4194-8a09-8e05b908ab73 None None] PATH_INFO: `/` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:31.073575 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 175/338] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jul 14 10:39:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 14 10:39:31.084932 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892a255b-719b-4746-af64-8b3e60917185 None None] REQUEST_METHOD: `POST` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:31.085559 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892a255b-719b-4746-af64-8b3e60917185 None None] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:31.086119 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892a255b-719b-4746-af64-8b3e60917185 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:31.109214 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902bef1e-ff87-49ba-8a21-85ca0b8980e9 None None] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:31.136881 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.auth.core [None req-892a255b-719b-4746-af64-8b3e60917185 None None] MFA Rules not processed for user `ae4bcdd8106d4bebbdcae96be33505bc`. Rule list: `[]` (Enabled: `True`). {{(pid=86656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:39:31.138016 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-892a255b-719b-4746-af64-8b3e60917185 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:39:31.157365 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90db523-b9d2-4620-b01a-1ac64cbe372e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:31.158729 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90db523-b9d2-4620-b01a-1ac64cbe372e None admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:31.159506 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90db523-b9d2-4620-b01a-1ac64cbe372e None admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:31.159793 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90db523-b9d2-4620-b01a-1ac64cbe372e None admin] PATH_INFO: `/v3/roles` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:31.160567 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90db523-b9d2-4620-b01a-1ac64cbe372e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:39:31.160904 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90db523-b9d2-4620-b01a-1ac64cbe372e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:39:31.162687 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90db523-b9d2-4620-b01a-1ac64cbe372e None admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:39:31.176930 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 164/339] 10.222.0.16 () {56 vars in 1111 bytes} [Thu Jul 14 10:39:30 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:39:31.182402 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90db523-b9d2-4620-b01a-1ac64cbe372e None admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:31.229529 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 176/340] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jul 14 10:39:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 10:39:31.232793 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=100 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:39:31.256759 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892a255b-719b-4746-af64-8b3e60917185 None None] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:31.278495 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=100 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:39:31.324474 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90db523-b9d2-4620-b01a-1ac64cbe372e None admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:31.366052 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c0da72-8d8f-4444-a3dc-a9af73735e75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:31.366727 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c0da72-8d8f-4444-a3dc-a9af73735e75 None admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:31.367014 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c0da72-8d8f-4444-a3dc-a9af73735e75 None admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:31.367289 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c0da72-8d8f-4444-a3dc-a9af73735e75 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:31.388254 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892a255b-719b-4746-af64-8b3e60917185 None None] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:31.439716 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb57aeb-32a6-4672-a84b-add33a3d0ced None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:31.440530 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb57aeb-32a6-4672-a84b-add33a3d0ced None admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:31.440831 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb57aeb-32a6-4672-a84b-add33a3d0ced None admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:31.441113 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb57aeb-32a6-4672-a84b-add33a3d0ced None admin] PATH_INFO: `/v3/roles/member` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:31.464525 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb57aeb-32a6-4672-a84b-add33a3d0ced None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 10:39:31.473150 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application [None req-9bb57aeb-32a6-4672-a84b-add33a3d0ced None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 14 10:39:31.473150 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:39:31.473150 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:39:31.473150 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:39:31.473150 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:39:31.473150 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:39:31.473150 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:39:31.473150 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:39:31.473150 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:39:31.473150 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:39:31.473150 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:39:31.473150 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:39:31.473150 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 10:39:31.473150 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 10:39:31.473150 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 10:39:31.473150 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 10:39:31.474048 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 10:39:31.474048 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 10:39:31.474048 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 10:39:31.474048 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 10:39:31.474048 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:39:31.474048 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:39:31.474048 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:39:31.474048 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:39:31.474048 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:39:31.474048 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:39:31.474048 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:39:31.474048 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application with Lock( Jul 14 10:39:31.474048 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:39:31.474048 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:39:31.474048 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:39:31.474048 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:39:31.474838 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:39:31.474838 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:39:31.474838 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:39:31.474838 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:39:31.474838 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 10:39:31.474838 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 10:39:31.474838 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 10:39:31.474838 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 10:39:31.474838 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 10:39:31.474838 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 10:39:31.474838 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 14 10:39:31.474838 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application Jul 14 10:39:31.475441 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 177/341] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Jul 14 10:39:31 2022] GET /identity/v3/roles/member => generated 84 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:39:31.482098 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb57aeb-32a6-4672-a84b-add33a3d0ced None admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:31.502099 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c0da72-8d8f-4444-a3dc-a9af73735e75 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:39:31.503940 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c0da72-8d8f-4444-a3dc-a9af73735e75 None admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:39:31.569372 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=100 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:39:31.602423 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb57aeb-32a6-4672-a84b-add33a3d0ced None admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:31.640899 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5489f2-3366-4344-90ec-352ed93bdca1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:31.641837 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5489f2-3366-4344-90ec-352ed93bdca1 None admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:31.642970 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5489f2-3366-4344-90ec-352ed93bdca1 None admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:31.643334 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5489f2-3366-4344-90ec-352ed93bdca1 None admin] PATH_INFO: `/v3/roles` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:31.644322 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5489f2-3366-4344-90ec-352ed93bdca1 None admin] RBAC: Adding query filter params (name=member) {{(pid=86656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:39:31.644761 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5489f2-3366-4344-90ec-352ed93bdca1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:39:31.646246 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=100 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:39:31.647516 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5489f2-3366-4344-90ec-352ed93bdca1 None admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:39:31.658246 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 178/342] 10.222.0.16 () {56 vars in 1101 bytes} [Thu Jul 14 10:39:31 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:39:31.664042 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5489f2-3366-4344-90ec-352ed93bdca1 None admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:31.711428 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 165/343] 10.222.0.16 () {58 vars in 1282 bytes} [Thu Jul 14 10:39:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 529 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 10:39:31.718252 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c0da72-8d8f-4444-a3dc-a9af73735e75 None admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:31.780998 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5489f2-3366-4344-90ec-352ed93bdca1 None admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:31.816816 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=100 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:39:31.820041 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cfb05d-2c74-48a5-9b2e-f1591efbc967 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:31.820920 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cfb05d-2c74-48a5-9b2e-f1591efbc967 None admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:31.821257 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cfb05d-2c74-48a5-9b2e-f1591efbc967 None admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:31.821543 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cfb05d-2c74-48a5-9b2e-f1591efbc967 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:31.911670 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c0da72-8d8f-4444-a3dc-a9af73735e75 None admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:31.918532 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46cfb05d-2c74-48a5-9b2e-f1591efbc967 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:39:31.920028 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46cfb05d-2c74-48a5-9b2e-f1591efbc967 None admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:39:31.965289 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3965bed8-b6f3-4e32-97dd-1ced39c94ad8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:31.966160 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3965bed8-b6f3-4e32-97dd-1ced39c94ad8 None admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:31.966444 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3965bed8-b6f3-4e32-97dd-1ced39c94ad8 None admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:31.966721 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3965bed8-b6f3-4e32-97dd-1ced39c94ad8 None admin] PATH_INFO: `/v3/projects/3d3a37cd8fb044539b71f6202165da75` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:31.968574 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3965bed8-b6f3-4e32-97dd-1ced39c94ad8 None admin] RBAC: Authorizing `identity:get_project(project_id=3d3a37cd8fb044539b71f6202165da75)` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:39:31.970792 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3965bed8-b6f3-4e32-97dd-1ced39c94ad8 None admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:39:31.975898 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 166/344] 10.222.0.16 () {56 vars in 1186 bytes} [Thu Jul 14 10:39:31 2022] GET /identity/v3/projects/3d3a37cd8fb044539b71f6202165da75 => generated 298 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 10:39:31.981628 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57570976-7083-4466-b19d-bbf93c237fe0 None None] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:31.981923 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57570976-7083-4466-b19d-bbf93c237fe0 None None] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:31.982202 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57570976-7083-4466-b19d-bbf93c237fe0 None None] PATH_INFO: `/` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:31.983585 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 167/345] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jul 14 10:39:31 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:39:31.984307 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57570976-7083-4466-b19d-bbf93c237fe0 None None] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:32.050391 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=100 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:39:32.099201 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 179/346] 10.222.0.16 () {58 vars in 1282 bytes} [Thu Jul 14 10:39:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 436 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 14 10:39:32.100512 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6d4464-0ec7-42a3-9808-fbf8d27ca8c8 None None] REQUEST_METHOD: `POST` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:32.106073 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6d4464-0ec7-42a3-9808-fbf8d27ca8c8 None None] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:32.106383 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6d4464-0ec7-42a3-9808-fbf8d27ca8c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:32.138848 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.auth.core [None req-6c6d4464-0ec7-42a3-9808-fbf8d27ca8c8 None None] MFA Rules not processed for user `ae4bcdd8106d4bebbdcae96be33505bc`. Rule list: `[]` (Enabled: `True`). {{(pid=86656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:39:32.140061 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-6c6d4464-0ec7-42a3-9808-fbf8d27ca8c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:39:32.172190 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57570976-7083-4466-b19d-bbf93c237fe0 None None] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:32.181335 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=100 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:39:32.229241 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1a6ad7-f10d-404b-be80-d8c61c4fa7b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:32.230478 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1a6ad7-f10d-404b-be80-d8c61c4fa7b4 None admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:32.230873 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1a6ad7-f10d-404b-be80-d8c61c4fa7b4 None admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:32.231254 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1a6ad7-f10d-404b-be80-d8c61c4fa7b4 None admin] PATH_INFO: `/v3/groups/c5074ffbaa514049890530146c069ba8` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:32.240487 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1a6ad7-f10d-404b-be80-d8c61c4fa7b4 None admin] RBAC: Authorizing `identity:get_group(group_id=c5074ffbaa514049890530146c069ba8)` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:39:32.246848 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1a6ad7-f10d-404b-be80-d8c61c4fa7b4 None admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:39:32.249488 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 168/347] 10.222.0.16 () {56 vars in 1180 bytes} [Thu Jul 14 10:39:31 2022] GET /identity/v3/groups/c5074ffbaa514049890530146c069ba8 => generated 226 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:39:32.250895 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 180/348] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jul 14 10:39:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 10:39:32.252019 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1a6ad7-f10d-404b-be80-d8c61c4fa7b4 None admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:32.310148 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6d4464-0ec7-42a3-9808-fbf8d27ca8c8 None None] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:32.440964 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6d4464-0ec7-42a3-9808-fbf8d27ca8c8 None None] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:32.451770 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=100 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:39:32.462130 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1a6ad7-f10d-404b-be80-d8c61c4fa7b4 None admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:32.480358 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d707c0a-6cbb-4fba-a5b2-357d010f68e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:32.481339 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d707c0a-6cbb-4fba-a5b2-357d010f68e3 None admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:32.481963 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d707c0a-6cbb-4fba-a5b2-357d010f68e3 None admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:32.482424 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d707c0a-6cbb-4fba-a5b2-357d010f68e3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:32.483428 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d707c0a-6cbb-4fba-a5b2-357d010f68e3 None admin] RBAC: Adding query filter params (group.id=c5074ffbaa514049890530146c069ba8, role.id=64ec6989f4724a8ab1e32d37c186c8f8, scope.project.id=3d3a37cd8fb044539b71f6202165da75) {{(pid=86656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:39:32.483921 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d707c0a-6cbb-4fba-a5b2-357d010f68e3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:39:32.485567 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d707c0a-6cbb-4fba-a5b2-357d010f68e3 None admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:39:32.492114 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 181/349] 10.222.0.16 () {56 vars in 1376 bytes} [Thu Jul 14 10:39:32 2022] GET /identity/v3/role_assignments?group.id=c5074ffbaa514049890530146c069ba8&scope.project.id=3d3a37cd8fb044539b71f6202165da75&role.id=64ec6989f4724a8ab1e32d37c186c8f8 => generated 260 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 10:39:32.493183 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d707c0a-6cbb-4fba-a5b2-357d010f68e3 None admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:32.531048 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=100 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:39:32.537774 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c0e2fd-ad8f-456a-b2f6-8dc55ff660fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:32.539868 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c0e2fd-ad8f-456a-b2f6-8dc55ff660fd None admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:32.541822 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c0e2fd-ad8f-456a-b2f6-8dc55ff660fd None admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:32.542346 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c0e2fd-ad8f-456a-b2f6-8dc55ff660fd None admin] PATH_INFO: `/v3/projects/3d3a37cd8fb044539b71f6202165da75` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:32.547431 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c0e2fd-ad8f-456a-b2f6-8dc55ff660fd None admin] RBAC: Authorizing `identity:get_project(project_id=3d3a37cd8fb044539b71f6202165da75)` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:39:32.549407 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c0e2fd-ad8f-456a-b2f6-8dc55ff660fd None admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:39:32.555295 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 169/350] 10.222.0.16 () {56 vars in 1186 bytes} [Thu Jul 14 10:39:32 2022] GET /identity/v3/projects/3d3a37cd8fb044539b71f6202165da75 => generated 298 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:39:32.559441 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10512187-9914-496e-9528-23fd0c7fbadc None None] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:32.559936 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10512187-9914-496e-9528-23fd0c7fbadc None None] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:32.560388 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10512187-9914-496e-9528-23fd0c7fbadc None None] PATH_INFO: `/` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:32.562664 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 170/351] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jul 14 10:39:32 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:39:32.565320 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10512187-9914-496e-9528-23fd0c7fbadc None None] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:32.664679 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d707c0a-6cbb-4fba-a5b2-357d010f68e3 None admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:32.704743 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce513a25-235c-4b0a-9329-6bea83c0cdd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:32.705902 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce513a25-235c-4b0a-9329-6bea83c0cdd8 None admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:32.706369 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce513a25-235c-4b0a-9329-6bea83c0cdd8 None admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:32.706822 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce513a25-235c-4b0a-9329-6bea83c0cdd8 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:32.718326 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce513a25-235c-4b0a-9329-6bea83c0cdd8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 10:39:32.727931 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application [None req-ce513a25-235c-4b0a-9329-6bea83c0cdd8 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 14 10:39:32.727931 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:39:32.727931 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:39:32.727931 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:39:32.727931 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:39:32.727931 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:39:32.727931 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:39:32.727931 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:39:32.727931 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:39:32.727931 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:39:32.727931 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:39:32.727931 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:39:32.727931 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 10:39:32.727931 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 10:39:32.727931 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 10:39:32.727931 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 10:39:32.728950 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 10:39:32.728950 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 10:39:32.728950 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 10:39:32.728950 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 10:39:32.728950 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:39:32.728950 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:39:32.728950 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:39:32.728950 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:39:32.728950 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:39:32.728950 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:39:32.728950 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:39:32.728950 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application with Lock( Jul 14 10:39:32.728950 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:39:32.728950 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:39:32.728950 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:39:32.728950 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:39:32.729793 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:39:32.729793 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:39:32.729793 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:39:32.729793 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:39:32.729793 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 10:39:32.729793 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 10:39:32.729793 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 10:39:32.729793 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 10:39:32.729793 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 10:39:32.729793 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 10:39:32.729793 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 14 10:39:32.729793 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application Jul 14 10:39:32.731938 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 182/352] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Jul 14 10:39:32 2022] GET /identity/v3/roles/member => generated 84 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:39:32.733342 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb5ab6a-78fd-4d88-92ba-a433a2c8dca8 None None] REQUEST_METHOD: `POST` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:32.733792 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb5ab6a-78fd-4d88-92ba-a433a2c8dca8 None None] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:32.734219 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb5ab6a-78fd-4d88-92ba-a433a2c8dca8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:32.753987 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.auth.core [None req-9bb5ab6a-78fd-4d88-92ba-a433a2c8dca8 None None] MFA Rules not processed for user `ae4bcdd8106d4bebbdcae96be33505bc`. Rule list: `[]` (Enabled: `True`). {{(pid=86656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:39:32.755465 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-9bb5ab6a-78fd-4d88-92ba-a433a2c8dca8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:39:32.830896 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 183/353] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jul 14 10:39:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 10:39:32.831225 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10512187-9914-496e-9528-23fd0c7fbadc None None] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:32.832528 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb5ab6a-78fd-4d88-92ba-a433a2c8dca8 None None] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:32.836027 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=100 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:39:32.926355 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476a63b9-1eb1-44da-935d-d5e368b5a7a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:32.927638 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476a63b9-1eb1-44da-935d-d5e368b5a7a4 None admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:32.928076 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476a63b9-1eb1-44da-935d-d5e368b5a7a4 None admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:32.928498 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476a63b9-1eb1-44da-935d-d5e368b5a7a4 None admin] PATH_INFO: `/v3/groups/c5074ffbaa514049890530146c069ba8` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:32.930684 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476a63b9-1eb1-44da-935d-d5e368b5a7a4 None admin] RBAC: Authorizing `identity:get_group(group_id=c5074ffbaa514049890530146c069ba8)` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:39:32.932681 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476a63b9-1eb1-44da-935d-d5e368b5a7a4 None admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:39:32.935952 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 171/354] 10.222.0.16 () {56 vars in 1180 bytes} [Thu Jul 14 10:39:32 2022] GET /identity/v3/groups/c5074ffbaa514049890530146c069ba8 => generated 226 bytes in 371 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:39:32.937442 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476a63b9-1eb1-44da-935d-d5e368b5a7a4 None admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:32.944577 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb5ab6a-78fd-4d88-92ba-a433a2c8dca8 None None] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:32.982776 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790f157d-1034-41d2-bd6e-34d9dac46263 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:32.983743 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790f157d-1034-41d2-bd6e-34d9dac46263 None admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:32.984177 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790f157d-1034-41d2-bd6e-34d9dac46263 None admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:32.984649 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790f157d-1034-41d2-bd6e-34d9dac46263 None admin] PATH_INFO: `/v3/roles` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:32.985570 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790f157d-1034-41d2-bd6e-34d9dac46263 None admin] RBAC: Adding query filter params (name=member) {{(pid=86656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:39:32.986584 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790f157d-1034-41d2-bd6e-34d9dac46263 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:39:32.988169 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790f157d-1034-41d2-bd6e-34d9dac46263 None admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:39:32.990243 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=100 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:39:32.997796 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 184/355] 10.222.0.16 () {56 vars in 1101 bytes} [Thu Jul 14 10:39:32 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:39:32.998900 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790f157d-1034-41d2-bd6e-34d9dac46263 None admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:33.079005 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=100 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:39:33.102550 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476a63b9-1eb1-44da-935d-d5e368b5a7a4 None admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:33.117806 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790f157d-1034-41d2-bd6e-34d9dac46263 None admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:33.154377 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccae236b-fa6f-4998-96e2-fe65470dd158 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:33.155279 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccae236b-fa6f-4998-96e2-fe65470dd158 None admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:33.155581 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fe010e-3a70-4943-9967-76a15bc2594f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:33.155914 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccae236b-fa6f-4998-96e2-fe65470dd158 None admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:33.156333 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccae236b-fa6f-4998-96e2-fe65470dd158 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:33.156703 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fe010e-3a70-4943-9967-76a15bc2594f None admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:33.157172 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fe010e-3a70-4943-9967-76a15bc2594f None admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:33.158097 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fe010e-3a70-4943-9967-76a15bc2594f None admin] PATH_INFO: `/v3/roles/reader` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:33.158374 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccae236b-fa6f-4998-96e2-fe65470dd158 None admin] RBAC: Adding query filter params (group.id=c5074ffbaa514049890530146c069ba8, role.id=0da46c267d354cce81495dfdd56c1ec2, scope.project.id=3d3a37cd8fb044539b71f6202165da75) {{(pid=86656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:39:33.158839 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccae236b-fa6f-4998-96e2-fe65470dd158 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:39:33.160436 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccae236b-fa6f-4998-96e2-fe65470dd158 None admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:39:33.166895 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 185/356] 10.222.0.16 () {56 vars in 1376 bytes} [Thu Jul 14 10:39:32 2022] GET /identity/v3/role_assignments?group.id=c5074ffbaa514049890530146c069ba8&scope.project.id=3d3a37cd8fb044539b71f6202165da75&role.id=0da46c267d354cce81495dfdd56c1ec2 => generated 260 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:39:33.168418 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8154df-b99f-41e6-8ba2-a5477e202ab9 None None] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:33.168887 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8154df-b99f-41e6-8ba2-a5477e202ab9 None None] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:33.169317 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8154df-b99f-41e6-8ba2-a5477e202ab9 None None] PATH_INFO: `/` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:33.171027 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 186/357] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jul 14 10:39:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:39:33.171945 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8154df-b99f-41e6-8ba2-a5477e202ab9 None None] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:33.177544 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8fe010e-3a70-4943-9967-76a15bc2594f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 10:39:33.191116 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application [None req-a8fe010e-3a70-4943-9967-76a15bc2594f None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 14 10:39:33.191116 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:39:33.191116 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:39:33.191116 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:39:33.191116 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:39:33.191116 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:39:33.191116 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:39:33.191116 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:39:33.191116 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:39:33.191116 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:39:33.191116 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:39:33.191116 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:39:33.191116 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 10:39:33.191116 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 10:39:33.191116 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 10:39:33.191116 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 10:39:33.192249 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 10:39:33.192249 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 10:39:33.192249 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 10:39:33.192249 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 10:39:33.192249 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:39:33.192249 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:39:33.192249 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:39:33.192249 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:39:33.192249 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:39:33.192249 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:39:33.192249 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:39:33.192249 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application with Lock( Jul 14 10:39:33.192249 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:39:33.192249 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:39:33.192249 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:39:33.192249 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:39:33.193067 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:39:33.193067 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:39:33.193067 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:39:33.193067 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:39:33.193067 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 10:39:33.193067 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 10:39:33.193067 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 10:39:33.193067 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 10:39:33.193067 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 10:39:33.193067 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 10:39:33.193067 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 14 10:39:33.193067 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application Jul 14 10:39:33.193067 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 172/358] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Jul 14 10:39:32 2022] GET /identity/v3/roles/reader => generated 84 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:39:33.194817 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc10aed-2d40-4603-89de-da770242cd7b None None] REQUEST_METHOD: `POST` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:33.195386 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc10aed-2d40-4603-89de-da770242cd7b None None] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:33.195772 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc10aed-2d40-4603-89de-da770242cd7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:33.225548 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.auth.core [None req-1fc10aed-2d40-4603-89de-da770242cd7b None None] MFA Rules not processed for user `ae4bcdd8106d4bebbdcae96be33505bc`. Rule list: `[]` (Enabled: `True`). {{(pid=86655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:39:33.227320 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-1fc10aed-2d40-4603-89de-da770242cd7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:39:33.298463 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8154df-b99f-41e6-8ba2-a5477e202ab9 None None] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:33.330510 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=100 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:39:33.337485 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a64daf1-4c8b-4854-8e9d-dd5127ba1653 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:33.338416 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a64daf1-4c8b-4854-8e9d-dd5127ba1653 None admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:33.339121 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a64daf1-4c8b-4854-8e9d-dd5127ba1653 None admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:33.339873 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a64daf1-4c8b-4854-8e9d-dd5127ba1653 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:33.343184 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 173/359] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jul 14 10:39:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 10:39:33.345948 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc10aed-2d40-4603-89de-da770242cd7b None None] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:33.386046 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=100 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:39:33.415022 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a64daf1-4c8b-4854-8e9d-dd5127ba1653 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:39:33.416543 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a64daf1-4c8b-4854-8e9d-dd5127ba1653 None admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:39:33.507962 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc10aed-2d40-4603-89de-da770242cd7b None None] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:33.526595 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 187/360] 10.222.0.16 () {58 vars in 1282 bytes} [Thu Jul 14 10:39:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 10:39:33.526595 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a64daf1-4c8b-4854-8e9d-dd5127ba1653 None admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:33.556950 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=100 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:39:33.575390 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a22af1-8173-411e-af8b-e4e94774b798 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:33.576915 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a22af1-8173-411e-af8b-e4e94774b798 None admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:33.577569 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a22af1-8173-411e-af8b-e4e94774b798 None admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:33.578203 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a22af1-8173-411e-af8b-e4e94774b798 None admin] PATH_INFO: `/v3/roles` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:33.580132 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a22af1-8173-411e-af8b-e4e94774b798 None admin] RBAC: Adding query filter params (name=reader) {{(pid=86655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:39:33.580984 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a22af1-8173-411e-af8b-e4e94774b798 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:39:33.583460 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a22af1-8173-411e-af8b-e4e94774b798 None admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:39:33.598254 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 174/361] 10.222.0.16 () {56 vars in 1101 bytes} [Thu Jul 14 10:39:33 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:39:33.599965 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a22af1-8173-411e-af8b-e4e94774b798 None admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:33.634577 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a64daf1-4c8b-4854-8e9d-dd5127ba1653 None admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:33.671172 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c453793-e2a5-4213-99cf-6cd67a73c8dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:33.671972 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c453793-e2a5-4213-99cf-6cd67a73c8dc None admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:33.672262 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c453793-e2a5-4213-99cf-6cd67a73c8dc None admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:33.672532 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c453793-e2a5-4213-99cf-6cd67a73c8dc None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:33.683110 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c453793-e2a5-4213-99cf-6cd67a73c8dc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 10:39:33.691643 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application [None req-1c453793-e2a5-4213-99cf-6cd67a73c8dc None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 14 10:39:33.691643 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:39:33.691643 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:39:33.691643 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:39:33.691643 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:39:33.691643 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:39:33.691643 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:39:33.691643 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:39:33.691643 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:39:33.691643 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:39:33.691643 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:39:33.691643 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:39:33.691643 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 10:39:33.691643 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 10:39:33.691643 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 10:39:33.691643 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 10:39:33.693023 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 10:39:33.693023 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 10:39:33.693023 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 10:39:33.693023 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 10:39:33.693023 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:39:33.693023 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:39:33.693023 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:39:33.693023 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:39:33.693023 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:39:33.693023 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:39:33.693023 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:39:33.693023 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application with Lock( Jul 14 10:39:33.693023 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:39:33.693023 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:39:33.693023 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:39:33.693023 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:39:33.694223 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:39:33.694223 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:39:33.694223 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:39:33.694223 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:39:33.694223 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 10:39:33.694223 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 10:39:33.694223 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 10:39:33.694223 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 10:39:33.694223 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 10:39:33.694223 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 10:39:33.694223 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 14 10:39:33.694223 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application Jul 14 10:39:33.694223 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 188/362] 10.222.0.16 () {56 vars in 1114 bytes} [Thu Jul 14 10:39:33 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:39:33.694223 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c453793-e2a5-4213-99cf-6cd67a73c8dc None admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:33.744127 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=100 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:39:33.770779 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a22af1-8173-411e-af8b-e4e94774b798 None admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:33.798944 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=100 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:39:33.811201 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c453793-e2a5-4213-99cf-6cd67a73c8dc None admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:33.828516 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a024824b-99bf-44c3-951d-828e487ae9f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:33.829922 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a024824b-99bf-44c3-951d-828e487ae9f3 None admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:33.830362 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a024824b-99bf-44c3-951d-828e487ae9f3 None admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:33.830825 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a024824b-99bf-44c3-951d-828e487ae9f3 None admin] PATH_INFO: `/v3/projects/e3cf5b002a1c43f7a02696ed092318ca` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:33.832615 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a024824b-99bf-44c3-951d-828e487ae9f3 None admin] RBAC: Authorizing `identity:get_project(project_id=e3cf5b002a1c43f7a02696ed092318ca)` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:39:33.834883 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a024824b-99bf-44c3-951d-828e487ae9f3 None admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:39:33.837796 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 175/363] 10.222.0.16 () {56 vars in 1186 bytes} [Thu Jul 14 10:39:33 2022] GET /identity/v3/projects/e3cf5b002a1c43f7a02696ed092318ca => generated 302 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:39:33.839035 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a024824b-99bf-44c3-951d-828e487ae9f3 None admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:33.875589 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9476952-9f2c-413e-a2b8-da3cdc5477c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:33.877227 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9476952-9f2c-413e-a2b8-da3cdc5477c2 None admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:33.877519 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9476952-9f2c-413e-a2b8-da3cdc5477c2 None admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:33.877798 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9476952-9f2c-413e-a2b8-da3cdc5477c2 None admin] PATH_INFO: `/v3/users/e285915ce58c4d5bb995dceb9678d29c` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:33.879072 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9476952-9f2c-413e-a2b8-da3cdc5477c2 None admin] RBAC: Authorizing `identity:get_user(user_id=e285915ce58c4d5bb995dceb9678d29c)` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:39:33.880634 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9476952-9f2c-413e-a2b8-da3cdc5477c2 None admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:39:33.883733 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 189/364] 10.222.0.16 () {56 vars in 1177 bytes} [Thu Jul 14 10:39:33 2022] GET /identity/v3/users/e285915ce58c4d5bb995dceb9678d29c => generated 293 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:39:33.883733 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9476952-9f2c-413e-a2b8-da3cdc5477c2 None admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:34.008933 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a024824b-99bf-44c3-951d-828e487ae9f3 None admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:34.034296 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9476952-9f2c-413e-a2b8-da3cdc5477c2 None admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:34.070116 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db50c01a-ccfa-4f23-9ab8-8c8e071dc437 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:34.071010 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db50c01a-ccfa-4f23-9ab8-8c8e071dc437 None admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:34.071419 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db50c01a-ccfa-4f23-9ab8-8c8e071dc437 None admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:34.071798 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db50c01a-ccfa-4f23-9ab8-8c8e071dc437 None admin] PATH_INFO: `/v3/roles` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:34.074328 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db50c01a-ccfa-4f23-9ab8-8c8e071dc437 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:39:34.074819 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db50c01a-ccfa-4f23-9ab8-8c8e071dc437 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:39:34.077644 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db50c01a-ccfa-4f23-9ab8-8c8e071dc437 None admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:39:34.080175 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92087c9-8c5a-431a-a902-0ca07512c7e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:34.081549 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92087c9-8c5a-431a-a902-0ca07512c7e7 None admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:34.081936 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92087c9-8c5a-431a-a902-0ca07512c7e7 None admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:34.082332 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92087c9-8c5a-431a-a902-0ca07512c7e7 None admin] PATH_INFO: `/v3/groups/c5074ffbaa514049890530146c069ba8` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:34.083611 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92087c9-8c5a-431a-a902-0ca07512c7e7 None admin] RBAC: Authorizing `identity:get_group(group_id=c5074ffbaa514049890530146c069ba8)` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:39:34.086420 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92087c9-8c5a-431a-a902-0ca07512c7e7 None admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:39:34.088212 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 190/365] 10.222.0.16 () {56 vars in 1180 bytes} [Thu Jul 14 10:39:33 2022] GET /identity/v3/groups/c5074ffbaa514049890530146c069ba8 => generated 226 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:39:34.089569 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c074264f-40af-4154-8a94-8aa30abcd31d None None] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:34.089857 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c074264f-40af-4154-8a94-8aa30abcd31d None None] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:34.090155 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c074264f-40af-4154-8a94-8aa30abcd31d None None] PATH_INFO: `/` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:34.091864 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 176/366] 10.222.0.16 () {56 vars in 1111 bytes} [Thu Jul 14 10:39:33 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:39:34.093201 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db50c01a-ccfa-4f23-9ab8-8c8e071dc437 None admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:34.098107 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 191/367] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jul 14 10:39:34 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:39:34.101863 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c074264f-40af-4154-8a94-8aa30abcd31d None None] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:34.122749 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=100 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:39:34.140636 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=100 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:39:34.218735 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db50c01a-ccfa-4f23-9ab8-8c8e071dc437 None admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:34.232117 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c074264f-40af-4154-8a94-8aa30abcd31d None None] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:34.257936 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a70125-c7eb-491d-b88a-42fd1bf0ab44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:34.258744 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a70125-c7eb-491d-b88a-42fd1bf0ab44 None admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:34.259121 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a70125-c7eb-491d-b88a-42fd1bf0ab44 None admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:34.259496 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a70125-c7eb-491d-b88a-42fd1bf0ab44 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:34.260676 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a70125-c7eb-491d-b88a-42fd1bf0ab44 None admin] RBAC: Adding query filter params (role.id=ac28665f2a2446b8a9c98f0de3126d33, user.id=e285915ce58c4d5bb995dceb9678d29c, scope.system=all) {{(pid=86655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:39:34.260861 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a70125-c7eb-491d-b88a-42fd1bf0ab44 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:39:34.262428 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a70125-c7eb-491d-b88a-42fd1bf0ab44 None admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:39:34.279189 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ab119d-8a70-4664-a8e4-641b8cdb4d7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:34.280079 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ab119d-8a70-4664-a8e4-641b8cdb4d7f None admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:34.280524 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ab119d-8a70-4664-a8e4-641b8cdb4d7f None admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:34.281017 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 177/368] 10.222.0.16 () {56 vars in 1308 bytes} [Thu Jul 14 10:39:34 2022] GET /identity/v3/role_assignments?user.id=e285915ce58c4d5bb995dceb9678d29c&scope.system=all&role.id=ac28665f2a2446b8a9c98f0de3126d33 => generated 510 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:39:34.281199 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ab119d-8a70-4664-a8e4-641b8cdb4d7f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:34.282953 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f77442-fd1e-4cf9-a47f-3c0bcadd785d None None] REQUEST_METHOD: `POST` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:34.283317 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f77442-fd1e-4cf9-a47f-3c0bcadd785d None None] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:34.283711 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f77442-fd1e-4cf9-a47f-3c0bcadd785d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:34.304042 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.auth.core [None req-23f77442-fd1e-4cf9-a47f-3c0bcadd785d None None] MFA Rules not processed for user `ae4bcdd8106d4bebbdcae96be33505bc`. Rule list: `[]` (Enabled: `True`). {{(pid=86655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:39:34.305845 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-23f77442-fd1e-4cf9-a47f-3c0bcadd785d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:39:34.360219 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ab119d-8a70-4664-a8e4-641b8cdb4d7f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:39:34.363090 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ab119d-8a70-4664-a8e4-641b8cdb4d7f None admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:39:34.395380 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 178/369] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jul 14 10:39:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 10:39:34.396199 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f77442-fd1e-4cf9-a47f-3c0bcadd785d None None] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:34.398827 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=100 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:39:34.409159 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=100 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:39:34.513533 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f77442-fd1e-4cf9-a47f-3c0bcadd785d None None] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:34.517764 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 192/370] 10.222.0.16 () {58 vars in 1282 bytes} [Thu Jul 14 10:39:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 416 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 10:39:34.518795 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ab119d-8a70-4664-a8e4-641b8cdb4d7f None admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:34.558786 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca978bf-8f33-40cd-b963-2c390f4eb77a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:34.559447 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca978bf-8f33-40cd-b963-2c390f4eb77a None admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:34.559736 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca978bf-8f33-40cd-b963-2c390f4eb77a None admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:34.560014 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca978bf-8f33-40cd-b963-2c390f4eb77a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:34.560879 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca978bf-8f33-40cd-b963-2c390f4eb77a None admin] RBAC: Adding query filter params (group.id=c5074ffbaa514049890530146c069ba8, role.id=0da46c267d354cce81495dfdd56c1ec2, scope.project.id=e3cf5b002a1c43f7a02696ed092318ca) {{(pid=86655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:39:34.561191 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca978bf-8f33-40cd-b963-2c390f4eb77a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:39:34.562891 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca978bf-8f33-40cd-b963-2c390f4eb77a None admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:39:34.569519 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 179/371] 10.222.0.16 () {56 vars in 1376 bytes} [Thu Jul 14 10:39:34 2022] GET /identity/v3/role_assignments?group.id=c5074ffbaa514049890530146c069ba8&scope.project.id=e3cf5b002a1c43f7a02696ed092318ca&role.id=0da46c267d354cce81495dfdd56c1ec2 => generated 260 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:39:34.570260 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca978bf-8f33-40cd-b963-2c390f4eb77a None admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:34.642385 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=100 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:39:34.657329 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ab119d-8a70-4664-a8e4-641b8cdb4d7f None admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:34.682048 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca978bf-8f33-40cd-b963-2c390f4eb77a None admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:34.691700 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=100 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:39:34.706380 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19cf33da-5899-4981-9b6a-0835bd594cfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:34.707277 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cf33da-5899-4981-9b6a-0835bd594cfe None admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:34.707563 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cf33da-5899-4981-9b6a-0835bd594cfe None admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:34.707838 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cf33da-5899-4981-9b6a-0835bd594cfe None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:34.730529 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19cf33da-5899-4981-9b6a-0835bd594cfe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 10:39:34.746643 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application [None req-19cf33da-5899-4981-9b6a-0835bd594cfe None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 10:39:34.746643 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:39:34.746643 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:39:34.746643 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:39:34.746643 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:39:34.746643 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:39:34.746643 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:39:34.746643 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:39:34.746643 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:39:34.746643 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:39:34.746643 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:39:34.746643 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:39:34.746643 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 10:39:34.746643 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 10:39:34.746643 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 10:39:34.746643 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 10:39:34.747609 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 10:39:34.747609 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 10:39:34.747609 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 10:39:34.747609 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 10:39:34.747609 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:39:34.747609 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:39:34.747609 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:39:34.747609 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:39:34.747609 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:39:34.747609 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:39:34.747609 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:39:34.747609 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application with Lock( Jul 14 10:39:34.747609 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:39:34.747609 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:39:34.747609 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:39:34.747609 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:39:34.748383 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:39:34.748383 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:39:34.748383 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:39:34.748383 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:39:34.748383 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 10:39:34.748383 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 10:39:34.748383 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 10:39:34.748383 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 10:39:34.748383 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 10:39:34.748383 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 10:39:34.748383 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 10:39:34.748383 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application Jul 14 10:39:34.749118 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f2ccec-dbdb-45d6-8786-7e253192877f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:34.749118 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f2ccec-dbdb-45d6-8786-7e253192877f None admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:34.750052 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f2ccec-dbdb-45d6-8786-7e253192877f None admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:34.750052 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f2ccec-dbdb-45d6-8786-7e253192877f None admin] PATH_INFO: `/v3/projects/e3cf5b002a1c43f7a02696ed092318ca` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:34.751002 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 193/372] 10.222.0.16 () {56 vars in 1096 bytes} [Thu Jul 14 10:39:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:39:34.752576 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f2ccec-dbdb-45d6-8786-7e253192877f None admin] RBAC: Authorizing `identity:get_project(project_id=e3cf5b002a1c43f7a02696ed092318ca)` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:39:34.753906 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f2ccec-dbdb-45d6-8786-7e253192877f None admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:39:34.755822 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 180/373] 10.222.0.16 () {56 vars in 1186 bytes} [Thu Jul 14 10:39:34 2022] GET /identity/v3/projects/e3cf5b002a1c43f7a02696ed092318ca => generated 302 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:39:34.758647 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19cf33da-5899-4981-9b6a-0835bd594cfe None admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:34.766456 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f2ccec-dbdb-45d6-8786-7e253192877f None admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:34.947978 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19cf33da-5899-4981-9b6a-0835bd594cfe None admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:34.961915 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f2ccec-dbdb-45d6-8786-7e253192877f None admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:35.000897 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd88b2c-4abf-414b-a0c2-ac44a7f61c23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:35.001792 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd88b2c-4abf-414b-a0c2-ac44a7f61c23 None admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:35.002050 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd88b2c-4abf-414b-a0c2-ac44a7f61c23 None admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:35.002326 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd88b2c-4abf-414b-a0c2-ac44a7f61c23 None admin] PATH_INFO: `/v3/roles` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:35.006114 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd88b2c-4abf-414b-a0c2-ac44a7f61c23 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:39:35.006434 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd88b2c-4abf-414b-a0c2-ac44a7f61c23 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:39:35.007818 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd88b2c-4abf-414b-a0c2-ac44a7f61c23 None admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:39:35.024178 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 194/374] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Jul 14 10:39:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:39:35.029984 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80769e94-50e6-4506-8815-516f028a68ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:35.030851 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80769e94-50e6-4506-8815-516f028a68ac None admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:35.031126 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80769e94-50e6-4506-8815-516f028a68ac None admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:35.031415 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80769e94-50e6-4506-8815-516f028a68ac None admin] PATH_INFO: `/v3/groups/c5074ffbaa514049890530146c069ba8` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:35.033448 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd88b2c-4abf-414b-a0c2-ac44a7f61c23 None admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:35.034455 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80769e94-50e6-4506-8815-516f028a68ac None admin] RBAC: Authorizing `identity:get_group(group_id=c5074ffbaa514049890530146c069ba8)` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:39:35.035910 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80769e94-50e6-4506-8815-516f028a68ac None admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:39:35.037748 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 181/375] 10.222.0.16 () {56 vars in 1180 bytes} [Thu Jul 14 10:39:34 2022] GET /identity/v3/groups/c5074ffbaa514049890530146c069ba8 => generated 226 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:39:35.054789 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80769e94-50e6-4506-8815-516f028a68ac None admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:35.058088 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=100 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:39:35.130258 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=100 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:39:35.218333 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd88b2c-4abf-414b-a0c2-ac44a7f61c23 None admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:35.238654 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80769e94-50e6-4506-8815-516f028a68ac None admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:35.284453 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6f031b-4765-4f50-aca6-ecab6c10a308 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:35.285142 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6f031b-4765-4f50-aca6-ecab6c10a308 None admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:35.285425 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6f031b-4765-4f50-aca6-ecab6c10a308 None admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:35.285696 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6f031b-4765-4f50-aca6-ecab6c10a308 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:35.286543 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6f031b-4765-4f50-aca6-ecab6c10a308 None admin] RBAC: Adding query filter params (group.id=c5074ffbaa514049890530146c069ba8, role.id=64ec6989f4724a8ab1e32d37c186c8f8, scope.project.id=e3cf5b002a1c43f7a02696ed092318ca) {{(pid=86655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:39:35.286852 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6f031b-4765-4f50-aca6-ecab6c10a308 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:39:35.288287 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6f031b-4765-4f50-aca6-ecab6c10a308 None admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:39:35.297315 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7142cb-fe4b-468e-8c03-ef4526bb9ebb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:35.297968 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7142cb-fe4b-468e-8c03-ef4526bb9ebb None admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:35.298797 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7142cb-fe4b-468e-8c03-ef4526bb9ebb None admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:35.299065 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7142cb-fe4b-468e-8c03-ef4526bb9ebb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:35.306199 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 182/376] 10.222.0.16 () {56 vars in 1376 bytes} [Thu Jul 14 10:39:35 2022] GET /identity/v3/role_assignments?group.id=c5074ffbaa514049890530146c069ba8&scope.project.id=e3cf5b002a1c43f7a02696ed092318ca&role.id=64ec6989f4724a8ab1e32d37c186c8f8 => generated 260 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 10:39:35.379747 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7142cb-fe4b-468e-8c03-ef4526bb9ebb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:39:35.381245 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7142cb-fe4b-468e-8c03-ef4526bb9ebb None admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:39:35.433874 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=100 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:39:35.496350 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 195/377] 10.222.0.16 () {58 vars in 1282 bytes} [Thu Jul 14 10:39:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 464 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 10:39:35.502828 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6f031b-4765-4f50-aca6-ecab6c10a308 None admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:35.560324 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6caa877-546b-4306-8931-4eeda0f46dbf None None] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:35.560629 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6caa877-546b-4306-8931-4eeda0f46dbf None None] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:35.565003 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6caa877-546b-4306-8931-4eeda0f46dbf None None] PATH_INFO: `/` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:35.567020 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 196/378] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jul 14 10:39:35 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 14 10:39:35.580822 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4338a12b-638e-4f1c-89a8-749ee4be6244 None None] REQUEST_METHOD: `POST` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:35.581136 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4338a12b-638e-4f1c-89a8-749ee4be6244 None None] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:35.581375 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4338a12b-638e-4f1c-89a8-749ee4be6244 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:35.603726 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=100 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:39:35.614767 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.auth.core [None req-4338a12b-638e-4f1c-89a8-749ee4be6244 None None] MFA Rules not processed for user `ae4bcdd8106d4bebbdcae96be33505bc`. Rule list: `[]` (Enabled: `True`). {{(pid=86656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:39:35.615995 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-4338a12b-638e-4f1c-89a8-749ee4be6244 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:39:35.655738 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6f031b-4765-4f50-aca6-ecab6c10a308 None admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:35.717941 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341491bc-0633-4ed8-a48d-36b53e087723 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:35.718812 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341491bc-0633-4ed8-a48d-36b53e087723 None admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:35.719097 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341491bc-0633-4ed8-a48d-36b53e087723 None admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:35.719375 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341491bc-0633-4ed8-a48d-36b53e087723 None admin] PATH_INFO: `/v3/projects/7a2b7c1edcba4e118452f92cb83ff4b2` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:35.721919 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341491bc-0633-4ed8-a48d-36b53e087723 None admin] RBAC: Authorizing `identity:get_project(project_id=7a2b7c1edcba4e118452f92cb83ff4b2)` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:39:35.723352 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341491bc-0633-4ed8-a48d-36b53e087723 None admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:39:35.729132 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 183/379] 10.222.0.16 () {56 vars in 1186 bytes} [Thu Jul 14 10:39:35 2022] GET /identity/v3/projects/7a2b7c1edcba4e118452f92cb83ff4b2 => generated 344 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:39:35.731187 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341491bc-0633-4ed8-a48d-36b53e087723 None admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:35.754073 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 197/380] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jul 14 10:39:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 14 10:39:35.802708 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4338a12b-638e-4f1c-89a8-749ee4be6244 None None] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:35.896279 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341491bc-0633-4ed8-a48d-36b53e087723 None admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:35.940944 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=100 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:39:35.960005 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933e401c-b926-4f1d-ae24-3d3b2539d264 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:35.960894 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933e401c-b926-4f1d-ae24-3d3b2539d264 None admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:35.961179 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933e401c-b926-4f1d-ae24-3d3b2539d264 None admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:35.961452 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933e401c-b926-4f1d-ae24-3d3b2539d264 None admin] PATH_INFO: `/v3/groups/da205123caaa4fb8ae8fb3221a99daef` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:35.966267 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=100 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:39:35.973492 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933e401c-b926-4f1d-ae24-3d3b2539d264 None admin] RBAC: Authorizing `identity:get_group(group_id=da205123caaa4fb8ae8fb3221a99daef)` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:39:35.974958 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933e401c-b926-4f1d-ae24-3d3b2539d264 None admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:39:35.976872 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 184/381] 10.222.0.16 () {56 vars in 1180 bytes} [Thu Jul 14 10:39:35 2022] GET /identity/v3/groups/da205123caaa4fb8ae8fb3221a99daef => generated 229 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:39:35.979489 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4338a12b-638e-4f1c-89a8-749ee4be6244 None None] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:35.982392 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933e401c-b926-4f1d-ae24-3d3b2539d264 None admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:36.042771 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0ad4a4-e87f-46ea-98ef-751f9648a424 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:36.045789 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0ad4a4-e87f-46ea-98ef-751f9648a424 None admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:36.045789 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0ad4a4-e87f-46ea-98ef-751f9648a424 None admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:36.045789 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0ad4a4-e87f-46ea-98ef-751f9648a424 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:36.057872 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0ad4a4-e87f-46ea-98ef-751f9648a424 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 10:39:36.067113 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application [None req-5d0ad4a4-e87f-46ea-98ef-751f9648a424 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 14 10:39:36.067113 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:39:36.067113 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:39:36.067113 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:39:36.067113 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:39:36.067113 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:39:36.067113 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:39:36.067113 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:39:36.067113 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:39:36.067113 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:39:36.067113 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:39:36.067113 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:39:36.067113 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 10:39:36.067113 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 10:39:36.067113 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 10:39:36.067113 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 10:39:36.067989 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 10:39:36.067989 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 10:39:36.067989 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 10:39:36.067989 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 10:39:36.067989 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:39:36.067989 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:39:36.067989 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:39:36.067989 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:39:36.067989 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:39:36.067989 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:39:36.067989 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:39:36.067989 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application with Lock( Jul 14 10:39:36.067989 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:39:36.067989 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:39:36.067989 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:39:36.067989 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:39:36.069133 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:39:36.069133 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:39:36.069133 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:39:36.069133 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:39:36.069133 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 10:39:36.069133 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 10:39:36.069133 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 10:39:36.069133 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 10:39:36.069133 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 10:39:36.069133 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 10:39:36.069133 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 14 10:39:36.069133 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application Jul 14 10:39:36.073061 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 198/382] 10.222.0.16 () {56 vars in 1114 bytes} [Thu Jul 14 10:39:35 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 10:39:36.074871 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0ad4a4-e87f-46ea-98ef-751f9648a424 None admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:36.164347 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933e401c-b926-4f1d-ae24-3d3b2539d264 None admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:36.192227 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0ad4a4-e87f-46ea-98ef-751f9648a424 None admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:36.228030 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b2ff39-e0a4-44ae-bd3e-a8f6c5f214e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:36.228694 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b2ff39-e0a4-44ae-bd3e-a8f6c5f214e5 None admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:36.229005 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b2ff39-e0a4-44ae-bd3e-a8f6c5f214e5 None admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:36.229285 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b2ff39-e0a4-44ae-bd3e-a8f6c5f214e5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:36.229809 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bfcad9-b55b-4847-ac75-46dc11213cba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:36.230274 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b2ff39-e0a4-44ae-bd3e-a8f6c5f214e5 None admin] RBAC: Adding query filter params (group.id=da205123caaa4fb8ae8fb3221a99daef, role.id=153539819e5542df99269d2913bbecfb, scope.project.id=7a2b7c1edcba4e118452f92cb83ff4b2) {{(pid=86655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:39:36.230481 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bfcad9-b55b-4847-ac75-46dc11213cba None admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:36.230575 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b2ff39-e0a4-44ae-bd3e-a8f6c5f214e5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:39:36.230767 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bfcad9-b55b-4847-ac75-46dc11213cba None admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:36.231045 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bfcad9-b55b-4847-ac75-46dc11213cba None admin] PATH_INFO: `/v3/roles` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:36.231799 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84bfcad9-b55b-4847-ac75-46dc11213cba None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:39:36.232011 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b2ff39-e0a4-44ae-bd3e-a8f6c5f214e5 None admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:39:36.232102 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84bfcad9-b55b-4847-ac75-46dc11213cba None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:39:36.235162 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84bfcad9-b55b-4847-ac75-46dc11213cba None admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:39:36.240755 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=100 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:39:36.243005 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 185/383] 10.222.0.16 () {56 vars in 1376 bytes} [Thu Jul 14 10:39:35 2022] GET /identity/v3/role_assignments?group.id=da205123caaa4fb8ae8fb3221a99daef&scope.project.id=7a2b7c1edcba4e118452f92cb83ff4b2&role.id=153539819e5542df99269d2913bbecfb => generated 260 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:39:36.244245 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd3597e-b300-482d-b068-1e307d633e76 None None] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:36.244454 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd3597e-b300-482d-b068-1e307d633e76 None None] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:36.244734 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd3597e-b300-482d-b068-1e307d633e76 None None] PATH_INFO: `/` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:36.246148 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 186/384] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jul 14 10:39:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:39:36.251295 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 199/385] 10.222.0.16 () {56 vars in 1111 bytes} [Thu Jul 14 10:39:36 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:39:36.254989 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1a9252-c2de-433f-b3c5-64154d037051 None None] REQUEST_METHOD: `POST` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:36.254989 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1a9252-c2de-433f-b3c5-64154d037051 None None] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:36.254989 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1a9252-c2de-433f-b3c5-64154d037051 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:36.257870 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bfcad9-b55b-4847-ac75-46dc11213cba None admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:36.294089 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.auth.core [None req-9c1a9252-c2de-433f-b3c5-64154d037051 None None] MFA Rules not processed for user `ae4bcdd8106d4bebbdcae96be33505bc`. Rule list: `[]` (Enabled: `True`). {{(pid=86655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:39:36.295654 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-9c1a9252-c2de-433f-b3c5-64154d037051 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:39:36.417157 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=100 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:39:36.437494 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 187/386] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jul 14 10:39:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 14 10:39:36.445785 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bfcad9-b55b-4847-ac75-46dc11213cba None admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:36.466768 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1a9252-c2de-433f-b3c5-64154d037051 None None] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:36.510586 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d72849d-fd7f-4c9b-abb7-3caf2a72a97c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:36.511471 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d72849d-fd7f-4c9b-abb7-3caf2a72a97c None admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:36.511764 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d72849d-fd7f-4c9b-abb7-3caf2a72a97c None admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:36.512047 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d72849d-fd7f-4c9b-abb7-3caf2a72a97c None admin] PATH_INFO: `/v3/groups/c5074ffbaa514049890530146c069ba8` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:36.513279 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d72849d-fd7f-4c9b-abb7-3caf2a72a97c None admin] RBAC: Authorizing `identity:get_group(group_id=c5074ffbaa514049890530146c069ba8)` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:39:36.514738 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d72849d-fd7f-4c9b-abb7-3caf2a72a97c None admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:39:36.521722 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 200/387] 10.222.0.16 () {56 vars in 1180 bytes} [Thu Jul 14 10:39:36 2022] GET /identity/v3/groups/c5074ffbaa514049890530146c069ba8 => generated 226 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:39:36.525872 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d72849d-fd7f-4c9b-abb7-3caf2a72a97c None admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:36.607688 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1a9252-c2de-433f-b3c5-64154d037051 None None] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:36.626637 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=100 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:39:36.656843 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c94e83-5bda-4fee-89db-4b645457f14b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:36.658445 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c94e83-5bda-4fee-89db-4b645457f14b None admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:36.658741 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c94e83-5bda-4fee-89db-4b645457f14b None admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:36.659024 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c94e83-5bda-4fee-89db-4b645457f14b None admin] PATH_INFO: `/v3/roles/member` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:36.670367 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c94e83-5bda-4fee-89db-4b645457f14b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 10:39:36.682386 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application [None req-87c94e83-5bda-4fee-89db-4b645457f14b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 14 10:39:36.682386 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:39:36.682386 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:39:36.682386 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:39:36.682386 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:39:36.682386 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:39:36.682386 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:39:36.682386 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:39:36.682386 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:39:36.682386 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:39:36.682386 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:39:36.682386 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:39:36.682386 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 10:39:36.682386 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 10:39:36.682386 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 10:39:36.682386 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 10:39:36.683429 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 10:39:36.683429 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 10:39:36.683429 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 10:39:36.683429 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 10:39:36.683429 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:39:36.683429 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:39:36.683429 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:39:36.683429 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:39:36.683429 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:39:36.683429 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:39:36.683429 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:39:36.683429 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application with Lock( Jul 14 10:39:36.683429 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:39:36.683429 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:39:36.683429 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:39:36.683429 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:39:36.684210 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:39:36.684210 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:39:36.684210 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:39:36.684210 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:39:36.684210 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 10:39:36.684210 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 10:39:36.684210 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 10:39:36.684210 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 10:39:36.684210 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 10:39:36.684210 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 10:39:36.684210 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 14 10:39:36.684210 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application Jul 14 10:39:36.684210 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 188/388] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Jul 14 10:39:36 2022] GET /identity/v3/roles/member => generated 84 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:39:36.690759 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c94e83-5bda-4fee-89db-4b645457f14b None admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:36.703701 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d72849d-fd7f-4c9b-abb7-3caf2a72a97c None admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:36.756519 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=100 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:39:36.763020 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f55385-714b-409b-a6e3-099fc9483d9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:36.764510 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f55385-714b-409b-a6e3-099fc9483d9d None admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:36.765015 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f55385-714b-409b-a6e3-099fc9483d9d None admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:36.765485 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f55385-714b-409b-a6e3-099fc9483d9d None admin] PATH_INFO: `/v3/projects/3d3a37cd8fb044539b71f6202165da75` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:36.769530 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f55385-714b-409b-a6e3-099fc9483d9d None admin] RBAC: Authorizing `identity:get_project(project_id=3d3a37cd8fb044539b71f6202165da75)` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:39:36.771277 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f55385-714b-409b-a6e3-099fc9483d9d None admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:39:36.773692 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 201/389] 10.222.0.16 () {56 vars in 1186 bytes} [Thu Jul 14 10:39:36 2022] GET /identity/v3/projects/3d3a37cd8fb044539b71f6202165da75 => generated 298 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 10:39:36.779013 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f55385-714b-409b-a6e3-099fc9483d9d None admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:36.852817 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c94e83-5bda-4fee-89db-4b645457f14b None admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:36.915036 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ccd3f87-20c3-4354-bfcd-49d5c5495b4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:36.916135 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccd3f87-20c3-4354-bfcd-49d5c5495b4d None admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:36.916571 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccd3f87-20c3-4354-bfcd-49d5c5495b4d None admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:36.917041 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccd3f87-20c3-4354-bfcd-49d5c5495b4d None admin] PATH_INFO: `/v3/roles` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:36.917971 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ccd3f87-20c3-4354-bfcd-49d5c5495b4d None admin] RBAC: Adding query filter params (name=member) {{(pid=86655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:39:36.918439 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ccd3f87-20c3-4354-bfcd-49d5c5495b4d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:39:36.919988 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ccd3f87-20c3-4354-bfcd-49d5c5495b4d None admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:39:36.930281 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 189/390] 10.222.0.16 () {56 vars in 1101 bytes} [Thu Jul 14 10:39:36 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:39:36.938084 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ccd3f87-20c3-4354-bfcd-49d5c5495b4d None admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:36.980574 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f55385-714b-409b-a6e3-099fc9483d9d None admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:37.049993 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fa798b-188b-44dd-88b0-dc98d019e5e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:37.051162 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fa798b-188b-44dd-88b0-dc98d019e5e5 None admin] REQUEST_METHOD: `PUT` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:37.054290 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fa798b-188b-44dd-88b0-dc98d019e5e5 None admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:37.054730 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fa798b-188b-44dd-88b0-dc98d019e5e5 None admin] PATH_INFO: `/v3/projects/3d3a37cd8fb044539b71f6202165da75/groups/c5074ffbaa514049890530146c069ba8/roles/64ec6989f4724a8ab1e32d37c186c8f8` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:37.057685 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8fa798b-188b-44dd-88b0-dc98d019e5e5 None admin] RBAC: Authorizing `identity:create_grant(project_id=3d3a37cd8fb044539b71f6202165da75, group_id=c5074ffbaa514049890530146c069ba8, role_id=64ec6989f4724a8ab1e32d37c186c8f8)` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:39:37.060408 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8fa798b-188b-44dd-88b0-dc98d019e5e5 None admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:39:37.069498 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:39:37.088231 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 202/391] 10.222.0.16 () {58 vars in 1442 bytes} [Thu Jul 14 10:39:36 2022] PUT /identity/v3/projects/3d3a37cd8fb044539b71f6202165da75/groups/c5074ffbaa514049890530146c069ba8/roles/64ec6989f4724a8ab1e32d37c186c8f8 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 10:39:37.111400 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ccd3f87-20c3-4354-bfcd-49d5c5495b4d None admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:37.134571 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=100 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:39:37.163257 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5537bf-4180-45dc-9d39-9d735a2d4f44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:37.164214 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5537bf-4180-45dc-9d39-9d735a2d4f44 None admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:37.164742 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5537bf-4180-45dc-9d39-9d735a2d4f44 None admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:37.165487 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5537bf-4180-45dc-9d39-9d735a2d4f44 None admin] PATH_INFO: `/v3/groups/c5074ffbaa514049890530146c069ba8` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:37.167518 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5537bf-4180-45dc-9d39-9d735a2d4f44 None admin] RBAC: Authorizing `identity:get_group(group_id=c5074ffbaa514049890530146c069ba8)` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:39:37.169023 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5537bf-4180-45dc-9d39-9d735a2d4f44 None admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:39:37.171174 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 190/392] 10.222.0.16 () {56 vars in 1180 bytes} [Thu Jul 14 10:39:36 2022] GET /identity/v3/groups/c5074ffbaa514049890530146c069ba8 => generated 226 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 10:39:37.178100 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fa798b-188b-44dd-88b0-dc98d019e5e5 None admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:37.208981 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21149d1f-1154-4054-b9bc-265bfe2ec82c None None] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:37.209386 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21149d1f-1154-4054-b9bc-265bfe2ec82c None None] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:37.209723 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21149d1f-1154-4054-b9bc-265bfe2ec82c None None] PATH_INFO: `/` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:37.211456 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 191/393] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jul 14 10:39:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:39:37.218554 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1ad37e-2c1d-4964-be5d-8f5af22f586b None None] REQUEST_METHOD: `POST` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:37.218841 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1ad37e-2c1d-4964-be5d-8f5af22f586b None None] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:37.219119 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1ad37e-2c1d-4964-be5d-8f5af22f586b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:37.238924 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.auth.core [None req-3f1ad37e-2c1d-4964-be5d-8f5af22f586b None None] MFA Rules not processed for user `ae4bcdd8106d4bebbdcae96be33505bc`. Rule list: `[]` (Enabled: `True`). {{(pid=86655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:39:37.240305 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-3f1ad37e-2c1d-4964-be5d-8f5af22f586b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:39:37.325925 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 192/394] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jul 14 10:39:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 14 10:39:37.332521 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fa798b-188b-44dd-88b0-dc98d019e5e5 None admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:37.349504 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1ad37e-2c1d-4964-be5d-8f5af22f586b None None] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:37.382309 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730bad0b-f3fe-4709-9763-ea2d6e31156c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:37.383192 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730bad0b-f3fe-4709-9763-ea2d6e31156c None admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:37.383527 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730bad0b-f3fe-4709-9763-ea2d6e31156c None admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:37.383767 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730bad0b-f3fe-4709-9763-ea2d6e31156c None admin] PATH_INFO: `/v3/projects/3d3a37cd8fb044539b71f6202165da75` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:37.385168 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730bad0b-f3fe-4709-9763-ea2d6e31156c None admin] RBAC: Authorizing `identity:get_project(project_id=3d3a37cd8fb044539b71f6202165da75)` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:39:37.386759 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730bad0b-f3fe-4709-9763-ea2d6e31156c None admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:39:37.388982 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 203/395] 10.222.0.16 () {56 vars in 1186 bytes} [Thu Jul 14 10:39:37 2022] GET /identity/v3/projects/3d3a37cd8fb044539b71f6202165da75 => generated 298 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:39:37.396832 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730bad0b-f3fe-4709-9763-ea2d6e31156c None admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:37.471324 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=100 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:39:37.484663 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1ad37e-2c1d-4964-be5d-8f5af22f586b None None] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:37.498907 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=100 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:39:37.524203 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a046c93-8175-46f4-a7eb-e8901f621aef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:37.525418 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a046c93-8175-46f4-a7eb-e8901f621aef None admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:37.525852 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a046c93-8175-46f4-a7eb-e8901f621aef None admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:37.526317 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a046c93-8175-46f4-a7eb-e8901f621aef None admin] PATH_INFO: `/v3/roles/member` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:37.527977 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730bad0b-f3fe-4709-9763-ea2d6e31156c None admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:37.538075 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a046c93-8175-46f4-a7eb-e8901f621aef None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 10:39:37.546588 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application [None req-2a046c93-8175-46f4-a7eb-e8901f621aef None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 14 10:39:37.546588 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:39:37.546588 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:39:37.546588 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:39:37.546588 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:39:37.546588 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:39:37.546588 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:39:37.546588 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:39:37.546588 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:39:37.546588 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:39:37.546588 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:39:37.546588 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:39:37.546588 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 10:39:37.546588 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 10:39:37.546588 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 10:39:37.546588 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 10:39:37.547441 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 10:39:37.547441 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 10:39:37.547441 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 10:39:37.547441 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 10:39:37.547441 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:39:37.547441 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:39:37.547441 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:39:37.547441 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:39:37.547441 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:39:37.547441 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:39:37.547441 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:39:37.547441 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application with Lock( Jul 14 10:39:37.547441 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:39:37.547441 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:39:37.547441 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:39:37.547441 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:39:37.548888 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:39:37.548888 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:39:37.548888 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:39:37.548888 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:39:37.548888 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 10:39:37.548888 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 10:39:37.548888 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 10:39:37.548888 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 10:39:37.548888 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 10:39:37.548888 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 10:39:37.548888 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 14 10:39:37.548888 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application Jul 14 10:39:37.551717 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 193/396] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Jul 14 10:39:37 2022] GET /identity/v3/roles/member => generated 84 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:39:37.557573 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a046c93-8175-46f4-a7eb-e8901f621aef None admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:37.598213 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12558bbc-eb8a-4707-a608-d6272ca9a4f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:37.599115 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12558bbc-eb8a-4707-a608-d6272ca9a4f2 None admin] REQUEST_METHOD: `PUT` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:37.599410 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12558bbc-eb8a-4707-a608-d6272ca9a4f2 None admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:37.599695 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12558bbc-eb8a-4707-a608-d6272ca9a4f2 None admin] PATH_INFO: `/v3/projects/3d3a37cd8fb044539b71f6202165da75/groups/c5074ffbaa514049890530146c069ba8/roles/0da46c267d354cce81495dfdd56c1ec2` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:37.606254 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12558bbc-eb8a-4707-a608-d6272ca9a4f2 None admin] RBAC: Authorizing `identity:create_grant(project_id=3d3a37cd8fb044539b71f6202165da75, group_id=c5074ffbaa514049890530146c069ba8, role_id=0da46c267d354cce81495dfdd56c1ec2)` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:39:37.607780 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12558bbc-eb8a-4707-a608-d6272ca9a4f2 None admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:39:37.641580 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 204/397] 10.222.0.16 () {58 vars in 1442 bytes} [Thu Jul 14 10:39:37 2022] PUT /identity/v3/projects/3d3a37cd8fb044539b71f6202165da75/groups/c5074ffbaa514049890530146c069ba8/roles/0da46c267d354cce81495dfdd56c1ec2 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:39:37.703018 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a046c93-8175-46f4-a7eb-e8901f621aef None admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:37.742578 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fd465d-16e8-4f9f-bdf7-a968ddbd58ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:37.743643 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fd465d-16e8-4f9f-bdf7-a968ddbd58ca None admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:37.744148 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fd465d-16e8-4f9f-bdf7-a968ddbd58ca None admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:37.744638 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fd465d-16e8-4f9f-bdf7-a968ddbd58ca None admin] PATH_INFO: `/v3/roles` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:37.749943 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7fd465d-16e8-4f9f-bdf7-a968ddbd58ca None admin] RBAC: Adding query filter params (name=member) {{(pid=86655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:39:37.750569 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7fd465d-16e8-4f9f-bdf7-a968ddbd58ca None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:39:37.752856 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7fd465d-16e8-4f9f-bdf7-a968ddbd58ca None admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:39:37.764158 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 194/398] 10.222.0.16 () {56 vars in 1101 bytes} [Thu Jul 14 10:39:37 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 10:39:37.773957 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12558bbc-eb8a-4707-a608-d6272ca9a4f2 None admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:37.901601 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12558bbc-eb8a-4707-a608-d6272ca9a4f2 None admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:37.927653 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:39:37.947212 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459ac71a-46bf-4a30-9ad4-89a840748f0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:37.948082 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459ac71a-46bf-4a30-9ad4-89a840748f0d None admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:37.948368 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459ac71a-46bf-4a30-9ad4-89a840748f0d None admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:37.948648 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459ac71a-46bf-4a30-9ad4-89a840748f0d None admin] PATH_INFO: `/v3/groups/c5074ffbaa514049890530146c069ba8` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:37.949866 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459ac71a-46bf-4a30-9ad4-89a840748f0d None admin] RBAC: Authorizing `identity:get_group(group_id=c5074ffbaa514049890530146c069ba8)` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:39:37.951307 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459ac71a-46bf-4a30-9ad4-89a840748f0d None admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:39:37.952990 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 205/399] 10.222.0.16 () {56 vars in 1180 bytes} [Thu Jul 14 10:39:37 2022] GET /identity/v3/groups/c5074ffbaa514049890530146c069ba8 => generated 226 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:39:37.958889 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fd465d-16e8-4f9f-bdf7-a968ddbd58ca None admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:38.005940 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=100 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:39:38.086847 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fd465d-16e8-4f9f-bdf7-a968ddbd58ca None admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:38.122810 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b060efd-cefb-4609-b449-a515b87afdf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:38.123686 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b060efd-cefb-4609-b449-a515b87afdf4 None admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:38.123973 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b060efd-cefb-4609-b449-a515b87afdf4 None admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:38.124251 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b060efd-cefb-4609-b449-a515b87afdf4 None admin] PATH_INFO: `/v3/projects/e3cf5b002a1c43f7a02696ed092318ca` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:38.125494 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b060efd-cefb-4609-b449-a515b87afdf4 None admin] RBAC: Authorizing `identity:get_project(project_id=e3cf5b002a1c43f7a02696ed092318ca)` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:39:38.127025 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b060efd-cefb-4609-b449-a515b87afdf4 None admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:39:38.128965 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 195/400] 10.222.0.16 () {56 vars in 1186 bytes} [Thu Jul 14 10:39:37 2022] GET /identity/v3/projects/e3cf5b002a1c43f7a02696ed092318ca => generated 302 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:39:38.134655 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459ac71a-46bf-4a30-9ad4-89a840748f0d None admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:38.253603 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ac66a5-0325-4ea4-87ba-c70023560c2d None None] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:38.253925 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ac66a5-0325-4ea4-87ba-c70023560c2d None None] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:38.254173 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ac66a5-0325-4ea4-87ba-c70023560c2d None None] PATH_INFO: `/` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:38.256461 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 196/401] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jul 14 10:39:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:39:38.261964 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6d9ea6-4cdc-4afb-bfc9-2ed785dcd136 None None] REQUEST_METHOD: `POST` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:38.262254 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6d9ea6-4cdc-4afb-bfc9-2ed785dcd136 None None] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:38.262532 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6d9ea6-4cdc-4afb-bfc9-2ed785dcd136 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:38.272150 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459ac71a-46bf-4a30-9ad4-89a840748f0d None admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:38.297131 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.auth.core [None req-8f6d9ea6-4cdc-4afb-bfc9-2ed785dcd136 None None] MFA Rules not processed for user `ae4bcdd8106d4bebbdcae96be33505bc`. Rule list: `[]` (Enabled: `True`). {{(pid=86655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:39:38.299189 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-8f6d9ea6-4cdc-4afb-bfc9-2ed785dcd136 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:39:38.352555 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56287d74-1a6a-4dc0-83aa-0bea3e348c71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:38.354416 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56287d74-1a6a-4dc0-83aa-0bea3e348c71 None admin] REQUEST_METHOD: `PUT` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:38.355097 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56287d74-1a6a-4dc0-83aa-0bea3e348c71 None admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:38.356227 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56287d74-1a6a-4dc0-83aa-0bea3e348c71 None admin] PATH_INFO: `/v3/projects/e3cf5b002a1c43f7a02696ed092318ca/groups/c5074ffbaa514049890530146c069ba8/roles/0da46c267d354cce81495dfdd56c1ec2` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:38.359798 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56287d74-1a6a-4dc0-83aa-0bea3e348c71 None admin] RBAC: Authorizing `identity:create_grant(project_id=e3cf5b002a1c43f7a02696ed092318ca, group_id=c5074ffbaa514049890530146c069ba8, role_id=0da46c267d354cce81495dfdd56c1ec2)` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:39:38.362427 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56287d74-1a6a-4dc0-83aa-0bea3e348c71 None admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:39:38.396560 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 206/402] 10.222.0.16 () {58 vars in 1442 bytes} [Thu Jul 14 10:39:38 2022] PUT /identity/v3/projects/e3cf5b002a1c43f7a02696ed092318ca/groups/c5074ffbaa514049890530146c069ba8/roles/0da46c267d354cce81495dfdd56c1ec2 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:39:38.421019 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 197/403] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jul 14 10:39:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 14 10:39:38.452144 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56287d74-1a6a-4dc0-83aa-0bea3e348c71 None admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:38.533268 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:39:38.607855 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56287d74-1a6a-4dc0-83aa-0bea3e348c71 None admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:38.650648 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6915bfbb-76eb-4ddb-9851-f63a568705ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:38.651474 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6915bfbb-76eb-4ddb-9851-f63a568705ca None admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:38.651999 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6915bfbb-76eb-4ddb-9851-f63a568705ca None admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:38.652285 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6915bfbb-76eb-4ddb-9851-f63a568705ca None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:38.668907 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6915bfbb-76eb-4ddb-9851-f63a568705ca None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 10:39:38.677188 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application [None req-6915bfbb-76eb-4ddb-9851-f63a568705ca None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 14 10:39:38.677188 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:39:38.677188 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:39:38.677188 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:39:38.677188 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:39:38.677188 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:39:38.677188 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:39:38.677188 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:39:38.677188 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:39:38.677188 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:39:38.677188 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:39:38.677188 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:39:38.677188 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 10:39:38.677188 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 10:39:38.677188 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 10:39:38.677188 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 10:39:38.678076 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 10:39:38.678076 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 10:39:38.678076 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 10:39:38.678076 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 10:39:38.678076 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:39:38.678076 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:39:38.678076 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:39:38.678076 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:39:38.678076 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:39:38.678076 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:39:38.678076 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:39:38.678076 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application with Lock( Jul 14 10:39:38.678076 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:39:38.678076 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:39:38.678076 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:39:38.678076 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:39:38.679296 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:39:38.679296 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:39:38.679296 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:39:38.679296 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:39:38.679296 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 10:39:38.679296 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 10:39:38.679296 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 10:39:38.679296 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 10:39:38.679296 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 10:39:38.679296 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 10:39:38.679296 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 14 10:39:38.679296 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application Jul 14 10:39:38.679296 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 207/404] 10.222.0.16 () {56 vars in 1114 bytes} [Thu Jul 14 10:39:38 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:39:38.686262 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6d9ea6-4cdc-4afb-bfc9-2ed785dcd136 None None] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:38.722940 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=100 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:39:38.807556 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6d9ea6-4cdc-4afb-bfc9-2ed785dcd136 None None] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:38.861861 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64d2e99-7571-4b71-b734-11158018b9ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:38.862895 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64d2e99-7571-4b71-b734-11158018b9ea None admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:38.863378 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64d2e99-7571-4b71-b734-11158018b9ea None admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:38.863873 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64d2e99-7571-4b71-b734-11158018b9ea None admin] PATH_INFO: `/v3/roles` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:38.864861 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64d2e99-7571-4b71-b734-11158018b9ea None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:39:38.865368 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64d2e99-7571-4b71-b734-11158018b9ea None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:39:38.866953 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64d2e99-7571-4b71-b734-11158018b9ea None admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:39:38.881463 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 198/405] 10.222.0.16 () {56 vars in 1111 bytes} [Thu Jul 14 10:39:38 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:39:38.886568 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6915bfbb-76eb-4ddb-9851-f63a568705ca None admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:38.895781 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a303a2-1484-4ccc-8dbb-993b0546ddcb None None] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:38.896062 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a303a2-1484-4ccc-8dbb-993b0546ddcb None None] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:38.896338 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a303a2-1484-4ccc-8dbb-993b0546ddcb None None] PATH_INFO: `/` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:38.902318 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 199/406] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jul 14 10:39:38 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 14 10:39:38.911286 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309bd8e0-feca-439c-9eea-cb9f7e19506d None None] REQUEST_METHOD: `POST` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:38.911565 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309bd8e0-feca-439c-9eea-cb9f7e19506d None None] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:38.911835 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309bd8e0-feca-439c-9eea-cb9f7e19506d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:38.942737 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.auth.core [None req-309bd8e0-feca-439c-9eea-cb9f7e19506d None None] MFA Rules not processed for user `ae4bcdd8106d4bebbdcae96be33505bc`. Rule list: `[]` (Enabled: `True`). {{(pid=86655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:39:38.944039 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-309bd8e0-feca-439c-9eea-cb9f7e19506d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:39:39.017223 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 200/407] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jul 14 10:39:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 10:39:39.040356 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309bd8e0-feca-439c-9eea-cb9f7e19506d None None] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:39.067738 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=100 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:39:39.124399 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6915bfbb-76eb-4ddb-9851-f63a568705ca None admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:39.147417 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=100 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:39:39.149497 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309bd8e0-feca-439c-9eea-cb9f7e19506d None None] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:39.187197 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe347c09-e7b9-40ec-a1a7-7bb02cb2d925 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:39.187990 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe347c09-e7b9-40ec-a1a7-7bb02cb2d925 None admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:39.188275 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe347c09-e7b9-40ec-a1a7-7bb02cb2d925 None admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:39.189122 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe347c09-e7b9-40ec-a1a7-7bb02cb2d925 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:39.201258 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe347c09-e7b9-40ec-a1a7-7bb02cb2d925 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 10:39:39.209859 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application [None req-fe347c09-e7b9-40ec-a1a7-7bb02cb2d925 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 10:39:39.209859 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:39:39.209859 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:39:39.209859 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:39:39.209859 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:39:39.209859 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:39:39.209859 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:39:39.209859 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:39:39.209859 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:39:39.209859 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:39:39.209859 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:39:39.209859 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:39:39.209859 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 10:39:39.209859 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 10:39:39.209859 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 10:39:39.209859 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 10:39:39.210763 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 10:39:39.210763 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 10:39:39.210763 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 10:39:39.210763 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 10:39:39.210763 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:39:39.210763 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:39:39.210763 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:39:39.210763 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:39:39.210763 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:39:39.210763 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:39:39.210763 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:39:39.210763 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application with Lock( Jul 14 10:39:39.210763 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:39:39.210763 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:39:39.210763 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:39:39.210763 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:39:39.212057 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:39:39.212057 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:39:39.212057 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:39:39.212057 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:39:39.212057 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 10:39:39.212057 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 10:39:39.212057 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 10:39:39.212057 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 10:39:39.212057 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 10:39:39.212057 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 10:39:39.212057 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 10:39:39.212057 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application Jul 14 10:39:39.212057 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 201/408] 10.222.0.16 () {56 vars in 1096 bytes} [Thu Jul 14 10:39:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 10:39:39.217357 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe347c09-e7b9-40ec-a1a7-7bb02cb2d925 None admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:39.225978 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64386652-4ed1-4396-a3af-7812eb91ad77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:39.227231 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64386652-4ed1-4396-a3af-7812eb91ad77 None admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:39.227760 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64386652-4ed1-4396-a3af-7812eb91ad77 None admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:39.228036 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64386652-4ed1-4396-a3af-7812eb91ad77 None admin] PATH_INFO: `/v3/groups/c5074ffbaa514049890530146c069ba8` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:39.229342 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64386652-4ed1-4396-a3af-7812eb91ad77 None admin] RBAC: Authorizing `identity:get_group(group_id=c5074ffbaa514049890530146c069ba8)` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:39:39.230810 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64386652-4ed1-4396-a3af-7812eb91ad77 None admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:39:39.232655 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 208/409] 10.222.0.16 () {56 vars in 1180 bytes} [Thu Jul 14 10:39:38 2022] GET /identity/v3/groups/c5074ffbaa514049890530146c069ba8 => generated 226 bytes in 346 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:39:39.238173 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64386652-4ed1-4396-a3af-7812eb91ad77 None admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:39.316884 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=100 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:39:39.336341 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe347c09-e7b9-40ec-a1a7-7bb02cb2d925 None admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:39.379862 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c9666e-74c3-4f78-84b3-8d3cba74d1c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:39.380543 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c9666e-74c3-4f78-84b3-8d3cba74d1c4 None admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:39.381044 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c9666e-74c3-4f78-84b3-8d3cba74d1c4 None admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:39.381324 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c9666e-74c3-4f78-84b3-8d3cba74d1c4 None admin] PATH_INFO: `/v3/roles` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:39.382085 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c9666e-74c3-4f78-84b3-8d3cba74d1c4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:39:39.382389 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c9666e-74c3-4f78-84b3-8d3cba74d1c4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:39:39.383766 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c9666e-74c3-4f78-84b3-8d3cba74d1c4 None admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:39:39.402095 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 202/410] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Jul 14 10:39:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 10:39:39.411576 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c9666e-74c3-4f78-84b3-8d3cba74d1c4 None admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:39.446406 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64386652-4ed1-4396-a3af-7812eb91ad77 None admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:39.502311 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba2c155-2fb7-46c0-86c6-5ba59f77e06f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:39.503195 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba2c155-2fb7-46c0-86c6-5ba59f77e06f None admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:39.503480 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba2c155-2fb7-46c0-86c6-5ba59f77e06f None admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:39.503759 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba2c155-2fb7-46c0-86c6-5ba59f77e06f None admin] PATH_INFO: `/v3/projects/e3cf5b002a1c43f7a02696ed092318ca` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:39.505009 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba2c155-2fb7-46c0-86c6-5ba59f77e06f None admin] RBAC: Authorizing `identity:get_project(project_id=e3cf5b002a1c43f7a02696ed092318ca)` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:39:39.506477 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba2c155-2fb7-46c0-86c6-5ba59f77e06f None admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:39:39.508513 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 209/411] 10.222.0.16 () {56 vars in 1186 bytes} [Thu Jul 14 10:39:39 2022] GET /identity/v3/projects/e3cf5b002a1c43f7a02696ed092318ca => generated 302 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 10:39:39.513664 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba2c155-2fb7-46c0-86c6-5ba59f77e06f None admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:39.549795 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c9666e-74c3-4f78-84b3-8d3cba74d1c4 None admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:39.587664 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09b88a7-f228-4c43-bfb7-c22a1e5fda90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:39.588454 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09b88a7-f228-4c43-bfb7-c22a1e5fda90 None admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:39.588741 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09b88a7-f228-4c43-bfb7-c22a1e5fda90 None admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:39.589043 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09b88a7-f228-4c43-bfb7-c22a1e5fda90 None admin] PATH_INFO: `/v3/groups/da205123caaa4fb8ae8fb3221a99daef` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:39.590295 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=100 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:39:39.591365 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09b88a7-f228-4c43-bfb7-c22a1e5fda90 None admin] RBAC: Authorizing `identity:get_group(group_id=da205123caaa4fb8ae8fb3221a99daef)` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:39:39.592997 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09b88a7-f228-4c43-bfb7-c22a1e5fda90 None admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:39:39.596044 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 203/412] 10.222.0.16 () {56 vars in 1180 bytes} [Thu Jul 14 10:39:39 2022] GET /identity/v3/groups/da205123caaa4fb8ae8fb3221a99daef => generated 229 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:39:39.602658 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09b88a7-f228-4c43-bfb7-c22a1e5fda90 None admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:39.639095 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=100 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:39:39.692721 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba2c155-2fb7-46c0-86c6-5ba59f77e06f None admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:39.757090 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cc9e90-b376-4a93-a205-c97dfabdf038 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:39.758339 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cc9e90-b376-4a93-a205-c97dfabdf038 None admin] REQUEST_METHOD: `PUT` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:39.759394 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cc9e90-b376-4a93-a205-c97dfabdf038 None admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:39.759890 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cc9e90-b376-4a93-a205-c97dfabdf038 None admin] PATH_INFO: `/v3/projects/e3cf5b002a1c43f7a02696ed092318ca/groups/c5074ffbaa514049890530146c069ba8/roles/64ec6989f4724a8ab1e32d37c186c8f8` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:39.762391 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46cc9e90-b376-4a93-a205-c97dfabdf038 None admin] RBAC: Authorizing `identity:create_grant(project_id=e3cf5b002a1c43f7a02696ed092318ca, group_id=c5074ffbaa514049890530146c069ba8, role_id=64ec6989f4724a8ab1e32d37c186c8f8)` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:39:39.764041 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46cc9e90-b376-4a93-a205-c97dfabdf038 None admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:39:39.790305 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 210/413] 10.222.0.16 () {58 vars in 1442 bytes} [Thu Jul 14 10:39:39 2022] PUT /identity/v3/projects/e3cf5b002a1c43f7a02696ed092318ca/groups/c5074ffbaa514049890530146c069ba8/roles/64ec6989f4724a8ab1e32d37c186c8f8 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:39:39.829302 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09b88a7-f228-4c43-bfb7-c22a1e5fda90 None admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:39.889450 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c5725d-36db-4e38-a07e-e13cb1a3215f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:39.890247 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c5725d-36db-4e38-a07e-e13cb1a3215f None admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:39.890534 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c5725d-36db-4e38-a07e-e13cb1a3215f None admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:39.890811 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c5725d-36db-4e38-a07e-e13cb1a3215f None admin] PATH_INFO: `/v3/projects/7a2b7c1edcba4e118452f92cb83ff4b2` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:39.897687 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c5725d-36db-4e38-a07e-e13cb1a3215f None admin] RBAC: Authorizing `identity:get_project(project_id=7a2b7c1edcba4e118452f92cb83ff4b2)` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:39:39.899179 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c5725d-36db-4e38-a07e-e13cb1a3215f None admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:39:39.901341 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 204/414] 10.222.0.16 () {56 vars in 1186 bytes} [Thu Jul 14 10:39:39 2022] GET /identity/v3/projects/7a2b7c1edcba4e118452f92cb83ff4b2 => generated 344 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 10:39:39.906856 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cc9e90-b376-4a93-a205-c97dfabdf038 None admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:39.981694 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cef848-85f0-4744-848c-93d0fd911bcc None None] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:39.981985 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cef848-85f0-4744-848c-93d0fd911bcc None None] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:39.982293 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cef848-85f0-4744-848c-93d0fd911bcc None None] PATH_INFO: `/` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:39.983872 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 205/415] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jul 14 10:39:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:39:39.991769 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54eee075-6f43-4b10-a918-1731c70b81a3 None None] REQUEST_METHOD: `POST` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:39.992301 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54eee075-6f43-4b10-a918-1731c70b81a3 None None] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:39.992728 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54eee075-6f43-4b10-a918-1731c70b81a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:40.013017 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.auth.core [None req-54eee075-6f43-4b10-a918-1731c70b81a3 None None] MFA Rules not processed for user `ae4bcdd8106d4bebbdcae96be33505bc`. Rule list: `[]` (Enabled: `True`). {{(pid=86655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:39:40.015394 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-54eee075-6f43-4b10-a918-1731c70b81a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:39:40.052284 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cc9e90-b376-4a93-a205-c97dfabdf038 None admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:40.064658 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:39:40.098607 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b5e18f-aa1e-4316-80a4-b3c862fb3e60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:40.099877 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b5e18f-aa1e-4316-80a4-b3c862fb3e60 None admin] REQUEST_METHOD: `PUT` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:40.100377 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b5e18f-aa1e-4316-80a4-b3c862fb3e60 None admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:40.100890 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b5e18f-aa1e-4316-80a4-b3c862fb3e60 None admin] PATH_INFO: `/v3/projects/7a2b7c1edcba4e118452f92cb83ff4b2/groups/da205123caaa4fb8ae8fb3221a99daef/roles/153539819e5542df99269d2913bbecfb` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:40.103160 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b5e18f-aa1e-4316-80a4-b3c862fb3e60 None admin] RBAC: Authorizing `identity:create_grant(project_id=7a2b7c1edcba4e118452f92cb83ff4b2, group_id=da205123caaa4fb8ae8fb3221a99daef, role_id=153539819e5542df99269d2913bbecfb)` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:39:40.103403 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 206/416] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jul 14 10:39:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 14 10:39:40.105211 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b5e18f-aa1e-4316-80a4-b3c862fb3e60 None admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:39:40.124151 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 211/417] 10.222.0.16 () {58 vars in 1442 bytes} [Thu Jul 14 10:39:39 2022] PUT /identity/v3/projects/7a2b7c1edcba4e118452f92cb83ff4b2/groups/da205123caaa4fb8ae8fb3221a99daef/roles/153539819e5542df99269d2913bbecfb => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:39:40.141285 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54eee075-6f43-4b10-a918-1731c70b81a3 None None] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:40.156299 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=100 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:39:40.266975 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54eee075-6f43-4b10-a918-1731c70b81a3 None None] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:40.309748 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5528100e-ab75-4b58-bd04-0483648d7950 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:40.310580 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5528100e-ab75-4b58-bd04-0483648d7950 None admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:40.310870 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5528100e-ab75-4b58-bd04-0483648d7950 None admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:40.311145 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5528100e-ab75-4b58-bd04-0483648d7950 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:40.324215 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5528100e-ab75-4b58-bd04-0483648d7950 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 10:39:40.332673 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application [None req-5528100e-ab75-4b58-bd04-0483648d7950 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 14 10:39:40.332673 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:39:40.332673 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:39:40.332673 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:39:40.332673 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:39:40.332673 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:39:40.332673 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:39:40.332673 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:39:40.332673 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:39:40.332673 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:39:40.332673 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:39:40.332673 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:39:40.332673 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 10:39:40.332673 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 10:39:40.332673 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 10:39:40.332673 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 10:39:40.333654 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 10:39:40.333654 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 10:39:40.333654 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 10:39:40.333654 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 10:39:40.333654 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:39:40.333654 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:39:40.333654 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:39:40.333654 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:39:40.333654 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:39:40.333654 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:39:40.333654 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:39:40.333654 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application with Lock( Jul 14 10:39:40.333654 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:39:40.333654 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:39:40.333654 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:39:40.333654 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:39:40.334421 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:39:40.334421 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:39:40.334421 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:39:40.334421 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:39:40.334421 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 10:39:40.334421 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 10:39:40.334421 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 10:39:40.334421 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 10:39:40.334421 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 10:39:40.334421 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 10:39:40.334421 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 14 10:39:40.334421 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application Jul 14 10:39:40.334421 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 207/418] 10.222.0.16 () {56 vars in 1114 bytes} [Thu Jul 14 10:39:40 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:39:40.342993 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b5e18f-aa1e-4316-80a4-b3c862fb3e60 None admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:40.453301 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b5e18f-aa1e-4316-80a4-b3c862fb3e60 None admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:40.491097 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab58b17-954c-4528-8e1e-86fc7807de4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:40.491783 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab58b17-954c-4528-8e1e-86fc7807de4e None admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:40.492072 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab58b17-954c-4528-8e1e-86fc7807de4e None admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:40.492351 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab58b17-954c-4528-8e1e-86fc7807de4e None admin] PATH_INFO: `/v3/roles` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:40.493138 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab58b17-954c-4528-8e1e-86fc7807de4e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:39:40.493453 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab58b17-954c-4528-8e1e-86fc7807de4e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:39:40.494840 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab58b17-954c-4528-8e1e-86fc7807de4e None admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:39:40.507601 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 212/419] 10.222.0.16 () {56 vars in 1111 bytes} [Thu Jul 14 10:39:40 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:39:40.513040 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5528100e-ab75-4b58-bd04-0483648d7950 None admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:40.646051 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=100 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:39:40.663300 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc215097-f155-4fce-b215-967c87ab95c4 None None] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:40.663603 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc215097-f155-4fce-b215-967c87ab95c4 None None] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:40.663877 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc215097-f155-4fce-b215-967c87ab95c4 None None] PATH_INFO: `/` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:40.665504 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 213/420] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jul 14 10:39:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:39:40.670438 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31f22e9-65ec-4e59-94e5-2804ff07c68e None None] REQUEST_METHOD: `POST` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:40.670728 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31f22e9-65ec-4e59-94e5-2804ff07c68e None None] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:40.671011 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31f22e9-65ec-4e59-94e5-2804ff07c68e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:40.698703 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5528100e-ab75-4b58-bd04-0483648d7950 None admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:40.700662 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.auth.core [None req-d31f22e9-65ec-4e59-94e5-2804ff07c68e None None] MFA Rules not processed for user `ae4bcdd8106d4bebbdcae96be33505bc`. Rule list: `[]` (Enabled: `True`). {{(pid=86656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:39:40.701901 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-d31f22e9-65ec-4e59-94e5-2804ff07c68e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:39:40.749026 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c14a10-110d-41e9-b8ec-665e609ecc3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:40.749275 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:39:40.750377 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c14a10-110d-41e9-b8ec-665e609ecc3f None admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:40.751316 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c14a10-110d-41e9-b8ec-665e609ecc3f None admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:40.751816 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c14a10-110d-41e9-b8ec-665e609ecc3f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:40.826620 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c14a10-110d-41e9-b8ec-665e609ecc3f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:39:40.828318 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c14a10-110d-41e9-b8ec-665e609ecc3f None admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:39:40.856092 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 214/421] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jul 14 10:39:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 14 10:39:40.928325 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=100 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:39:40.932078 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31f22e9-65ec-4e59-94e5-2804ff07c68e None None] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:40.961439 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 208/422] 10.222.0.16 () {58 vars in 1282 bytes} [Thu Jul 14 10:39:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 449 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 10:39:40.971147 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c14a10-110d-41e9-b8ec-665e609ecc3f None admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:41.094187 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31f22e9-65ec-4e59-94e5-2804ff07c68e None None] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:41.146178 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c14b1d-a292-4e37-bb96-8e9d1c4e2959 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:41.146989 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c14b1d-a292-4e37-bb96-8e9d1c4e2959 None admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:41.147272 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c14b1d-a292-4e37-bb96-8e9d1c4e2959 None admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:41.147549 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c14b1d-a292-4e37-bb96-8e9d1c4e2959 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:41.169700 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c14b1d-a292-4e37-bb96-8e9d1c4e2959 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 10:39:41.178223 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application [None req-99c14b1d-a292-4e37-bb96-8e9d1c4e2959 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 14 10:39:41.178223 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:39:41.178223 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:39:41.178223 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:39:41.178223 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:39:41.178223 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:39:41.178223 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:39:41.178223 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:39:41.178223 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:39:41.178223 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:39:41.178223 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:39:41.178223 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:39:41.178223 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 10:39:41.178223 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 10:39:41.178223 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 10:39:41.178223 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 10:39:41.179119 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 10:39:41.179119 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 10:39:41.179119 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 10:39:41.179119 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 10:39:41.179119 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:39:41.179119 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:39:41.179119 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:39:41.179119 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:39:41.179119 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:39:41.179119 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:39:41.179119 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:39:41.179119 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application with Lock( Jul 14 10:39:41.179119 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:39:41.179119 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:39:41.179119 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:39:41.179119 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:39:41.179909 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:39:41.179909 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:39:41.179909 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:39:41.179909 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:39:41.179909 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 10:39:41.179909 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 10:39:41.179909 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 10:39:41.179909 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 10:39:41.179909 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 10:39:41.179909 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 10:39:41.179909 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 14 10:39:41.179909 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application Jul 14 10:39:41.179909 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 215/423] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Jul 14 10:39:40 2022] GET /identity/v3/roles/member => generated 84 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:39:41.185669 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c14b1d-a292-4e37-bb96-8e9d1c4e2959 None admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:41.213174 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=100 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:39:41.221540 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c14a10-110d-41e9-b8ec-665e609ecc3f None admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:41.260366 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fd756d-2f14-4b01-bfb0-1bc7e6e99f5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:41.261273 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fd756d-2f14-4b01-bfb0-1bc7e6e99f5d None admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:41.261556 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fd756d-2f14-4b01-bfb0-1bc7e6e99f5d None admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:41.261830 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fd756d-2f14-4b01-bfb0-1bc7e6e99f5d None admin] PATH_INFO: `/v3/projects/3d3a37cd8fb044539b71f6202165da75` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:41.263154 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72fd756d-2f14-4b01-bfb0-1bc7e6e99f5d None admin] RBAC: Authorizing `identity:get_project(project_id=3d3a37cd8fb044539b71f6202165da75)` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:39:41.264735 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72fd756d-2f14-4b01-bfb0-1bc7e6e99f5d None admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:39:41.267492 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 209/424] 10.222.0.16 () {56 vars in 1186 bytes} [Thu Jul 14 10:39:40 2022] GET /identity/v3/projects/3d3a37cd8fb044539b71f6202165da75 => generated 298 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:39:41.274784 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fd756d-2f14-4b01-bfb0-1bc7e6e99f5d None admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:41.327525 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c14b1d-a292-4e37-bb96-8e9d1c4e2959 None admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:41.345519 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=100 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:39:41.366979 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e997b8f5-e35a-469c-9ff2-d6ea40ba656a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:41.367781 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e997b8f5-e35a-469c-9ff2-d6ea40ba656a None admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:41.368181 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e997b8f5-e35a-469c-9ff2-d6ea40ba656a None admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:41.368563 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e997b8f5-e35a-469c-9ff2-d6ea40ba656a None admin] PATH_INFO: `/v3/roles` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:41.369509 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e997b8f5-e35a-469c-9ff2-d6ea40ba656a None admin] RBAC: Adding query filter params (name=member) {{(pid=86656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:39:41.370041 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e997b8f5-e35a-469c-9ff2-d6ea40ba656a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:39:41.371662 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e997b8f5-e35a-469c-9ff2-d6ea40ba656a None admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:39:41.382551 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 216/425] 10.222.0.16 () {56 vars in 1101 bytes} [Thu Jul 14 10:39:41 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:39:41.388484 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd63ff71-5021-443d-97f2-8fe9a99ed360 None None] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:41.388907 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd63ff71-5021-443d-97f2-8fe9a99ed360 None None] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:41.389288 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd63ff71-5021-443d-97f2-8fe9a99ed360 None None] PATH_INFO: `/` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:41.390832 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 217/426] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jul 14 10:39:41 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:39:41.392087 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd63ff71-5021-443d-97f2-8fe9a99ed360 None None] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:41.411408 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fd756d-2f14-4b01-bfb0-1bc7e6e99f5d None admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:41.462865 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e16f6c-47e7-417d-aa6f-7e07df446b6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:41.463957 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e16f6c-47e7-417d-aa6f-7e07df446b6c None admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:41.464413 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e16f6c-47e7-417d-aa6f-7e07df446b6c None admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:41.465070 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e16f6c-47e7-417d-aa6f-7e07df446b6c None admin] PATH_INFO: `/v3/groups/c5074ffbaa514049890530146c069ba8` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:41.466881 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e16f6c-47e7-417d-aa6f-7e07df446b6c None admin] RBAC: Authorizing `identity:get_group(group_id=c5074ffbaa514049890530146c069ba8)` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:39:41.468928 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e16f6c-47e7-417d-aa6f-7e07df446b6c None admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:39:41.471864 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 210/427] 10.222.0.16 () {56 vars in 1180 bytes} [Thu Jul 14 10:39:41 2022] GET /identity/v3/groups/c5074ffbaa514049890530146c069ba8 => generated 226 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:39:41.473441 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5758ecc1-8090-4f90-92e9-8ffc47d2aa46 None None] REQUEST_METHOD: `POST` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:41.473866 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5758ecc1-8090-4f90-92e9-8ffc47d2aa46 None None] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:41.474286 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5758ecc1-8090-4f90-92e9-8ffc47d2aa46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:41.484202 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=100 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:39:41.495939 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.auth.core [None req-5758ecc1-8090-4f90-92e9-8ffc47d2aa46 None None] MFA Rules not processed for user `ae4bcdd8106d4bebbdcae96be33505bc`. Rule list: `[]` (Enabled: `True`). {{(pid=86655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:39:41.497167 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-5758ecc1-8090-4f90-92e9-8ffc47d2aa46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:39:41.512104 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd63ff71-5021-443d-97f2-8fe9a99ed360 None None] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:41.550014 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be80a72-7cee-490d-a5ed-2aa3d9e1161c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:41.550706 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be80a72-7cee-490d-a5ed-2aa3d9e1161c None admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:41.551002 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be80a72-7cee-490d-a5ed-2aa3d9e1161c None admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:41.551279 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be80a72-7cee-490d-a5ed-2aa3d9e1161c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:41.589622 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 211/428] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jul 14 10:39:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 10:39:41.590849 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5758ecc1-8090-4f90-92e9-8ffc47d2aa46 None None] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:41.631129 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be80a72-7cee-490d-a5ed-2aa3d9e1161c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:39:41.633947 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be80a72-7cee-490d-a5ed-2aa3d9e1161c None admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:39:41.645232 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=100 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:39:41.725702 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5758ecc1-8090-4f90-92e9-8ffc47d2aa46 None None] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:41.729148 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=100 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:39:41.739449 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 218/429] 10.222.0.16 () {58 vars in 1282 bytes} [Thu Jul 14 10:39:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 10:39:41.740085 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be80a72-7cee-490d-a5ed-2aa3d9e1161c None admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:41.770312 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e29ba3-6ff4-43a3-9934-9d679d88afd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:41.770978 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e29ba3-6ff4-43a3-9934-9d679d88afd3 None admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:41.771262 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e29ba3-6ff4-43a3-9934-9d679d88afd3 None admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:41.771539 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e29ba3-6ff4-43a3-9934-9d679d88afd3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:41.772384 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e29ba3-6ff4-43a3-9934-9d679d88afd3 None admin] RBAC: Adding query filter params (group.id=c5074ffbaa514049890530146c069ba8, role.id=64ec6989f4724a8ab1e32d37c186c8f8, scope.project.id=3d3a37cd8fb044539b71f6202165da75) {{(pid=86655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:39:41.772696 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e29ba3-6ff4-43a3-9934-9d679d88afd3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:39:41.774143 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e29ba3-6ff4-43a3-9934-9d679d88afd3 None admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:39:41.792811 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 212/430] 10.222.0.16 () {56 vars in 1376 bytes} [Thu Jul 14 10:39:41 2022] GET /identity/v3/role_assignments?group.id=c5074ffbaa514049890530146c069ba8&scope.project.id=3d3a37cd8fb044539b71f6202165da75&role.id=64ec6989f4724a8ab1e32d37c186c8f8 => generated 611 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:39:41.792811 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e29ba3-6ff4-43a3-9934-9d679d88afd3 None admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:41.935557 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be80a72-7cee-490d-a5ed-2aa3d9e1161c None admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:41.991992 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e29ba3-6ff4-43a3-9934-9d679d88afd3 None admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:41.993492 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=100 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:39:42.001525 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd24964-bbf8-432b-9a77-376b585ada98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:42.003799 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd24964-bbf8-432b-9a77-376b585ada98 None admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:42.004285 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd24964-bbf8-432b-9a77-376b585ada98 None admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:42.004821 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd24964-bbf8-432b-9a77-376b585ada98 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:42.017237 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd24964-bbf8-432b-9a77-376b585ada98 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 10:39:42.025832 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application [None req-1bd24964-bbf8-432b-9a77-376b585ada98 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 14 10:39:42.025832 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:39:42.025832 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:39:42.025832 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:39:42.025832 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:39:42.025832 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:39:42.025832 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:39:42.025832 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:39:42.025832 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:39:42.025832 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:39:42.025832 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:39:42.025832 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:39:42.025832 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 10:39:42.025832 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 10:39:42.025832 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 10:39:42.025832 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 10:39:42.026708 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 10:39:42.026708 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 10:39:42.026708 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 10:39:42.026708 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 10:39:42.026708 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:39:42.026708 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:39:42.026708 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:39:42.026708 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:39:42.026708 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:39:42.026708 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:39:42.026708 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:39:42.026708 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application with Lock( Jul 14 10:39:42.026708 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:39:42.026708 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:39:42.026708 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:39:42.026708 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:39:42.027475 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:39:42.027475 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:39:42.027475 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:39:42.027475 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:39:42.027475 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 10:39:42.027475 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 10:39:42.027475 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 10:39:42.027475 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 10:39:42.027475 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 10:39:42.027475 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 10:39:42.027475 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 14 10:39:42.027475 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application Jul 14 10:39:42.030752 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 219/431] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Jul 14 10:39:41 2022] GET /identity/v3/roles/member => generated 84 bytes in 291 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:39:42.037787 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd24964-bbf8-432b-9a77-376b585ada98 None admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:42.038250 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f120dca2-a604-4533-903f-35e297e61809 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:42.039131 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f120dca2-a604-4533-903f-35e297e61809 None admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:42.039422 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f120dca2-a604-4533-903f-35e297e61809 None admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:42.039700 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f120dca2-a604-4533-903f-35e297e61809 None admin] PATH_INFO: `/v3/projects/3d3a37cd8fb044539b71f6202165da75` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:42.041477 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f120dca2-a604-4533-903f-35e297e61809 None admin] RBAC: Authorizing `identity:get_project(project_id=3d3a37cd8fb044539b71f6202165da75)` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:39:42.042928 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f120dca2-a604-4533-903f-35e297e61809 None admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:39:42.045405 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 213/432] 10.222.0.16 () {56 vars in 1186 bytes} [Thu Jul 14 10:39:41 2022] GET /identity/v3/projects/3d3a37cd8fb044539b71f6202165da75 => generated 298 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:39:42.054660 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f120dca2-a604-4533-903f-35e297e61809 None admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:42.092473 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=100 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:39:42.163236 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd24964-bbf8-432b-9a77-376b585ada98 None admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:42.163695 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f120dca2-a604-4533-903f-35e297e61809 None admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:42.222736 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137f2b9c-b4e0-4b95-91f2-d44dbf37b6ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:42.223530 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137f2b9c-b4e0-4b95-91f2-d44dbf37b6ea None admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:42.223823 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137f2b9c-b4e0-4b95-91f2-d44dbf37b6ea None admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:42.224107 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137f2b9c-b4e0-4b95-91f2-d44dbf37b6ea None admin] PATH_INFO: `/v3/groups/c5074ffbaa514049890530146c069ba8` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:42.225256 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708a8a98-eabe-49da-bf07-9115abc7a898 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:42.225932 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708a8a98-eabe-49da-bf07-9115abc7a898 None admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:42.226216 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708a8a98-eabe-49da-bf07-9115abc7a898 None admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:42.226496 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708a8a98-eabe-49da-bf07-9115abc7a898 None admin] PATH_INFO: `/v3/roles` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:42.227265 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708a8a98-eabe-49da-bf07-9115abc7a898 None admin] RBAC: Adding query filter params (name=member) {{(pid=86656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:39:42.227577 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708a8a98-eabe-49da-bf07-9115abc7a898 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:39:42.229004 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708a8a98-eabe-49da-bf07-9115abc7a898 None admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:39:42.232974 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137f2b9c-b4e0-4b95-91f2-d44dbf37b6ea None admin] RBAC: Authorizing `identity:get_group(group_id=c5074ffbaa514049890530146c069ba8)` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:39:42.234442 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137f2b9c-b4e0-4b95-91f2-d44dbf37b6ea None admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:39:42.237306 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 214/433] 10.222.0.16 () {56 vars in 1180 bytes} [Thu Jul 14 10:39:42 2022] GET /identity/v3/groups/c5074ffbaa514049890530146c069ba8 => generated 226 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:39:42.242750 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137f2b9c-b4e0-4b95-91f2-d44dbf37b6ea None admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:42.245812 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 220/434] 10.222.0.16 () {56 vars in 1101 bytes} [Thu Jul 14 10:39:42 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:39:42.250853 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708a8a98-eabe-49da-bf07-9115abc7a898 None admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:42.293609 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=100 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:39:42.369926 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137f2b9c-b4e0-4b95-91f2-d44dbf37b6ea None admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:42.371193 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708a8a98-eabe-49da-bf07-9115abc7a898 None admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:42.373831 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=100 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:39:42.406521 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7468c1f1-ee9c-4576-94ae-164f934da008 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:42.406740 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8dd6b7-fffc-4ca6-aad3-8f84bcd83813 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:42.407306 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8dd6b7-fffc-4ca6-aad3-8f84bcd83813 None admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:42.407420 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7468c1f1-ee9c-4576-94ae-164f934da008 None admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:42.407594 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8dd6b7-fffc-4ca6-aad3-8f84bcd83813 None admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:42.407752 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7468c1f1-ee9c-4576-94ae-164f934da008 None admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:42.407902 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8dd6b7-fffc-4ca6-aad3-8f84bcd83813 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:42.407991 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7468c1f1-ee9c-4576-94ae-164f934da008 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:42.408708 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8dd6b7-fffc-4ca6-aad3-8f84bcd83813 None admin] RBAC: Adding query filter params (group.id=c5074ffbaa514049890530146c069ba8, role.id=0da46c267d354cce81495dfdd56c1ec2, scope.project.id=3d3a37cd8fb044539b71f6202165da75) {{(pid=86655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:39:42.409071 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8dd6b7-fffc-4ca6-aad3-8f84bcd83813 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:39:42.410550 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8dd6b7-fffc-4ca6-aad3-8f84bcd83813 None admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:39:42.416862 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 215/435] 10.222.0.16 () {56 vars in 1376 bytes} [Thu Jul 14 10:39:42 2022] GET /identity/v3/role_assignments?group.id=c5074ffbaa514049890530146c069ba8&scope.project.id=3d3a37cd8fb044539b71f6202165da75&role.id=0da46c267d354cce81495dfdd56c1ec2 => generated 611 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:39:42.417940 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb173da-9b1e-4b38-8c9d-6a0bc469f75e None None] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:42.418318 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb173da-9b1e-4b38-8c9d-6a0bc469f75e None None] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:42.418513 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb173da-9b1e-4b38-8c9d-6a0bc469f75e None None] PATH_INFO: `/` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:42.425200 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 216/436] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jul 14 10:39:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:39:42.427463 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c5bf27-d1b4-43ff-a749-142b4dd86340 None None] REQUEST_METHOD: `POST` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:42.427776 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c5bf27-d1b4-43ff-a749-142b4dd86340 None None] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:42.428039 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c5bf27-d1b4-43ff-a749-142b4dd86340 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:42.455112 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.auth.core [None req-51c5bf27-d1b4-43ff-a749-142b4dd86340 None None] MFA Rules not processed for user `ae4bcdd8106d4bebbdcae96be33505bc`. Rule list: `[]` (Enabled: `True`). {{(pid=86655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:39:42.456345 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-51c5bf27-d1b4-43ff-a749-142b4dd86340 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:39:42.519150 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7468c1f1-ee9c-4576-94ae-164f934da008 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:39:42.520554 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7468c1f1-ee9c-4576-94ae-164f934da008 None admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:39:42.532618 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 217/437] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jul 14 10:39:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 10:39:42.533837 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caea98d8-8c7b-40f9-b5aa-71089cf1487c None None] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:42.534130 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caea98d8-8c7b-40f9-b5aa-71089cf1487c None None] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:42.534407 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caea98d8-8c7b-40f9-b5aa-71089cf1487c None None] PATH_INFO: `/` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:42.539823 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 218/438] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jul 14 10:39:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:39:42.541112 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd8dbbe-cbfa-41c8-bd17-f208e09e4c56 None None] REQUEST_METHOD: `POST` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:42.541399 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd8dbbe-cbfa-41c8-bd17-f208e09e4c56 None None] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:42.541675 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd8dbbe-cbfa-41c8-bd17-f208e09e4c56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:42.563828 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.auth.core [None req-edd8dbbe-cbfa-41c8-bd17-f208e09e4c56 None None] MFA Rules not processed for user `ae4bcdd8106d4bebbdcae96be33505bc`. Rule list: `[]` (Enabled: `True`). {{(pid=86655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:39:42.565080 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-edd8dbbe-cbfa-41c8-bd17-f208e09e4c56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:39:42.596576 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=100 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:39:42.646703 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 219/439] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jul 14 10:39:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 14 10:39:42.647564 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd8dbbe-cbfa-41c8-bd17-f208e09e4c56 None None] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:42.657765 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 221/440] 10.222.0.16 () {58 vars in 1282 bytes} [Thu Jul 14 10:39:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 407 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 14 10:39:42.662900 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7468c1f1-ee9c-4576-94ae-164f934da008 None admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:42.666494 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=100 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:39:42.775037 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd8dbbe-cbfa-41c8-bd17-f208e09e4c56 None None] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:42.782685 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7468c1f1-ee9c-4576-94ae-164f934da008 None admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:42.822685 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd0ab47-0817-4218-9238-2dca09371921 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:42.823513 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd0ab47-0817-4218-9238-2dca09371921 None admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:42.823807 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd0ab47-0817-4218-9238-2dca09371921 None admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:42.824080 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd0ab47-0817-4218-9238-2dca09371921 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:42.826554 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48565a5-458f-4a20-9169-7a9a13c3a4fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:42.827729 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48565a5-458f-4a20-9169-7a9a13c3a4fc None admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:42.828026 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48565a5-458f-4a20-9169-7a9a13c3a4fc None admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:42.829499 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48565a5-458f-4a20-9169-7a9a13c3a4fc None admin] PATH_INFO: `/v3/projects/e3cf5b002a1c43f7a02696ed092318ca` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:42.829685 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48565a5-458f-4a20-9169-7a9a13c3a4fc None admin] RBAC: Authorizing `identity:get_project(project_id=e3cf5b002a1c43f7a02696ed092318ca)` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:39:42.831590 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48565a5-458f-4a20-9169-7a9a13c3a4fc None admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:39:42.834612 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 222/441] 10.222.0.16 () {56 vars in 1186 bytes} [Thu Jul 14 10:39:42 2022] GET /identity/v3/projects/e3cf5b002a1c43f7a02696ed092318ca => generated 302 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 10:39:42.834612 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48565a5-458f-4a20-9169-7a9a13c3a4fc None admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:42.839976 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd0ab47-0817-4218-9238-2dca09371921 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 10:39:42.849708 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application [None req-6bd0ab47-0817-4218-9238-2dca09371921 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 14 10:39:42.849708 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:39:42.849708 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:39:42.849708 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:39:42.849708 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:39:42.849708 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:39:42.849708 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:39:42.849708 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:39:42.849708 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:39:42.849708 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:39:42.849708 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:39:42.849708 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:39:42.849708 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 10:39:42.849708 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 10:39:42.849708 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 10:39:42.849708 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 10:39:42.850616 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 10:39:42.850616 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 10:39:42.850616 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 10:39:42.850616 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 10:39:42.850616 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:39:42.850616 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:39:42.850616 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:39:42.850616 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:39:42.850616 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:39:42.850616 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:39:42.850616 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:39:42.850616 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application with Lock( Jul 14 10:39:42.850616 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:39:42.850616 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:39:42.850616 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:39:42.850616 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:39:42.852026 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:39:42.852026 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:39:42.852026 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:39:42.852026 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:39:42.852026 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 10:39:42.852026 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 10:39:42.852026 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 10:39:42.852026 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 10:39:42.852026 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 10:39:42.852026 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 10:39:42.852026 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 14 10:39:42.852026 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application Jul 14 10:39:42.852026 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 220/442] 10.222.0.16 () {56 vars in 1114 bytes} [Thu Jul 14 10:39:42 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:39:42.852026 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd0ab47-0817-4218-9238-2dca09371921 None admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:42.880708 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=100 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:39:42.918119 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=100 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:39:42.955763 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48565a5-458f-4a20-9169-7a9a13c3a4fc None admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:42.977106 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd0ab47-0817-4218-9238-2dca09371921 None admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:42.993713 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17a3bf7-30f1-4685-a6b2-1b1f4c75e07b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:42.994511 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17a3bf7-30f1-4685-a6b2-1b1f4c75e07b None admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:42.994799 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17a3bf7-30f1-4685-a6b2-1b1f4c75e07b None admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:42.995079 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17a3bf7-30f1-4685-a6b2-1b1f4c75e07b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:43.005626 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17a3bf7-30f1-4685-a6b2-1b1f4c75e07b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 10:39:43.012272 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5eed2d-a8f8-40c7-9cd1-3ef8fc4d069a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:43.013228 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5eed2d-a8f8-40c7-9cd1-3ef8fc4d069a None admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:43.013324 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application [None req-c17a3bf7-30f1-4685-a6b2-1b1f4c75e07b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 10:39:43.013324 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:39:43.013324 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:39:43.013324 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:39:43.013324 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:39:43.013324 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:39:43.013324 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:39:43.013324 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:39:43.013324 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:39:43.013324 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:39:43.013324 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:39:43.013324 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:39:43.013324 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 10:39:43.013324 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 10:39:43.013324 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 10:39:43.013324 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 10:39:43.014263 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 10:39:43.014263 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 10:39:43.014263 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 10:39:43.014263 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 10:39:43.014263 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:39:43.014263 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:39:43.014263 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:39:43.014263 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:39:43.014263 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:39:43.014263 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:39:43.014263 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:39:43.014263 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application with Lock( Jul 14 10:39:43.014263 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:39:43.014263 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:39:43.014263 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:39:43.014263 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:39:43.015052 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:39:43.015052 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:39:43.015052 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:39:43.015052 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:39:43.015052 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 10:39:43.015052 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 10:39:43.015052 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 10:39:43.015052 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 10:39:43.015052 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 10:39:43.015052 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 10:39:43.015052 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 10:39:43.015052 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application Jul 14 10:39:43.015784 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5eed2d-a8f8-40c7-9cd1-3ef8fc4d069a None admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:43.015784 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5eed2d-a8f8-40c7-9cd1-3ef8fc4d069a None admin] PATH_INFO: `/v3/groups/c5074ffbaa514049890530146c069ba8` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:43.015901 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 223/443] 10.222.0.16 () {56 vars in 1096 bytes} [Thu Jul 14 10:39:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:39:43.015963 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5eed2d-a8f8-40c7-9cd1-3ef8fc4d069a None admin] RBAC: Authorizing `identity:get_group(group_id=c5074ffbaa514049890530146c069ba8)` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:39:43.016048 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17a3bf7-30f1-4685-a6b2-1b1f4c75e07b None admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:43.016514 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5eed2d-a8f8-40c7-9cd1-3ef8fc4d069a None admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:39:43.018018 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 221/444] 10.222.0.16 () {56 vars in 1180 bytes} [Thu Jul 14 10:39:42 2022] GET /identity/v3/groups/c5074ffbaa514049890530146c069ba8 => generated 226 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:39:43.020400 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5eed2d-a8f8-40c7-9cd1-3ef8fc4d069a None admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:43.111059 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=100 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:39:43.117867 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17a3bf7-30f1-4685-a6b2-1b1f4c75e07b None admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:43.121077 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5eed2d-a8f8-40c7-9cd1-3ef8fc4d069a None admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:43.146686 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=100 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:39:43.151204 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fcc4c5-15c7-451b-a24e-30b06ba0d2fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:43.151879 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fcc4c5-15c7-451b-a24e-30b06ba0d2fa None admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:43.152163 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fcc4c5-15c7-451b-a24e-30b06ba0d2fa None admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:43.152473 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fcc4c5-15c7-451b-a24e-30b06ba0d2fa None admin] PATH_INFO: `/v3/roles` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:43.153270 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8fcc4c5-15c7-451b-a24e-30b06ba0d2fa None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:39:43.153581 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8fcc4c5-15c7-451b-a24e-30b06ba0d2fa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:39:43.154040 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797f65b2-0376-4970-82f4-acb427a6dd4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:43.154704 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797f65b2-0376-4970-82f4-acb427a6dd4a None admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:43.154954 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8fcc4c5-15c7-451b-a24e-30b06ba0d2fa None admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:39:43.155040 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797f65b2-0376-4970-82f4-acb427a6dd4a None admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:43.155273 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797f65b2-0376-4970-82f4-acb427a6dd4a None admin] PATH_INFO: `/v3/roles` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:43.156022 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797f65b2-0376-4970-82f4-acb427a6dd4a None admin] RBAC: Adding query filter params (name=admin) {{(pid=86655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:39:43.156329 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797f65b2-0376-4970-82f4-acb427a6dd4a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:39:43.158290 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797f65b2-0376-4970-82f4-acb427a6dd4a None admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:39:43.163820 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 224/445] 10.222.0.16 () {56 vars in 1111 bytes} [Thu Jul 14 10:39:43 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:39:43.164427 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fcc4c5-15c7-451b-a24e-30b06ba0d2fa None admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:43.166608 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 222/446] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Jul 14 10:39:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:39:43.169080 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797f65b2-0376-4970-82f4-acb427a6dd4a None admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:43.263582 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fcc4c5-15c7-451b-a24e-30b06ba0d2fa None admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:43.267914 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797f65b2-0376-4970-82f4-acb427a6dd4a None admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:43.297236 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4482e63b-7a56-4491-910a-103482283332 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:43.298007 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4482e63b-7a56-4491-910a-103482283332 None admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:43.298401 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4482e63b-7a56-4491-910a-103482283332 None admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:43.298680 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4482e63b-7a56-4491-910a-103482283332 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:43.299511 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4482e63b-7a56-4491-910a-103482283332 None admin] RBAC: Adding query filter params (group.id=c5074ffbaa514049890530146c069ba8, role.id=0da46c267d354cce81495dfdd56c1ec2, scope.project.id=e3cf5b002a1c43f7a02696ed092318ca) {{(pid=86656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:39:43.299824 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4482e63b-7a56-4491-910a-103482283332 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:39:43.300571 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f19e8c-2a36-4487-8863-6ccadf426c8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:43.301261 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f19e8c-2a36-4487-8863-6ccadf426c8b None admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:43.301354 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4482e63b-7a56-4491-910a-103482283332 None admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:39:43.301544 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f19e8c-2a36-4487-8863-6ccadf426c8b None admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:43.301816 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f19e8c-2a36-4487-8863-6ccadf426c8b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:43.307236 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 225/447] 10.222.0.16 () {56 vars in 1376 bytes} [Thu Jul 14 10:39:43 2022] GET /identity/v3/role_assignments?group.id=c5074ffbaa514049890530146c069ba8&scope.project.id=e3cf5b002a1c43f7a02696ed092318ca&role.id=0da46c267d354cce81495dfdd56c1ec2 => generated 611 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:39:43.307853 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4482e63b-7a56-4491-910a-103482283332 None admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:43.324980 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=100 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:39:43.382603 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=100 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:39:43.389221 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f19e8c-2a36-4487-8863-6ccadf426c8b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:39:43.390753 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f19e8c-2a36-4487-8863-6ccadf426c8b None admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:39:43.431009 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4482e63b-7a56-4491-910a-103482283332 None admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:43.487839 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8486647-bf84-45d3-97eb-452a8bad0096 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:43.488502 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8486647-bf84-45d3-97eb-452a8bad0096 None admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:43.488805 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8486647-bf84-45d3-97eb-452a8bad0096 None admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:43.489090 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8486647-bf84-45d3-97eb-452a8bad0096 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:43.509851 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 223/448] 10.222.0.16 () {58 vars in 1282 bytes} [Thu Jul 14 10:39:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 14 10:39:43.515316 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f19e8c-2a36-4487-8863-6ccadf426c8b None admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:43.566614 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8486647-bf84-45d3-97eb-452a8bad0096 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:39:43.568088 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8486647-bf84-45d3-97eb-452a8bad0096 None admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:39:43.582865 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=100 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:39:43.639658 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f19e8c-2a36-4487-8863-6ccadf426c8b None admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:43.641075 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=100 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:39:43.679569 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eabae3c-6c71-4fd5-9240-05187a2090af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:43.680434 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eabae3c-6c71-4fd5-9240-05187a2090af None admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:43.680719 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eabae3c-6c71-4fd5-9240-05187a2090af None admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:43.681094 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eabae3c-6c71-4fd5-9240-05187a2090af None admin] PATH_INFO: `/v3/projects/e3cf5b002a1c43f7a02696ed092318ca` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:43.682276 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eabae3c-6c71-4fd5-9240-05187a2090af None admin] RBAC: Authorizing `identity:get_project(project_id=e3cf5b002a1c43f7a02696ed092318ca)` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:39:43.683713 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eabae3c-6c71-4fd5-9240-05187a2090af None admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:39:43.685475 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 224/449] 10.222.0.16 () {56 vars in 1186 bytes} [Thu Jul 14 10:39:43 2022] GET /identity/v3/projects/e3cf5b002a1c43f7a02696ed092318ca => generated 302 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 10:39:43.690840 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 226/450] 10.222.0.16 () {58 vars in 1282 bytes} [Thu Jul 14 10:39:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 10:39:43.692001 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eabae3c-6c71-4fd5-9240-05187a2090af None admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:43.696333 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8486647-bf84-45d3-97eb-452a8bad0096 None admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:43.790570 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eabae3c-6c71-4fd5-9240-05187a2090af None admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:43.793410 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8486647-bf84-45d3-97eb-452a8bad0096 None admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:43.810719 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=100 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:39:43.825499 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66292a1-98e9-419d-9631-a550b8d7ae81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:43.826350 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66292a1-98e9-419d-9631-a550b8d7ae81 None admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:43.826635 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66292a1-98e9-419d-9631-a550b8d7ae81 None admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:43.826903 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66292a1-98e9-419d-9631-a550b8d7ae81 None admin] PATH_INFO: `/v3/groups/c5074ffbaa514049890530146c069ba8` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:43.827204 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245efc25-2657-4be8-948b-a14e5678423a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:43.828062 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66292a1-98e9-419d-9631-a550b8d7ae81 None admin] RBAC: Authorizing `identity:get_group(group_id=c5074ffbaa514049890530146c069ba8)` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:39:43.828182 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245efc25-2657-4be8-948b-a14e5678423a None admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:43.828356 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245efc25-2657-4be8-948b-a14e5678423a None admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:43.828637 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245efc25-2657-4be8-948b-a14e5678423a None admin] PATH_INFO: `/v3/projects/7a2b7c1edcba4e118452f92cb83ff4b2` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:43.829626 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66292a1-98e9-419d-9631-a550b8d7ae81 None admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:39:43.829936 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245efc25-2657-4be8-948b-a14e5678423a None admin] RBAC: Authorizing `identity:get_project(project_id=7a2b7c1edcba4e118452f92cb83ff4b2)` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:39:43.831236 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 225/451] 10.222.0.16 () {56 vars in 1180 bytes} [Thu Jul 14 10:39:43 2022] GET /identity/v3/groups/c5074ffbaa514049890530146c069ba8 => generated 226 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:39:43.834244 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245efc25-2657-4be8-948b-a14e5678423a None admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:39:43.834244 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 227/452] 10.222.0.16 () {56 vars in 1186 bytes} [Thu Jul 14 10:39:43 2022] GET /identity/v3/projects/7a2b7c1edcba4e118452f92cb83ff4b2 => generated 344 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 10:39:43.836792 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66292a1-98e9-419d-9631-a550b8d7ae81 None admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:43.838233 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245efc25-2657-4be8-948b-a14e5678423a None admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:43.865958 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=100 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:39:43.936704 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66292a1-98e9-419d-9631-a550b8d7ae81 None admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:43.940291 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245efc25-2657-4be8-948b-a14e5678423a None admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:43.970775 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ada0c6-9771-49b1-8c16-8e7584df432f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:43.971432 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ada0c6-9771-49b1-8c16-8e7584df432f None admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:43.971715 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ada0c6-9771-49b1-8c16-8e7584df432f None admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:43.971993 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ada0c6-9771-49b1-8c16-8e7584df432f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:43.972856 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ada0c6-9771-49b1-8c16-8e7584df432f None admin] RBAC: Adding query filter params (group.id=c5074ffbaa514049890530146c069ba8, role.id=64ec6989f4724a8ab1e32d37c186c8f8, scope.project.id=e3cf5b002a1c43f7a02696ed092318ca) {{(pid=86655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:39:43.973170 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ada0c6-9771-49b1-8c16-8e7584df432f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:39:43.974599 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ada0c6-9771-49b1-8c16-8e7584df432f None admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:39:43.974768 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4554035-335a-4c64-8aaf-bdb0402b5a61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:43.975623 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4554035-335a-4c64-8aaf-bdb0402b5a61 None admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:43.975904 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4554035-335a-4c64-8aaf-bdb0402b5a61 None admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:43.976181 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4554035-335a-4c64-8aaf-bdb0402b5a61 None admin] PATH_INFO: `/v3/groups/da205123caaa4fb8ae8fb3221a99daef` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:43.977374 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4554035-335a-4c64-8aaf-bdb0402b5a61 None admin] RBAC: Authorizing `identity:get_group(group_id=da205123caaa4fb8ae8fb3221a99daef)` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:39:43.978799 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4554035-335a-4c64-8aaf-bdb0402b5a61 None admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:39:43.980460 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 228/453] 10.222.0.16 () {56 vars in 1180 bytes} [Thu Jul 14 10:39:43 2022] GET /identity/v3/groups/da205123caaa4fb8ae8fb3221a99daef => generated 229 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 10:39:43.984531 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 226/454] 10.222.0.16 () {56 vars in 1376 bytes} [Thu Jul 14 10:39:43 2022] GET /identity/v3/role_assignments?group.id=c5074ffbaa514049890530146c069ba8&scope.project.id=e3cf5b002a1c43f7a02696ed092318ca&role.id=64ec6989f4724a8ab1e32d37c186c8f8 => generated 611 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:39:43.987141 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4554035-335a-4c64-8aaf-bdb0402b5a61 None admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:44.086912 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=100 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:39:44.094672 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4554035-335a-4c64-8aaf-bdb0402b5a61 None admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:44.129247 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b10bc59-8971-4770-a1a1-802246c8496a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:44.129905 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b10bc59-8971-4770-a1a1-802246c8496a None admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:44.130191 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b10bc59-8971-4770-a1a1-802246c8496a None admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:44.130472 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b10bc59-8971-4770-a1a1-802246c8496a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:44.131315 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b10bc59-8971-4770-a1a1-802246c8496a None admin] RBAC: Adding query filter params (group.id=da205123caaa4fb8ae8fb3221a99daef, role.id=153539819e5542df99269d2913bbecfb, scope.project.id=7a2b7c1edcba4e118452f92cb83ff4b2) {{(pid=86656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:39:44.131630 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b10bc59-8971-4770-a1a1-802246c8496a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:39:44.133084 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b10bc59-8971-4770-a1a1-802246c8496a None admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:39:44.138873 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 229/455] 10.222.0.16 () {56 vars in 1376 bytes} [Thu Jul 14 10:39:43 2022] GET /identity/v3/role_assignments?group.id=da205123caaa4fb8ae8fb3221a99daef&scope.project.id=7a2b7c1edcba4e118452f92cb83ff4b2&role.id=153539819e5542df99269d2913bbecfb => generated 611 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:39:46.559561 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf45de65-5d34-4034-a87a-a6dc273cb103 None None] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:46.560078 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf45de65-5d34-4034-a87a-a6dc273cb103 None None] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:46.560151 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf45de65-5d34-4034-a87a-a6dc273cb103 None None] PATH_INFO: `/` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:46.562010 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 227/456] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jul 14 10:39:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:39:46.567383 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91467d51-9e33-415a-ba38-fe2938f71927 None None] REQUEST_METHOD: `POST` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:46.568251 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91467d51-9e33-415a-ba38-fe2938f71927 None None] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:46.568734 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91467d51-9e33-415a-ba38-fe2938f71927 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:46.586478 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.auth.core [None req-91467d51-9e33-415a-ba38-fe2938f71927 None None] MFA Rules not processed for user `ae4bcdd8106d4bebbdcae96be33505bc`. Rule list: `[]` (Enabled: `True`). {{(pid=86656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:39:46.588003 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-91467d51-9e33-415a-ba38-fe2938f71927 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:39:46.677906 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 230/457] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jul 14 10:39:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 10:39:46.703448 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf45de65-5d34-4034-a87a-a6dc273cb103 None None] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:46.792878 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=100 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:39:46.868600 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf45de65-5d34-4034-a87a-a6dc273cb103 None None] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:46.909178 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222a490f-6b23-45f4-b9c1-a21a513da958 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:46.909994 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222a490f-6b23-45f4-b9c1-a21a513da958 None admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:46.910278 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222a490f-6b23-45f4-b9c1-a21a513da958 None admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:46.910559 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222a490f-6b23-45f4-b9c1-a21a513da958 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:46.921345 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222a490f-6b23-45f4-b9c1-a21a513da958 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:39:46.923663 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222a490f-6b23-45f4-b9c1-a21a513da958 None admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:39:46.942198 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a016f28-4536-43fa-a26b-8ed027fbc27f None None] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:46.942487 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a016f28-4536-43fa-a26b-8ed027fbc27f None None] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:46.943000 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a016f28-4536-43fa-a26b-8ed027fbc27f None None] PATH_INFO: `/` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:46.944376 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application [None req-222a490f-6b23-45f4-b9c1-a21a513da958 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 10:39:46.944376 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:39:46.944376 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:39:46.944376 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:39:46.944376 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:39:46.944376 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:39:46.944376 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:39:46.944376 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:39:46.944376 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:39:46.944376 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:39:46.944376 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:39:46.944376 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:39:46.944376 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 10:39:46.944376 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 10:39:46.944376 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 10:39:46.945243 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 10:39:46.945243 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:39:46.945243 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:39:46.945243 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:39:46.945243 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:39:46.945243 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:39:46.945243 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:39:46.945243 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:39:46.945243 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application with Lock( Jul 14 10:39:46.945243 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:39:46.945243 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:39:46.945243 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:39:46.945243 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:39:46.945243 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:39:46.945243 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:39:46.945243 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:39:46.945243 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:39:46.946062 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 10:39:46.946062 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 10:39:46.946062 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 10:39:46.946062 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application Jul 14 10:39:46.946062 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 228/458] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Jul 14 10:39:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:39:46.946990 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 231/459] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jul 14 10:39:46 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 14 10:39:46.952874 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a016f28-4536-43fa-a26b-8ed027fbc27f None None] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:46.953108 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71133d8e-c1d5-433b-b937-169c0a15b841 None None] REQUEST_METHOD: `POST` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:46.953402 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71133d8e-c1d5-433b-b937-169c0a15b841 None None] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:46.954213 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71133d8e-c1d5-433b-b937-169c0a15b841 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:46.993772 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.auth.core [None req-71133d8e-c1d5-433b-b937-169c0a15b841 None None] MFA Rules not processed for user `ae4bcdd8106d4bebbdcae96be33505bc`. Rule list: `[]` (Enabled: `True`). {{(pid=86655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:39:46.994989 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-71133d8e-c1d5-433b-b937-169c0a15b841 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:39:47.065319 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=100 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:39:47.079905 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a016f28-4536-43fa-a26b-8ed027fbc27f None None] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:47.131070 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 229/460] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jul 14 10:39:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 10:39:47.133743 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d395d65-46a0-4b78-9dfd-a2404f41b583 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:47.134408 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d395d65-46a0-4b78-9dfd-a2404f41b583 None admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:47.134690 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d395d65-46a0-4b78-9dfd-a2404f41b583 None admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:47.134966 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d395d65-46a0-4b78-9dfd-a2404f41b583 None admin] PATH_INFO: `/v3/domains` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:47.135695 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d395d65-46a0-4b78-9dfd-a2404f41b583 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:39:47.136001 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d395d65-46a0-4b78-9dfd-a2404f41b583 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:39:47.137477 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d395d65-46a0-4b78-9dfd-a2404f41b583 None admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:39:47.150356 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 232/461] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Jul 14 10:39:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:39:47.155757 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71133d8e-c1d5-433b-b937-169c0a15b841 None None] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:47.173208 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d395d65-46a0-4b78-9dfd-a2404f41b583 None admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:47.212165 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=100 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:39:47.286160 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71133d8e-c1d5-433b-b937-169c0a15b841 None None] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:47.292342 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d395d65-46a0-4b78-9dfd-a2404f41b583 None admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:47.324661 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a059fcd-c81e-4224-9df0-296bb1d3ad60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:47.325554 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a059fcd-c81e-4224-9df0-296bb1d3ad60 None admin] REQUEST_METHOD: `POST` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:47.326009 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a059fcd-c81e-4224-9df0-296bb1d3ad60 None admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:47.326527 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a059fcd-c81e-4224-9df0-296bb1d3ad60 None admin] PATH_INFO: `/v3/users` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:47.327456 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a059fcd-c81e-4224-9df0-296bb1d3ad60 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:39:47.327829 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1430d28-c061-405d-835c-d8770b267ced None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:47.328643 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1430d28-c061-405d-835c-d8770b267ced None admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:47.328956 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1430d28-c061-405d-835c-d8770b267ced None admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:47.329236 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1430d28-c061-405d-835c-d8770b267ced None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:47.329735 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a059fcd-c81e-4224-9df0-296bb1d3ad60 None admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:39:47.340007 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1430d28-c061-405d-835c-d8770b267ced None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:39:47.341491 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1430d28-c061-405d-835c-d8770b267ced None admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:39:47.351475 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=100 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:39:47.352673 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 230/462] 10.222.0.16 () {60 vars in 1132 bytes} [Thu Jul 14 10:39:47 2022] POST /identity/v3/users => generated 246 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:39:47.354138 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9264976c-3446-465b-a6a2-7aafe487c8fe None None] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:47.354425 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9264976c-3446-465b-a6a2-7aafe487c8fe None None] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:47.354702 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9264976c-3446-465b-a6a2-7aafe487c8fe None None] PATH_INFO: `/` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:47.360761 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 231/463] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jul 14 10:39:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:39:47.360761 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c67b47-0ec6-48a8-aba1-9fa171986daa None None] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:47.360761 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c67b47-0ec6-48a8-aba1-9fa171986daa None None] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:47.360761 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c67b47-0ec6-48a8-aba1-9fa171986daa None None] PATH_INFO: `/` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:47.360761 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 232/464] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jul 14 10:39:47 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:39:47.361786 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application [None req-e1430d28-c061-405d-835c-d8770b267ced None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 10:39:47.361786 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:39:47.361786 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:39:47.361786 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:39:47.361786 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:39:47.361786 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:39:47.361786 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:39:47.361786 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:39:47.361786 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:39:47.361786 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:39:47.361786 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:39:47.361786 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:39:47.361786 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 10:39:47.361786 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 10:39:47.361786 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 10:39:47.362603 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 10:39:47.362603 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:39:47.362603 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:39:47.362603 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:39:47.362603 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:39:47.362603 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:39:47.362603 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:39:47.362603 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:39:47.362603 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application with Lock( Jul 14 10:39:47.362603 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:39:47.362603 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:39:47.362603 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:39:47.362603 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:39:47.362603 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:39:47.362603 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:39:47.362603 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:39:47.362603 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:39:47.363448 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 10:39:47.363448 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 10:39:47.363448 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 10:39:47.363448 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application Jul 14 10:39:47.366155 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da66173f-15d6-499b-9203-23353ecfc918 None None] REQUEST_METHOD: `POST` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:47.366472 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da66173f-15d6-499b-9203-23353ecfc918 None None] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:47.366755 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da66173f-15d6-499b-9203-23353ecfc918 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:47.367559 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 233/465] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Jul 14 10:39:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:39:47.376991 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819c2765-3446-49a4-8201-fa8c35349d60 None None] REQUEST_METHOD: `POST` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:47.376991 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819c2765-3446-49a4-8201-fa8c35349d60 None None] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:47.376991 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819c2765-3446-49a4-8201-fa8c35349d60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:47.393052 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.auth.core [None req-da66173f-15d6-499b-9203-23353ecfc918 None None] MFA Rules not processed for user `ae4bcdd8106d4bebbdcae96be33505bc`. Rule list: `[]` (Enabled: `True`). {{(pid=86655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:39:47.394221 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-da66173f-15d6-499b-9203-23353ecfc918 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:39:47.395917 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.auth.core [None req-819c2765-3446-49a4-8201-fa8c35349d60 None None] MFA Rules not processed for user `ae4bcdd8106d4bebbdcae96be33505bc`. Rule list: `[]` (Enabled: `True`). {{(pid=86656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:39:47.398355 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-819c2765-3446-49a4-8201-fa8c35349d60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:39:47.470646 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 233/466] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jul 14 10:39:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 10:39:47.471562 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da66173f-15d6-499b-9203-23353ecfc918 None None] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:47.495148 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:39:47.497279 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 234/467] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jul 14 10:39:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 10:39:47.515420 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819c2765-3446-49a4-8201-fa8c35349d60 None None] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:47.610724 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da66173f-15d6-499b-9203-23353ecfc918 None None] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:47.649442 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819c2765-3446-49a4-8201-fa8c35349d60 None None] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:47.660177 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67769c94-95b3-4bed-8bf3-1131471a30c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:47.660888 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67769c94-95b3-4bed-8bf3-1131471a30c0 None admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:47.661173 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67769c94-95b3-4bed-8bf3-1131471a30c0 None admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:47.661448 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67769c94-95b3-4bed-8bf3-1131471a30c0 None admin] PATH_INFO: `/v3/domains` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:47.662188 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67769c94-95b3-4bed-8bf3-1131471a30c0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:39:47.662497 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67769c94-95b3-4bed-8bf3-1131471a30c0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:39:47.663883 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67769c94-95b3-4bed-8bf3-1131471a30c0 None admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:39:47.682853 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 234/468] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Jul 14 10:39:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:39:47.683660 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=100 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:39:47.683770 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67769c94-95b3-4bed-8bf3-1131471a30c0 None admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:47.696833 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258ace6c-ac99-414f-b20f-60f5dfec41e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:47.697690 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258ace6c-ac99-414f-b20f-60f5dfec41e5 None admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:47.697976 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258ace6c-ac99-414f-b20f-60f5dfec41e5 None admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:47.698703 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258ace6c-ac99-414f-b20f-60f5dfec41e5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:47.712963 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258ace6c-ac99-414f-b20f-60f5dfec41e5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:39:47.715422 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258ace6c-ac99-414f-b20f-60f5dfec41e5 None admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:39:47.744167 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application [None req-258ace6c-ac99-414f-b20f-60f5dfec41e5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 10:39:47.744167 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:39:47.744167 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:39:47.744167 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:39:47.744167 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:39:47.744167 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:39:47.744167 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:39:47.744167 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:39:47.744167 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:39:47.744167 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:39:47.744167 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:39:47.744167 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:39:47.744167 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 10:39:47.744167 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 10:39:47.744167 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 10:39:47.745089 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 10:39:47.745089 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:39:47.745089 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:39:47.745089 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:39:47.745089 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:39:47.745089 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:39:47.745089 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:39:47.745089 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:39:47.745089 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application with Lock( Jul 14 10:39:47.745089 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:39:47.745089 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:39:47.745089 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:39:47.745089 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:39:47.745089 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:39:47.745089 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:39:47.745089 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:39:47.745089 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:39:47.745944 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 10:39:47.745944 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 10:39:47.745944 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 10:39:47.745944 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application Jul 14 10:39:47.746704 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 235/469] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Jul 14 10:39:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 10:39:47.750525 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258ace6c-ac99-414f-b20f-60f5dfec41e5 None admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:47.780890 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=100 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:39:47.812193 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67769c94-95b3-4bed-8bf3-1131471a30c0 None admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:47.850439 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9074a8f6-2976-41ce-9b81-13397f20c00c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:47.850644 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9074a8f6-2976-41ce-9b81-13397f20c00c None admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:47.850885 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9074a8f6-2976-41ce-9b81-13397f20c00c None admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:47.851163 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9074a8f6-2976-41ce-9b81-13397f20c00c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:47.862593 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9074a8f6-2976-41ce-9b81-13397f20c00c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:39:47.864135 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9074a8f6-2976-41ce-9b81-13397f20c00c None admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:39:47.882687 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application [None req-9074a8f6-2976-41ce-9b81-13397f20c00c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 10:39:47.882687 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:39:47.882687 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:39:47.882687 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:39:47.882687 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:39:47.882687 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:39:47.882687 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:39:47.882687 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:39:47.882687 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:39:47.882687 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:39:47.882687 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:39:47.882687 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:39:47.882687 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 10:39:47.882687 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 10:39:47.882687 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 10:39:47.883678 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 10:39:47.883678 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:39:47.883678 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:39:47.883678 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:39:47.883678 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:39:47.883678 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:39:47.883678 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:39:47.883678 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:39:47.883678 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application with Lock( Jul 14 10:39:47.883678 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:39:47.883678 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:39:47.883678 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:39:47.883678 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:39:47.883678 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:39:47.883678 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:39:47.883678 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:39:47.883678 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:39:47.885145 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 10:39:47.885145 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 10:39:47.885145 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 10:39:47.885145 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application Jul 14 10:39:47.885145 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 235/470] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Jul 14 10:39:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:39:47.885145 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9074a8f6-2976-41ce-9b81-13397f20c00c None admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:47.891778 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258ace6c-ac99-414f-b20f-60f5dfec41e5 None admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:47.926680 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee6ef96-59d1-40f5-b325-532a4fa05862 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:47.927208 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee6ef96-59d1-40f5-b325-532a4fa05862 None admin] REQUEST_METHOD: `POST` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:47.927471 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee6ef96-59d1-40f5-b325-532a4fa05862 None admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:47.927747 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee6ef96-59d1-40f5-b325-532a4fa05862 None admin] PATH_INFO: `/v3/users` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:47.928462 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee6ef96-59d1-40f5-b325-532a4fa05862 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:39:47.929958 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee6ef96-59d1-40f5-b325-532a4fa05862 None admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:39:47.956399 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 236/471] 10.222.0.16 () {60 vars in 1132 bytes} [Thu Jul 14 10:39:47 2022] POST /identity/v3/users => generated 248 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:39:47.961595 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee6ef96-59d1-40f5-b325-532a4fa05862 None admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:48.009232 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:39:48.067315 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9074a8f6-2976-41ce-9b81-13397f20c00c None admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:48.082730 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee6ef96-59d1-40f5-b325-532a4fa05862 None admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:48.127027 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=100 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:39:48.133060 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936b13b0-09c4-452b-b35f-6e8c106e8b01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:48.134114 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936b13b0-09c4-452b-b35f-6e8c106e8b01 None admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:48.135456 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936b13b0-09c4-452b-b35f-6e8c106e8b01 None admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:48.135950 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936b13b0-09c4-452b-b35f-6e8c106e8b01 None admin] PATH_INFO: `/v3/domains` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:48.137467 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936b13b0-09c4-452b-b35f-6e8c106e8b01 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:39:48.137979 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fab45d-9b76-40d8-9f8a-1bd2433cec7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:48.138233 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936b13b0-09c4-452b-b35f-6e8c106e8b01 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:39:48.138652 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fab45d-9b76-40d8-9f8a-1bd2433cec7f None admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:48.138936 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fab45d-9b76-40d8-9f8a-1bd2433cec7f None admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:48.139215 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fab45d-9b76-40d8-9f8a-1bd2433cec7f None admin] PATH_INFO: `/v3/domains` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:48.139944 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94fab45d-9b76-40d8-9f8a-1bd2433cec7f None admin] RBAC: Adding query filter params (name=Default) {{(pid=86656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:39:48.140249 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94fab45d-9b76-40d8-9f8a-1bd2433cec7f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:39:48.140912 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936b13b0-09c4-452b-b35f-6e8c106e8b01 None admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:39:48.141760 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94fab45d-9b76-40d8-9f8a-1bd2433cec7f None admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:39:48.158361 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 237/472] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Jul 14 10:39:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:39:48.158944 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 236/473] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Jul 14 10:39:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:39:48.166214 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fab45d-9b76-40d8-9f8a-1bd2433cec7f None admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:48.167257 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936b13b0-09c4-452b-b35f-6e8c106e8b01 None admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:48.287743 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=100 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:39:48.291775 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fab45d-9b76-40d8-9f8a-1bd2433cec7f None admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:48.301002 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936b13b0-09c4-452b-b35f-6e8c106e8b01 None admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:48.336734 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07735074-0c53-4212-af1b-23ab9258dc34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:48.337574 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07735074-0c53-4212-af1b-23ab9258dc34 None admin] REQUEST_METHOD: `POST` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:48.337977 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07735074-0c53-4212-af1b-23ab9258dc34 None admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:48.338349 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07735074-0c53-4212-af1b-23ab9258dc34 None admin] PATH_INFO: `/v3/users` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:48.339160 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07735074-0c53-4212-af1b-23ab9258dc34 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:39:48.340521 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588ca4b0-8296-4c9a-8a88-44f059635a71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:48.340789 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07735074-0c53-4212-af1b-23ab9258dc34 None admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:39:48.341550 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588ca4b0-8296-4c9a-8a88-44f059635a71 None admin] REQUEST_METHOD: `POST` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:48.341982 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588ca4b0-8296-4c9a-8a88-44f059635a71 None admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:48.342406 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588ca4b0-8296-4c9a-8a88-44f059635a71 None admin] PATH_INFO: `/v3/users` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:48.343275 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588ca4b0-8296-4c9a-8a88-44f059635a71 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:39:48.345483 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588ca4b0-8296-4c9a-8a88-44f059635a71 None admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:39:48.366544 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 238/474] 10.222.0.16 () {60 vars in 1132 bytes} [Thu Jul 14 10:39:48 2022] POST /identity/v3/users => generated 248 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:39:48.368303 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fceaf837-a8ac-4fd1-aa76-064d9e349c8b None None] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:48.368705 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fceaf837-a8ac-4fd1-aa76-064d9e349c8b None None] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:48.369137 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fceaf837-a8ac-4fd1-aa76-064d9e349c8b None None] PATH_INFO: `/` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:48.369388 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 237/475] 10.222.0.16 () {60 vars in 1132 bytes} [Thu Jul 14 10:39:48 2022] POST /identity/v3/users => generated 249 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:39:48.370908 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 239/476] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jul 14 10:39:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:39:48.378122 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef8fe07-0d61-4c00-a17c-3a1be9f2be2a None None] REQUEST_METHOD: `POST` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:48.378799 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef8fe07-0d61-4c00-a17c-3a1be9f2be2a None None] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:48.379382 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef8fe07-0d61-4c00-a17c-3a1be9f2be2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:48.400272 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.auth.core [None req-5ef8fe07-0d61-4c00-a17c-3a1be9f2be2a None None] MFA Rules not processed for user `ae4bcdd8106d4bebbdcae96be33505bc`. Rule list: `[]` (Enabled: `True`). {{(pid=86655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:39:48.401960 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-5ef8fe07-0d61-4c00-a17c-3a1be9f2be2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:39:48.460251 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:39:48.493325 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 238/477] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jul 14 10:39:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 10:39:48.521985 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fceaf837-a8ac-4fd1-aa76-064d9e349c8b None None] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:48.649592 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fceaf837-a8ac-4fd1-aa76-064d9e349c8b None None] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:48.693661 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a316f2a0-696a-43c3-8695-19420fae621a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:48.694341 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a316f2a0-696a-43c3-8695-19420fae621a None admin] REQUEST_METHOD: `POST` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:48.694626 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a316f2a0-696a-43c3-8695-19420fae621a None admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:48.694960 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a316f2a0-696a-43c3-8695-19420fae621a None admin] PATH_INFO: `/v3/roles` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:48.695730 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a316f2a0-696a-43c3-8695-19420fae621a None admin] RBAC: Authorizing `identity:create_role()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:39:48.697234 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a316f2a0-696a-43c3-8695-19420fae621a None admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:39:48.703907 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.sql.core [None req-a316f2a0-696a-43c3-8695-19420fae621a None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 14 10:39:48.703907 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jul 14 10:39:48.703907 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [parameters: {'id': 'f1a4559389374978bb206f0ed598964f', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jul 14 10:39:48.703907 dv-cinder-846146-7-smb devstack@keystone.service[86656]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=86656) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 14 10:39:48.720362 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application [None req-a316f2a0-696a-43c3-8695-19420fae621a None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jul 14 10:39:48.720362 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:39:48.720362 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 14 10:39:48.720362 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 14 10:39:48.720362 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 14 10:39:48.720362 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 14 10:39:48.720362 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 14 10:39:48.720362 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application result = self._query(query) Jul 14 10:39:48.720362 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 14 10:39:48.720362 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application conn.query(q) Jul 14 10:39:48.720362 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 14 10:39:48.720362 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 14 10:39:48.720362 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 14 10:39:48.720362 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application result.read() Jul 14 10:39:48.720362 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 14 10:39:48.721364 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 14 10:39:48.721364 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 14 10:39:48.721364 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 14 10:39:48.721364 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 14 10:39:48.721364 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 14 10:39:48.721364 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 14 10:39:48.721364 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 14 10:39:48.721364 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 14 10:39:48.721364 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application Jul 14 10:39:48.721364 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 14 10:39:48.721364 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application Jul 14 10:39:48.721364 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:39:48.721364 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 14 10:39:48.721364 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 14 10:39:48.721364 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Jul 14 10:39:48.721364 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return ref.to_dict() Jul 14 10:39:48.721364 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 14 10:39:48.721364 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application next(self.gen) Jul 14 10:39:48.722252 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 14 10:39:48.722252 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application yield resource Jul 14 10:39:48.722252 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 14 10:39:48.722252 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application next(self.gen) Jul 14 10:39:48.722252 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 14 10:39:48.722252 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application self.session.rollback() Jul 14 10:39:48.722252 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 14 10:39:48.722252 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application self.force_reraise() Jul 14 10:39:48.722252 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 14 10:39:48.722252 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application raise self.value Jul 14 10:39:48.722252 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 14 10:39:48.722252 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 14 10:39:48.722252 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 14 10:39:48.722252 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application session.commit() Jul 14 10:39:48.722252 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 14 10:39:48.722252 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 14 10:39:48.722252 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 14 10:39:48.723145 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application self._prepare_impl() Jul 14 10:39:48.723145 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 14 10:39:48.723145 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application self.session.flush() Jul 14 10:39:48.723145 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 14 10:39:48.723145 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application self._flush(objects) Jul 14 10:39:48.723145 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 14 10:39:48.723145 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 14 10:39:48.723145 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 14 10:39:48.723145 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application compat.raise_( Jul 14 10:39:48.723145 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 14 10:39:48.723145 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application raise exception Jul 14 10:39:48.723145 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 14 10:39:48.723145 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application flush_context.execute() Jul 14 10:39:48.723145 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 14 10:39:48.723145 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application rec.execute(self) Jul 14 10:39:48.723145 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 14 10:39:48.723145 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 14 10:39:48.723982 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 14 10:39:48.723982 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 14 10:39:48.723982 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jul 14 10:39:48.723982 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application c = connection._execute_20( Jul 14 10:39:48.723982 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 14 10:39:48.723982 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 14 10:39:48.723982 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 14 10:39:48.723982 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 14 10:39:48.723982 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 14 10:39:48.723982 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 14 10:39:48.723982 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 14 10:39:48.723982 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 14 10:39:48.723982 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 14 10:39:48.723982 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 14 10:39:48.723982 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 14 10:39:48.723982 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application raise exception Jul 14 10:39:48.725809 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 14 10:39:48.725809 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 14 10:39:48.725809 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 14 10:39:48.725809 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 14 10:39:48.725809 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 14 10:39:48.725809 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application result = self._query(query) Jul 14 10:39:48.725809 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 14 10:39:48.725809 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application conn.query(q) Jul 14 10:39:48.725809 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 14 10:39:48.725809 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 14 10:39:48.725809 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 14 10:39:48.725809 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application result.read() Jul 14 10:39:48.725809 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 14 10:39:48.725809 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 14 10:39:48.725809 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 14 10:39:48.725809 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 14 10:39:48.728542 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 14 10:39:48.728542 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 14 10:39:48.728542 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 14 10:39:48.728542 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 14 10:39:48.728542 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 14 10:39:48.728542 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jul 14 10:39:48.728542 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application [parameters: {'id': 'f1a4559389374978bb206f0ed598964f', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jul 14 10:39:48.728542 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 14 10:39:48.728542 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application Jul 14 10:39:48.728542 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 10:39:48.728542 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application Jul 14 10:39:48.728542 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:39:48.728542 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:39:48.728542 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:39:48.728542 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:39:48.728542 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:39:48.730733 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:39:48.730733 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:39:48.730733 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:39:48.730733 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:39:48.730733 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:39:48.730733 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:39:48.730733 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Jul 14 10:39:48.730733 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Jul 14 10:39:48.730733 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:39:48.730733 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:39:48.730733 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Jul 14 10:39:48.730733 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Jul 14 10:39:48.730733 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 14 10:39:48.730733 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 14 10:39:48.730733 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jul 14 10:39:48.730733 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application Jul 14 10:39:48.736737 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 240/478] 10.222.0.16 () {60 vars in 1131 bytes} [Thu Jul 14 10:39:48 2022] POST /identity/v3/roles => generated 144 bytes in 200 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:39:48.736974 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef8fe07-0d61-4c00-a17c-3a1be9f2be2a None None] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:48.866235 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef8fe07-0d61-4c00-a17c-3a1be9f2be2a None None] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:48.902666 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bc610a-2e26-40a4-a9a2-1ef6d6b526eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:48.903882 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bc610a-2e26-40a4-a9a2-1ef6d6b526eb None admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:48.904390 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bc610a-2e26-40a4-a9a2-1ef6d6b526eb None admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:48.904913 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bc610a-2e26-40a4-a9a2-1ef6d6b526eb None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:48.917371 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55bc610a-2e26-40a4-a9a2-1ef6d6b526eb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 10:39:48.926292 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application [None req-55bc610a-2e26-40a4-a9a2-1ef6d6b526eb None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 14 10:39:48.926292 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:39:48.926292 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:39:48.926292 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:39:48.926292 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:39:48.926292 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:39:48.926292 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:39:48.926292 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:39:48.926292 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:39:48.926292 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:39:48.926292 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:39:48.926292 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:39:48.926292 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 10:39:48.926292 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 10:39:48.926292 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 10:39:48.926292 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 10:39:48.927208 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 10:39:48.927208 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 10:39:48.927208 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 10:39:48.927208 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 10:39:48.927208 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:39:48.927208 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:39:48.927208 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:39:48.927208 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:39:48.927208 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:39:48.927208 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:39:48.927208 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:39:48.927208 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application with Lock( Jul 14 10:39:48.927208 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:39:48.927208 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:39:48.927208 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:39:48.927208 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:39:48.928013 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:39:48.928013 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:39:48.928013 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:39:48.928013 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:39:48.928013 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 10:39:48.928013 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 10:39:48.928013 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 10:39:48.928013 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 10:39:48.928013 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 10:39:48.928013 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 10:39:48.928013 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 14 10:39:48.928013 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application Jul 14 10:39:48.930910 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 239/479] 10.222.0.16 () {56 vars in 1114 bytes} [Thu Jul 14 10:39:48 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:39:48.938382 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a316f2a0-696a-43c3-8695-19420fae621a None admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:48.974639 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:39:49.091556 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a316f2a0-696a-43c3-8695-19420fae621a None admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:49.137536 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2541d2c0-b9f6-408c-8a71-2c0dd4391c67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:49.138210 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2541d2c0-b9f6-408c-8a71-2c0dd4391c67 None admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:49.138493 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2541d2c0-b9f6-408c-8a71-2c0dd4391c67 None admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:49.138764 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2541d2c0-b9f6-408c-8a71-2c0dd4391c67 None admin] PATH_INFO: `/v3/roles` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:49.139521 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2541d2c0-b9f6-408c-8a71-2c0dd4391c67 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:39:49.139828 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2541d2c0-b9f6-408c-8a71-2c0dd4391c67 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:39:49.141805 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2541d2c0-b9f6-408c-8a71-2c0dd4391c67 None admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:39:49.156692 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 241/480] 10.222.0.16 () {56 vars in 1111 bytes} [Thu Jul 14 10:39:48 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:39:49.971683 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c298239d-c93b-4871-9031-297b0bb869f1 None None] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:49.972209 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c298239d-c93b-4871-9031-297b0bb869f1 None None] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:49.972283 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c298239d-c93b-4871-9031-297b0bb869f1 None None] PATH_INFO: `/` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:49.973895 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 240/481] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jul 14 10:39:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:39:49.980670 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0a6b5b-a541-46d4-99bb-257b54372f3c None None] REQUEST_METHOD: `POST` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:49.981118 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0a6b5b-a541-46d4-99bb-257b54372f3c None None] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:49.981335 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0a6b5b-a541-46d4-99bb-257b54372f3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:50.001983 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.auth.core [None req-ec0a6b5b-a541-46d4-99bb-257b54372f3c None None] MFA Rules not processed for user `ae4bcdd8106d4bebbdcae96be33505bc`. Rule list: `[]` (Enabled: `True`). {{(pid=86656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:39:50.003225 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-ec0a6b5b-a541-46d4-99bb-257b54372f3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:39:50.093028 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 242/482] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jul 14 10:39:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 10:39:50.128184 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c298239d-c93b-4871-9031-297b0bb869f1 None None] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:50.190092 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=100 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:39:50.255301 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c298239d-c93b-4871-9031-297b0bb869f1 None None] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:50.289850 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afeb3acd-829c-4609-9cfb-cfe9b7c96621 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:50.290645 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afeb3acd-829c-4609-9cfb-cfe9b7c96621 None admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:50.290923 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afeb3acd-829c-4609-9cfb-cfe9b7c96621 None admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:50.291194 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afeb3acd-829c-4609-9cfb-cfe9b7c96621 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:50.302149 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afeb3acd-829c-4609-9cfb-cfe9b7c96621 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 10:39:50.310111 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application [None req-afeb3acd-829c-4609-9cfb-cfe9b7c96621 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 14 10:39:50.310111 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:39:50.310111 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:39:50.310111 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:39:50.310111 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:39:50.310111 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:39:50.310111 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:39:50.310111 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:39:50.310111 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:39:50.310111 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:39:50.310111 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:39:50.310111 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:39:50.310111 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 10:39:50.310111 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 10:39:50.310111 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 10:39:50.310111 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 10:39:50.310964 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 10:39:50.310964 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 10:39:50.310964 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 10:39:50.310964 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 10:39:50.310964 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:39:50.310964 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:39:50.310964 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:39:50.310964 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:39:50.310964 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:39:50.310964 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:39:50.310964 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:39:50.310964 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application with Lock( Jul 14 10:39:50.310964 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:39:50.310964 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:39:50.310964 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:39:50.310964 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:39:50.312134 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:39:50.312134 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:39:50.312134 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:39:50.312134 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:39:50.312134 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 10:39:50.312134 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 10:39:50.312134 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 10:39:50.312134 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 10:39:50.312134 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 10:39:50.312134 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 10:39:50.312134 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 14 10:39:50.312134 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application Jul 14 10:39:50.312134 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 241/483] 10.222.0.16 () {56 vars in 1102 bytes} [Thu Jul 14 10:39:50 2022] GET /identity/v3/roles/service => generated 85 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:39:50.317861 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0a6b5b-a541-46d4-99bb-257b54372f3c None None] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:50.349225 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=100 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:39:50.488996 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0a6b5b-a541-46d4-99bb-257b54372f3c None None] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:50.537713 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b155ddc6-a5a6-4a2b-a730-f8403e236b67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:50.538694 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b155ddc6-a5a6-4a2b-a730-f8403e236b67 None admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:50.539154 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b155ddc6-a5a6-4a2b-a730-f8403e236b67 None admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:50.539606 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b155ddc6-a5a6-4a2b-a730-f8403e236b67 None admin] PATH_INFO: `/v3/roles` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:50.540570 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b155ddc6-a5a6-4a2b-a730-f8403e236b67 None admin] RBAC: Adding query filter params (name=service) {{(pid=86656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:39:50.541077 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b155ddc6-a5a6-4a2b-a730-f8403e236b67 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:39:50.542625 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b155ddc6-a5a6-4a2b-a730-f8403e236b67 None admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:39:50.556123 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 243/484] 10.222.0.16 () {56 vars in 1103 bytes} [Thu Jul 14 10:39:50 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:39:50.561837 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afeb3acd-829c-4609-9cfb-cfe9b7c96621 None admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:50.672941 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=100 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:39:50.680530 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afeb3acd-829c-4609-9cfb-cfe9b7c96621 None admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:50.699482 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b887a1-054e-49ee-808d-1f3eb1d00188 None None] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:50.699785 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b887a1-054e-49ee-808d-1f3eb1d00188 None None] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:50.700053 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b887a1-054e-49ee-808d-1f3eb1d00188 None None] PATH_INFO: `/` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:50.701704 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 244/485] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jul 14 10:39:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:39:50.719596 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825ec3be-fdc4-4e2d-8b6e-ac81be973cd1 None None] REQUEST_METHOD: `POST` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:50.719995 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825ec3be-fdc4-4e2d-8b6e-ac81be973cd1 None None] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:50.720279 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825ec3be-fdc4-4e2d-8b6e-ac81be973cd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:50.721026 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7cbfd6-d4be-4756-a4cf-fc0b65f14967 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:50.721824 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7cbfd6-d4be-4756-a4cf-fc0b65f14967 None admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:50.722130 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7cbfd6-d4be-4756-a4cf-fc0b65f14967 None admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:50.722371 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7cbfd6-d4be-4756-a4cf-fc0b65f14967 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:50.740701 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7cbfd6-d4be-4756-a4cf-fc0b65f14967 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:39:50.742206 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7cbfd6-d4be-4756-a4cf-fc0b65f14967 None admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:39:50.751984 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.auth.core [None req-825ec3be-fdc4-4e2d-8b6e-ac81be973cd1 None None] MFA Rules not processed for user `ae4bcdd8106d4bebbdcae96be33505bc`. Rule list: `[]` (Enabled: `True`). {{(pid=86656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:39:50.753226 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-825ec3be-fdc4-4e2d-8b6e-ac81be973cd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:39:50.779852 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application [None req-fb7cbfd6-d4be-4756-a4cf-fc0b65f14967 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 10:39:50.779852 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:39:50.779852 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:39:50.779852 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:39:50.779852 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:39:50.779852 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:39:50.779852 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:39:50.779852 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:39:50.779852 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:39:50.779852 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:39:50.779852 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:39:50.779852 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:39:50.779852 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 10:39:50.779852 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 10:39:50.779852 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 10:39:50.781128 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 10:39:50.781128 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:39:50.781128 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:39:50.781128 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:39:50.781128 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:39:50.781128 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:39:50.781128 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:39:50.781128 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:39:50.781128 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application with Lock( Jul 14 10:39:50.781128 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:39:50.781128 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:39:50.781128 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:39:50.781128 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:39:50.781128 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:39:50.781128 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:39:50.781128 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:39:50.781128 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:39:50.782059 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 10:39:50.782059 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 10:39:50.782059 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 10:39:50.782059 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application Jul 14 10:39:50.782059 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 242/486] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Jul 14 10:39:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:39:50.788903 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7cbfd6-d4be-4756-a4cf-fc0b65f14967 None admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:50.896094 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 245/487] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jul 14 10:39:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 10:39:50.902484 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb3718d-289c-4759-89e9-69b0ee52db10 None None] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:50.903340 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb3718d-289c-4759-89e9-69b0ee52db10 None None] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:50.905316 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb3718d-289c-4759-89e9-69b0ee52db10 None None] PATH_INFO: `/` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:50.908138 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 246/488] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jul 14 10:39:50 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:39:50.918116 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12bc1f0-ae52-4e5b-9f7a-9385fba291be None None] REQUEST_METHOD: `POST` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:50.918657 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12bc1f0-ae52-4e5b-9f7a-9385fba291be None None] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:50.919136 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12bc1f0-ae52-4e5b-9f7a-9385fba291be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:50.927379 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=100 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:39:50.938072 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.auth.core [None req-a12bc1f0-ae52-4e5b-9f7a-9385fba291be None None] MFA Rules not processed for user `ae4bcdd8106d4bebbdcae96be33505bc`. Rule list: `[]` (Enabled: `True`). {{(pid=86656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:39:50.939763 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-a12bc1f0-ae52-4e5b-9f7a-9385fba291be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:39:50.961117 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7cbfd6-d4be-4756-a4cf-fc0b65f14967 None admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:51.004611 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b6dd6f-a111-40c6-90ba-045fab59861c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:51.005417 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b6dd6f-a111-40c6-90ba-045fab59861c None admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:51.005617 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b6dd6f-a111-40c6-90ba-045fab59861c None admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:51.005862 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b6dd6f-a111-40c6-90ba-045fab59861c None admin] PATH_INFO: `/v3/domains` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:51.006706 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b6dd6f-a111-40c6-90ba-045fab59861c None admin] RBAC: Adding query filter params (name=Default) {{(pid=86655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:39:51.007015 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b6dd6f-a111-40c6-90ba-045fab59861c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:39:51.008394 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b6dd6f-a111-40c6-90ba-045fab59861c None admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:39:51.016869 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 247/489] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jul 14 10:39:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 10:39:51.018321 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12bc1f0-ae52-4e5b-9f7a-9385fba291be None None] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:51.021380 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 243/490] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Jul 14 10:39:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:39:51.027244 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b6dd6f-a111-40c6-90ba-045fab59861c None admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:51.043484 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=100 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:39:51.144430 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12bc1f0-ae52-4e5b-9f7a-9385fba291be None None] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:51.151139 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b6dd6f-a111-40c6-90ba-045fab59861c None admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:51.175530 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=100 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:39:51.180293 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b78115-3fda-4c09-a413-2905d01edf2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:51.181679 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b78115-3fda-4c09-a413-2905d01edf2e None admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:51.182471 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b78115-3fda-4c09-a413-2905d01edf2e None admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:51.183426 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b78115-3fda-4c09-a413-2905d01edf2e None admin] PATH_INFO: `/v3/roles/service` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:51.187509 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0938565b-d153-442b-9e70-812e67221328 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:51.189137 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0938565b-d153-442b-9e70-812e67221328 None admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:51.189431 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0938565b-d153-442b-9e70-812e67221328 None admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:51.189711 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0938565b-d153-442b-9e70-812e67221328 None admin] PATH_INFO: `/v3/users/nova` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:51.195295 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b78115-3fda-4c09-a413-2905d01edf2e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 10:39:51.196762 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0938565b-d153-442b-9e70-812e67221328 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:39:51.198224 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0938565b-d153-442b-9e70-812e67221328 None admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:39:51.203121 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application [None req-a7b78115-3fda-4c09-a413-2905d01edf2e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 14 10:39:51.203121 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:39:51.203121 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:39:51.203121 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:39:51.203121 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:39:51.203121 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:39:51.203121 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:39:51.203121 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:39:51.203121 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:39:51.203121 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:39:51.203121 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:39:51.203121 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:39:51.203121 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 10:39:51.203121 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 10:39:51.203121 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 10:39:51.203121 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 10:39:51.204052 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 10:39:51.204052 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 10:39:51.204052 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 10:39:51.204052 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 10:39:51.204052 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:39:51.204052 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:39:51.204052 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:39:51.204052 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:39:51.204052 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:39:51.204052 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:39:51.204052 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:39:51.204052 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application with Lock( Jul 14 10:39:51.204052 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:39:51.204052 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:39:51.204052 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:39:51.204052 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:39:51.204872 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:39:51.204872 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:39:51.204872 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:39:51.204872 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:39:51.204872 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 10:39:51.204872 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 10:39:51.204872 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 10:39:51.204872 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 10:39:51.204872 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 10:39:51.204872 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 10:39:51.204872 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 14 10:39:51.204872 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application Jul 14 10:39:51.204872 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 248/491] 10.222.0.16 () {56 vars in 1102 bytes} [Thu Jul 14 10:39:51 2022] GET /identity/v3/roles/service => generated 85 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:39:51.205521 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b78115-3fda-4c09-a413-2905d01edf2e None admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:51.215833 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application [None req-0938565b-d153-442b-9e70-812e67221328 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 14 10:39:51.215833 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:39:51.215833 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:39:51.215833 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:39:51.215833 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:39:51.215833 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:39:51.215833 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:39:51.215833 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:39:51.215833 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:39:51.215833 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:39:51.215833 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:39:51.215833 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:39:51.215833 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 10:39:51.215833 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 10:39:51.215833 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 10:39:51.215833 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 10:39:51.216738 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:39:51.216738 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:39:51.216738 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 10:39:51.216738 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 10:39:51.216738 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 10:39:51.216738 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 10:39:51.216738 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:39:51.216738 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:39:51.216738 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:39:51.216738 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:39:51.216738 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:39:51.216738 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application with Lock( Jul 14 10:39:51.216738 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:39:51.216738 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:39:51.216738 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:39:51.216738 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:39:51.216738 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:39:51.216738 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:39:51.218236 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:39:51.218236 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:39:51.218236 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 10:39:51.218236 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 10:39:51.218236 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 10:39:51.218236 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 10:39:51.218236 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 10:39:51.218236 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 10:39:51.218236 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 14 10:39:51.218236 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application Jul 14 10:39:51.218236 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 244/492] 10.222.0.16 () {56 vars in 1093 bytes} [Thu Jul 14 10:39:51 2022] GET /identity/v3/users/nova => generated 82 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:39:51.218780 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bef6778-d362-4143-8297-3c1a1bfc2b4b None None] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:51.218851 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bef6778-d362-4143-8297-3c1a1bfc2b4b None None] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:51.219663 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bef6778-d362-4143-8297-3c1a1bfc2b4b None None] PATH_INFO: `/` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:51.225174 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 245/493] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jul 14 10:39:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:39:51.225174 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bef6778-d362-4143-8297-3c1a1bfc2b4b None None] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:51.292686 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=100 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:39:51.324194 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b78115-3fda-4c09-a413-2905d01edf2e None admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:51.327483 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bef6778-d362-4143-8297-3c1a1bfc2b4b None None] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:51.362460 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd102b02-5dce-4c6c-b539-0b15fcdc73b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:51.362803 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377545e8-a130-481b-baf4-16e6f3729e50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:51.363140 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd102b02-5dce-4c6c-b539-0b15fcdc73b5 None admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:51.363433 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd102b02-5dce-4c6c-b539-0b15fcdc73b5 None admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:51.363607 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377545e8-a130-481b-baf4-16e6f3729e50 None admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:51.363753 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd102b02-5dce-4c6c-b539-0b15fcdc73b5 None admin] PATH_INFO: `/v3/roles` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:51.363896 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377545e8-a130-481b-baf4-16e6f3729e50 None admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:51.364148 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377545e8-a130-481b-baf4-16e6f3729e50 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:51.364480 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd102b02-5dce-4c6c-b539-0b15fcdc73b5 None admin] RBAC: Adding query filter params (name=service) {{(pid=86655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:39:51.364821 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd102b02-5dce-4c6c-b539-0b15fcdc73b5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:39:51.366213 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd102b02-5dce-4c6c-b539-0b15fcdc73b5 None admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:39:51.376469 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 246/494] 10.222.0.16 () {56 vars in 1103 bytes} [Thu Jul 14 10:39:51 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:39:51.376469 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd102b02-5dce-4c6c-b539-0b15fcdc73b5 None admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:51.380300 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377545e8-a130-481b-baf4-16e6f3729e50 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 10:39:51.389294 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application [None req-377545e8-a130-481b-baf4-16e6f3729e50 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 14 10:39:51.389294 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:39:51.389294 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:39:51.389294 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:39:51.389294 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:39:51.389294 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:39:51.389294 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:39:51.389294 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:39:51.389294 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:39:51.389294 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:39:51.389294 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:39:51.389294 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:39:51.389294 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 10:39:51.389294 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 10:39:51.389294 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 10:39:51.389294 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 10:39:51.390343 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 10:39:51.390343 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 10:39:51.390343 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 10:39:51.390343 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 10:39:51.390343 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:39:51.390343 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:39:51.390343 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:39:51.390343 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:39:51.390343 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:39:51.390343 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:39:51.390343 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:39:51.390343 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application with Lock( Jul 14 10:39:51.390343 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:39:51.390343 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:39:51.390343 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:39:51.390343 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:39:51.391372 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:39:51.391372 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:39:51.391372 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:39:51.391372 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:39:51.391372 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 10:39:51.391372 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 10:39:51.391372 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 10:39:51.391372 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 10:39:51.391372 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 10:39:51.391372 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 10:39:51.391372 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 14 10:39:51.391372 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application Jul 14 10:39:51.391372 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 249/495] 10.222.0.16 () {56 vars in 1102 bytes} [Thu Jul 14 10:39:51 2022] GET /identity/v3/roles/service => generated 85 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:39:51.392031 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689f8286-f339-4c36-982a-b774451744dc None None] REQUEST_METHOD: `POST` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:51.392095 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689f8286-f339-4c36-982a-b774451744dc None None] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:51.392715 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689f8286-f339-4c36-982a-b774451744dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:51.416829 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.auth.core [None req-689f8286-f339-4c36-982a-b774451744dc None None] MFA Rules not processed for user `ae4bcdd8106d4bebbdcae96be33505bc`. Rule list: `[]` (Enabled: `True`). {{(pid=86656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:39:51.418031 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-689f8286-f339-4c36-982a-b774451744dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:39:51.470992 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=100 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:39:51.482975 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd102b02-5dce-4c6c-b539-0b15fcdc73b5 None admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:51.499232 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 250/496] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jul 14 10:39:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 10:39:51.500084 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689f8286-f339-4c36-982a-b774451744dc None None] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:51.525282 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=100 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:39:51.531532 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b826dbf-d05d-47a0-983d-8e2ddfc4a895 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:51.532217 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b826dbf-d05d-47a0-983d-8e2ddfc4a895 None admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:51.532651 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b826dbf-d05d-47a0-983d-8e2ddfc4a895 None admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:51.533138 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b826dbf-d05d-47a0-983d-8e2ddfc4a895 None admin] PATH_INFO: `/v3/users` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:51.533914 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b826dbf-d05d-47a0-983d-8e2ddfc4a895 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:39:51.534210 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b826dbf-d05d-47a0-983d-8e2ddfc4a895 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:39:51.535664 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b826dbf-d05d-47a0-983d-8e2ddfc4a895 None admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:39:51.575722 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 247/497] 10.222.0.16 () {56 vars in 1133 bytes} [Thu Jul 14 10:39:51 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:39:51.576569 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b826dbf-d05d-47a0-983d-8e2ddfc4a895 None admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:51.624080 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689f8286-f339-4c36-982a-b774451744dc None None] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:51.658893 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d7690a-c5eb-4d83-9dc1-091492c674c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:51.659699 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d7690a-c5eb-4d83-9dc1-091492c674c1 None admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:51.659985 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d7690a-c5eb-4d83-9dc1-091492c674c1 None admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:51.660258 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d7690a-c5eb-4d83-9dc1-091492c674c1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:51.670243 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d7690a-c5eb-4d83-9dc1-091492c674c1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:39:51.671706 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d7690a-c5eb-4d83-9dc1-091492c674c1 None admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:39:51.688540 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b826dbf-d05d-47a0-983d-8e2ddfc4a895 None admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:51.690465 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application [None req-98d7690a-c5eb-4d83-9dc1-091492c674c1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 10:39:51.690465 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:39:51.690465 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:39:51.690465 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:39:51.690465 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:39:51.690465 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:39:51.690465 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:39:51.690465 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:39:51.690465 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:39:51.690465 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:39:51.690465 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:39:51.690465 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:39:51.690465 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 10:39:51.690465 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 10:39:51.690465 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 10:39:51.691336 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 10:39:51.691336 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:39:51.691336 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:39:51.691336 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:39:51.691336 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:39:51.691336 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:39:51.691336 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:39:51.691336 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:39:51.691336 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application with Lock( Jul 14 10:39:51.691336 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:39:51.691336 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:39:51.691336 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:39:51.691336 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:39:51.691336 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:39:51.691336 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:39:51.691336 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:39:51.691336 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:39:51.692426 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 10:39:51.692426 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 10:39:51.692426 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 10:39:51.692426 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application Jul 14 10:39:51.692426 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 251/498] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Jul 14 10:39:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:39:51.692426 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d7690a-c5eb-4d83-9dc1-091492c674c1 None admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:51.728592 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=100 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:39:51.734138 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88152a9-e8e3-41b5-bdac-0e151e0b0dd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:51.735818 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88152a9-e8e3-41b5-bdac-0e151e0b0dd6 None admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:51.736252 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88152a9-e8e3-41b5-bdac-0e151e0b0dd6 None admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:51.736674 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88152a9-e8e3-41b5-bdac-0e151e0b0dd6 None admin] PATH_INFO: `/v3/roles` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:51.737607 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88152a9-e8e3-41b5-bdac-0e151e0b0dd6 None admin] RBAC: Adding query filter params (name=service) {{(pid=86655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:39:51.738063 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88152a9-e8e3-41b5-bdac-0e151e0b0dd6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:39:51.739621 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88152a9-e8e3-41b5-bdac-0e151e0b0dd6 None admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:39:51.748067 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 248/499] 10.222.0.16 () {56 vars in 1103 bytes} [Thu Jul 14 10:39:51 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:39:51.749052 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88152a9-e8e3-41b5-bdac-0e151e0b0dd6 None admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:51.811581 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d7690a-c5eb-4d83-9dc1-091492c674c1 None admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:51.816927 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=100 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:39:51.849830 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d41413-decf-479d-8ae3-2f78283a9b7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:51.850638 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d41413-decf-479d-8ae3-2f78283a9b7e None admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:51.850927 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d41413-decf-479d-8ae3-2f78283a9b7e None admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:51.851209 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d41413-decf-479d-8ae3-2f78283a9b7e None admin] PATH_INFO: `/v3/roles/service` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:51.863642 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d41413-decf-479d-8ae3-2f78283a9b7e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 10:39:51.869957 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88152a9-e8e3-41b5-bdac-0e151e0b0dd6 None admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:51.871608 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application [None req-06d41413-decf-479d-8ae3-2f78283a9b7e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 14 10:39:51.871608 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:39:51.871608 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:39:51.871608 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:39:51.871608 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:39:51.871608 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:39:51.871608 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:39:51.871608 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:39:51.871608 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:39:51.871608 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:39:51.871608 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:39:51.871608 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:39:51.871608 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 10:39:51.871608 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 10:39:51.871608 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 10:39:51.871608 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 10:39:51.872472 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 10:39:51.872472 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 10:39:51.872472 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 10:39:51.872472 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 10:39:51.872472 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:39:51.872472 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:39:51.872472 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:39:51.872472 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:39:51.872472 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:39:51.872472 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:39:51.872472 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:39:51.872472 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application with Lock( Jul 14 10:39:51.872472 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:39:51.872472 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:39:51.872472 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:39:51.872472 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:39:51.874616 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:39:51.874616 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:39:51.874616 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:39:51.874616 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:39:51.874616 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 10:39:51.874616 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 10:39:51.874616 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 10:39:51.874616 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 10:39:51.874616 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 10:39:51.874616 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 10:39:51.874616 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 14 10:39:51.874616 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application Jul 14 10:39:51.874616 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 252/500] 10.222.0.16 () {56 vars in 1102 bytes} [Thu Jul 14 10:39:51 2022] GET /identity/v3/roles/service => generated 85 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:39:51.876291 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d41413-decf-479d-8ae3-2f78283a9b7e None admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:51.905384 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978ab089-bed7-4d01-89e2-51ad6dea1d32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:51.906040 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978ab089-bed7-4d01-89e2-51ad6dea1d32 None admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:51.906318 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978ab089-bed7-4d01-89e2-51ad6dea1d32 None admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:51.907232 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978ab089-bed7-4d01-89e2-51ad6dea1d32 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:51.972291 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=100 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:39:51.978326 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978ab089-bed7-4d01-89e2-51ad6dea1d32 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:39:51.979766 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d41413-decf-479d-8ae3-2f78283a9b7e None admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:51.979874 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978ab089-bed7-4d01-89e2-51ad6dea1d32 None admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:39:52.012900 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4550223-58cc-461b-bb5a-5a419e8bd9e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:52.013565 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4550223-58cc-461b-bb5a-5a419e8bd9e7 None admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:52.013849 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4550223-58cc-461b-bb5a-5a419e8bd9e7 None admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:52.014128 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4550223-58cc-461b-bb5a-5a419e8bd9e7 None admin] PATH_INFO: `/v3/domains` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:52.014852 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4550223-58cc-461b-bb5a-5a419e8bd9e7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:39:52.015164 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4550223-58cc-461b-bb5a-5a419e8bd9e7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:39:52.017271 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4550223-58cc-461b-bb5a-5a419e8bd9e7 None admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:39:52.029301 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 253/501] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Jul 14 10:39:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:39:52.030084 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4550223-58cc-461b-bb5a-5a419e8bd9e7 None admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:52.034353 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=100 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:39:52.079595 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 249/502] 10.222.0.16 () {58 vars in 1282 bytes} [Thu Jul 14 10:39:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 10:39:52.080826 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476f551a-8557-4bd9-bbe8-2870bb15c4c8 None None] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:52.081127 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476f551a-8557-4bd9-bbe8-2870bb15c4c8 None None] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:52.081410 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476f551a-8557-4bd9-bbe8-2870bb15c4c8 None None] PATH_INFO: `/` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:52.082680 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 250/503] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jul 14 10:39:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:39:52.087274 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476f551a-8557-4bd9-bbe8-2870bb15c4c8 None None] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:52.133910 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4550223-58cc-461b-bb5a-5a419e8bd9e7 None admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:52.168408 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b386de-066b-4514-850a-74d75d2a91ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:52.169232 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b386de-066b-4514-850a-74d75d2a91ab None admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:52.169570 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b386de-066b-4514-850a-74d75d2a91ab None admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:52.169857 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b386de-066b-4514-850a-74d75d2a91ab None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:52.180032 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b386de-066b-4514-850a-74d75d2a91ab None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:39:52.181513 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b386de-066b-4514-850a-74d75d2a91ab None admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:39:52.185947 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476f551a-8557-4bd9-bbe8-2870bb15c4c8 None None] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:52.199445 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application [None req-37b386de-066b-4514-850a-74d75d2a91ab None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 10:39:52.199445 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:39:52.199445 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:39:52.199445 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:39:52.199445 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:39:52.199445 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:39:52.199445 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:39:52.199445 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:39:52.199445 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:39:52.199445 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:39:52.199445 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:39:52.199445 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:39:52.199445 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 10:39:52.199445 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 10:39:52.199445 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 10:39:52.200284 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 10:39:52.200284 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:39:52.200284 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:39:52.200284 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:39:52.200284 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:39:52.200284 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:39:52.200284 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:39:52.200284 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:39:52.200284 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application with Lock( Jul 14 10:39:52.200284 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:39:52.200284 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:39:52.200284 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:39:52.200284 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:39:52.200284 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:39:52.200284 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:39:52.200284 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:39:52.200284 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:39:52.201513 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 10:39:52.201513 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 10:39:52.201513 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 10:39:52.201513 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application Jul 14 10:39:52.201513 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 254/504] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Jul 14 10:39:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:39:52.201513 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b386de-066b-4514-850a-74d75d2a91ab None admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:52.210150 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=100 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:39:52.222283 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26b2128-ce10-4a2a-b315-d795946e49b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:52.222969 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26b2128-ce10-4a2a-b315-d795946e49b8 None admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:52.223267 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26b2128-ce10-4a2a-b315-d795946e49b8 None admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:52.223525 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26b2128-ce10-4a2a-b315-d795946e49b8 None admin] PATH_INFO: `/v3/roles` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:52.224272 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26b2128-ce10-4a2a-b315-d795946e49b8 None admin] RBAC: Adding query filter params (name=service) {{(pid=86655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:39:52.224576 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26b2128-ce10-4a2a-b315-d795946e49b8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:39:52.225989 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26b2128-ce10-4a2a-b315-d795946e49b8 None admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:39:52.233911 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 251/505] 10.222.0.16 () {56 vars in 1103 bytes} [Thu Jul 14 10:39:52 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:39:52.235413 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26b2128-ce10-4a2a-b315-d795946e49b8 None admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:52.251943 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=100 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:39:52.303365 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b386de-066b-4514-850a-74d75d2a91ab None admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:52.335665 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26b2128-ce10-4a2a-b315-d795946e49b8 None admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:52.338317 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee2ddf7-f141-4cb0-ac96-574876953206 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:52.339448 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee2ddf7-f141-4cb0-ac96-574876953206 None admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:52.339788 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee2ddf7-f141-4cb0-ac96-574876953206 None admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:52.340070 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee2ddf7-f141-4cb0-ac96-574876953206 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:52.349397 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee2ddf7-f141-4cb0-ac96-574876953206 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:39:52.350849 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee2ddf7-f141-4cb0-ac96-574876953206 None admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:39:52.366141 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application [None req-9ee2ddf7-f141-4cb0-ac96-574876953206 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 14 10:39:52.366141 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:39:52.366141 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:39:52.366141 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:39:52.366141 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:39:52.366141 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:39:52.366141 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:39:52.366141 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:39:52.366141 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:39:52.366141 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:39:52.366141 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:39:52.366141 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:39:52.366141 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 10:39:52.366141 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 10:39:52.366141 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 10:39:52.366141 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 10:39:52.367029 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:39:52.367029 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:39:52.367029 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 10:39:52.367029 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 10:39:52.367029 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 10:39:52.367029 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 10:39:52.367029 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:39:52.367029 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:39:52.367029 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:39:52.367029 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:39:52.367029 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:39:52.367029 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application with Lock( Jul 14 10:39:52.367029 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:39:52.367029 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:39:52.367029 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:39:52.367029 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:39:52.367029 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:39:52.367029 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:39:52.367905 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:39:52.367905 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:39:52.367905 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 10:39:52.367905 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 10:39:52.367905 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 10:39:52.367905 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 10:39:52.367905 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 10:39:52.367905 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 10:39:52.367905 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 14 10:39:52.367905 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application Jul 14 10:39:52.367905 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 255/506] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Jul 14 10:39:52 2022] GET /identity/v3/users/cinder => generated 84 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:39:52.368512 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a337c96f-de14-4412-b199-e87af41fd070 None None] REQUEST_METHOD: `POST` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:52.368864 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a337c96f-de14-4412-b199-e87af41fd070 None None] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:52.369173 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a337c96f-de14-4412-b199-e87af41fd070 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:52.373190 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24281c9-9f06-4e3d-9a02-b387508f11a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:52.373983 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24281c9-9f06-4e3d-9a02-b387508f11a9 None admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:52.374287 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24281c9-9f06-4e3d-9a02-b387508f11a9 None admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:52.374561 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24281c9-9f06-4e3d-9a02-b387508f11a9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:52.385413 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24281c9-9f06-4e3d-9a02-b387508f11a9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:39:52.386311 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.auth.core [None req-a337c96f-de14-4412-b199-e87af41fd070 None None] MFA Rules not processed for user `ae4bcdd8106d4bebbdcae96be33505bc`. Rule list: `[]` (Enabled: `True`). {{(pid=86656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:39:52.386872 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24281c9-9f06-4e3d-9a02-b387508f11a9 None admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:39:52.387503 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-a337c96f-de14-4412-b199-e87af41fd070 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:39:52.404197 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application [None req-b24281c9-9f06-4e3d-9a02-b387508f11a9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 10:39:52.404197 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:39:52.404197 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:39:52.404197 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:39:52.404197 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:39:52.404197 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:39:52.404197 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:39:52.404197 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:39:52.404197 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:39:52.404197 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:39:52.404197 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:39:52.404197 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:39:52.404197 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 10:39:52.404197 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 10:39:52.404197 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 10:39:52.405083 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 10:39:52.405083 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:39:52.405083 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:39:52.405083 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:39:52.405083 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:39:52.405083 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:39:52.405083 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:39:52.405083 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:39:52.405083 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application with Lock( Jul 14 10:39:52.405083 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:39:52.405083 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:39:52.405083 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:39:52.405083 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:39:52.405083 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:39:52.405083 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:39:52.405083 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:39:52.405083 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:39:52.406008 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 10:39:52.406008 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 10:39:52.406008 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 10:39:52.406008 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application Jul 14 10:39:52.406008 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 252/507] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Jul 14 10:39:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:39:52.406268 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24281c9-9f06-4e3d-9a02-b387508f11a9 None admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:52.448527 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=100 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:39:52.457302 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 256/508] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jul 14 10:39:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 10:39:52.458184 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a337c96f-de14-4412-b199-e87af41fd070 None None] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:52.469885 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=100 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:39:52.504842 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24281c9-9f06-4e3d-9a02-b387508f11a9 None admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:52.537979 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d305bcd8-3c62-4398-b148-78cd05c3d1bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:52.538638 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d305bcd8-3c62-4398-b148-78cd05c3d1bc None admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:52.538919 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d305bcd8-3c62-4398-b148-78cd05c3d1bc None admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:52.539203 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d305bcd8-3c62-4398-b148-78cd05c3d1bc None admin] PATH_INFO: `/v3/domains` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:52.539926 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d305bcd8-3c62-4398-b148-78cd05c3d1bc None admin] RBAC: Adding query filter params (name=Default) {{(pid=86655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:39:52.540232 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d305bcd8-3c62-4398-b148-78cd05c3d1bc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:39:52.541631 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d305bcd8-3c62-4398-b148-78cd05c3d1bc None admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:39:52.554161 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 253/509] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Jul 14 10:39:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:39:52.554952 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d305bcd8-3c62-4398-b148-78cd05c3d1bc None admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:52.576801 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a337c96f-de14-4412-b199-e87af41fd070 None None] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:52.609350 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2f64ba-503f-4acf-955d-4fd810a186cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:52.610178 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2f64ba-503f-4acf-955d-4fd810a186cc None admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:52.610463 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2f64ba-503f-4acf-955d-4fd810a186cc None admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:52.610733 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2f64ba-503f-4acf-955d-4fd810a186cc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:52.620659 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2f64ba-503f-4acf-955d-4fd810a186cc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:39:52.622147 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2f64ba-503f-4acf-955d-4fd810a186cc None admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:39:52.641642 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application [None req-0c2f64ba-503f-4acf-955d-4fd810a186cc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 10:39:52.641642 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:39:52.641642 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:39:52.641642 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:39:52.641642 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:39:52.641642 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:39:52.641642 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:39:52.641642 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:39:52.641642 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:39:52.641642 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:39:52.641642 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:39:52.641642 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:39:52.641642 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 10:39:52.641642 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 10:39:52.641642 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 10:39:52.642513 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 10:39:52.642513 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:39:52.642513 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:39:52.642513 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:39:52.642513 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:39:52.642513 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:39:52.642513 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:39:52.642513 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:39:52.642513 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application with Lock( Jul 14 10:39:52.642513 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:39:52.642513 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:39:52.642513 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:39:52.642513 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:39:52.642513 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:39:52.642513 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:39:52.642513 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:39:52.642513 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:39:52.643377 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 10:39:52.643377 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 10:39:52.643377 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 10:39:52.643377 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application Jul 14 10:39:52.644917 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 257/510] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Jul 14 10:39:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:39:52.645884 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2f64ba-503f-4acf-955d-4fd810a186cc None admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:52.658841 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d305bcd8-3c62-4398-b148-78cd05c3d1bc None admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:52.685123 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=100 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:39:52.695121 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79c20ed-d03d-4025-bd0e-ac929c08f87e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:52.695796 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79c20ed-d03d-4025-bd0e-ac929c08f87e None admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:52.695948 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=100 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:39:52.696081 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79c20ed-d03d-4025-bd0e-ac929c08f87e None admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:52.696361 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79c20ed-d03d-4025-bd0e-ac929c08f87e None admin] PATH_INFO: `/v3/users` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:52.697535 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79c20ed-d03d-4025-bd0e-ac929c08f87e None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=86655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:39:52.697847 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79c20ed-d03d-4025-bd0e-ac929c08f87e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:39:52.699295 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79c20ed-d03d-4025-bd0e-ac929c08f87e None admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:39:52.716497 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 254/511] 10.222.0.16 () {56 vars in 1137 bytes} [Thu Jul 14 10:39:52 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:39:52.717501 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79c20ed-d03d-4025-bd0e-ac929c08f87e None admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:52.746505 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2f64ba-503f-4acf-955d-4fd810a186cc None admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:52.779983 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c0f4ed-b0b8-42c6-b175-9313af0944c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:52.780582 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c0f4ed-b0b8-42c6-b175-9313af0944c6 None admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:52.780888 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c0f4ed-b0b8-42c6-b175-9313af0944c6 None admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:52.781162 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c0f4ed-b0b8-42c6-b175-9313af0944c6 None admin] PATH_INFO: `/v3/domains` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:52.782406 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c0f4ed-b0b8-42c6-b175-9313af0944c6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:39:52.782713 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c0f4ed-b0b8-42c6-b175-9313af0944c6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:39:52.784086 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c0f4ed-b0b8-42c6-b175-9313af0944c6 None admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:39:52.796083 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 258/512] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Jul 14 10:39:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:39:52.797683 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c0f4ed-b0b8-42c6-b175-9313af0944c6 None admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:52.823438 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79c20ed-d03d-4025-bd0e-ac929c08f87e None admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:52.858370 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43001488-e85e-4394-8fb8-bbbc25d9beee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:52.859173 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43001488-e85e-4394-8fb8-bbbc25d9beee None admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:52.859455 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43001488-e85e-4394-8fb8-bbbc25d9beee None admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:52.860352 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43001488-e85e-4394-8fb8-bbbc25d9beee None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:52.870523 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43001488-e85e-4394-8fb8-bbbc25d9beee None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:39:52.871985 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43001488-e85e-4394-8fb8-bbbc25d9beee None admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:39:52.889367 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application [None req-43001488-e85e-4394-8fb8-bbbc25d9beee None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 10:39:52.889367 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:39:52.889367 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:39:52.889367 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:39:52.889367 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:39:52.889367 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:39:52.889367 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:39:52.889367 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:39:52.889367 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:39:52.889367 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:39:52.889367 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:39:52.889367 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:39:52.889367 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 10:39:52.889367 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 10:39:52.889367 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 10:39:52.890193 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 10:39:52.890193 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:39:52.890193 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:39:52.890193 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:39:52.890193 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:39:52.890193 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:39:52.890193 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:39:52.890193 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:39:52.890193 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application with Lock( Jul 14 10:39:52.890193 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:39:52.890193 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:39:52.890193 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:39:52.890193 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:39:52.890193 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:39:52.890193 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:39:52.890193 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:39:52.890193 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:39:52.891068 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 10:39:52.891068 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 10:39:52.891068 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 10:39:52.891068 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application Jul 14 10:39:52.891068 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 255/513] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Jul 14 10:39:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:39:52.891732 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43001488-e85e-4394-8fb8-bbbc25d9beee None admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:52.900735 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c0f4ed-b0b8-42c6-b175-9313af0944c6 None admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:52.910768 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=100 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:39:52.926162 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=100 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:39:52.936122 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8afff2e-d28b-45e8-8ed4-9ed1405e2f9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:52.937213 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8afff2e-d28b-45e8-8ed4-9ed1405e2f9b None admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:52.937522 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8afff2e-d28b-45e8-8ed4-9ed1405e2f9b None admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:52.938325 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8afff2e-d28b-45e8-8ed4-9ed1405e2f9b None admin] PATH_INFO: `/v3/users/neutron` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:52.945316 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8afff2e-d28b-45e8-8ed4-9ed1405e2f9b None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:39:52.946786 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8afff2e-d28b-45e8-8ed4-9ed1405e2f9b None admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:39:52.960994 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application [None req-e8afff2e-d28b-45e8-8ed4-9ed1405e2f9b None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 14 10:39:52.960994 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:39:52.960994 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:39:52.960994 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:39:52.960994 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:39:52.960994 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:39:52.960994 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:39:52.960994 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:39:52.960994 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:39:52.960994 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:39:52.960994 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:39:52.960994 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:39:52.960994 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 10:39:52.960994 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 10:39:52.960994 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 10:39:52.960994 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 10:39:52.962051 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:39:52.962051 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:39:52.962051 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 10:39:52.962051 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 10:39:52.962051 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 10:39:52.962051 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 10:39:52.962051 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:39:52.962051 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:39:52.962051 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:39:52.962051 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:39:52.962051 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:39:52.962051 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application with Lock( Jul 14 10:39:52.962051 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:39:52.962051 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:39:52.962051 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:39:52.962051 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:39:52.962051 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:39:52.962051 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:39:52.967439 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:39:52.967439 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:39:52.967439 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 10:39:52.967439 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 10:39:52.967439 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 10:39:52.967439 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 10:39:52.967439 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 10:39:52.967439 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 10:39:52.967439 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 14 10:39:52.967439 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application Jul 14 10:39:52.967439 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 259/514] 10.222.0.16 () {56 vars in 1102 bytes} [Thu Jul 14 10:39:52 2022] GET /identity/v3/users/neutron => generated 85 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:39:52.967439 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8afff2e-d28b-45e8-8ed4-9ed1405e2f9b None admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:53.000192 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43001488-e85e-4394-8fb8-bbbc25d9beee None admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:53.034191 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea44c5a7-cc40-465a-bf57-71f6bcb94600 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:53.034785 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea44c5a7-cc40-465a-bf57-71f6bcb94600 None admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:53.035329 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea44c5a7-cc40-465a-bf57-71f6bcb94600 None admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:53.035329 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea44c5a7-cc40-465a-bf57-71f6bcb94600 None admin] PATH_INFO: `/v3/domains` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:53.036054 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea44c5a7-cc40-465a-bf57-71f6bcb94600 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:39:53.036360 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea44c5a7-cc40-465a-bf57-71f6bcb94600 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:39:53.037773 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea44c5a7-cc40-465a-bf57-71f6bcb94600 None admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:39:53.049239 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 256/515] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Jul 14 10:39:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:39:53.050034 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea44c5a7-cc40-465a-bf57-71f6bcb94600 None admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:53.060991 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8afff2e-d28b-45e8-8ed4-9ed1405e2f9b None admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:53.095367 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87c5981-28da-49c3-9080-f3f0e9a09955 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:53.096016 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87c5981-28da-49c3-9080-f3f0e9a09955 None admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:53.096302 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87c5981-28da-49c3-9080-f3f0e9a09955 None admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:53.096577 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87c5981-28da-49c3-9080-f3f0e9a09955 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:53.130102 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=100 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:39:53.142107 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=100 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:39:53.148245 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea44c5a7-cc40-465a-bf57-71f6bcb94600 None admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:53.163881 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87c5981-28da-49c3-9080-f3f0e9a09955 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:39:53.165373 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87c5981-28da-49c3-9080-f3f0e9a09955 None admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:39:53.181227 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca51b3f1-1442-4184-a530-287b86cce8f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:53.182017 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca51b3f1-1442-4184-a530-287b86cce8f0 None admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:53.182302 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca51b3f1-1442-4184-a530-287b86cce8f0 None admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:53.182586 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca51b3f1-1442-4184-a530-287b86cce8f0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:53.189429 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca51b3f1-1442-4184-a530-287b86cce8f0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:39:53.190850 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca51b3f1-1442-4184-a530-287b86cce8f0 None admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:39:53.206141 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application [None req-ca51b3f1-1442-4184-a530-287b86cce8f0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 10:39:53.206141 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:39:53.206141 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:39:53.206141 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:39:53.206141 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:39:53.206141 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:39:53.206141 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:39:53.206141 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:39:53.206141 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:39:53.206141 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:39:53.206141 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:39:53.206141 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:39:53.206141 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 10:39:53.206141 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 10:39:53.206141 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 10:39:53.206978 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 10:39:53.206978 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:39:53.206978 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:39:53.206978 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:39:53.206978 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:39:53.206978 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:39:53.206978 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:39:53.206978 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:39:53.206978 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application with Lock( Jul 14 10:39:53.206978 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:39:53.206978 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:39:53.206978 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:39:53.206978 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:39:53.206978 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:39:53.206978 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:39:53.206978 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:39:53.206978 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:39:53.207802 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 10:39:53.207802 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 10:39:53.207802 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 10:39:53.207802 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 10:39:53.207802 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 10:39:53.207802 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 10:39:53.207802 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 10:39:53.207802 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application Jul 14 10:39:53.207802 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 257/516] 10.222.0.16 () {56 vars in 1111 bytes} [Thu Jul 14 10:39:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:39:53.208270 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca51b3f1-1442-4184-a530-287b86cce8f0 None admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:53.264721 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 260/517] 10.222.0.16 () {58 vars in 1282 bytes} [Thu Jul 14 10:39:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 10:39:53.265582 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87c5981-28da-49c3-9080-f3f0e9a09955 None admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:53.305383 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca51b3f1-1442-4184-a530-287b86cce8f0 None admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:53.330981 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=100 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:39:53.339651 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b317dc8-4cfa-42a7-b631-68eb0be72f98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:53.340312 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b317dc8-4cfa-42a7-b631-68eb0be72f98 None admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:53.340603 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b317dc8-4cfa-42a7-b631-68eb0be72f98 None admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:53.340917 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b317dc8-4cfa-42a7-b631-68eb0be72f98 None admin] PATH_INFO: `/v3/domains` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:53.341655 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b317dc8-4cfa-42a7-b631-68eb0be72f98 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:39:53.341962 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b317dc8-4cfa-42a7-b631-68eb0be72f98 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:39:53.343330 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b317dc8-4cfa-42a7-b631-68eb0be72f98 None admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:39:53.355252 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 258/518] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Jul 14 10:39:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:39:53.356048 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b317dc8-4cfa-42a7-b631-68eb0be72f98 None admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:53.364002 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87c5981-28da-49c3-9080-f3f0e9a09955 None admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:53.375597 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=100 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:39:53.399613 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04010af-acea-459a-be6d-e27f38b4bd4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:53.400478 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04010af-acea-459a-be6d-e27f38b4bd4d None admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:53.400756 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04010af-acea-459a-be6d-e27f38b4bd4d None admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:53.401061 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04010af-acea-459a-be6d-e27f38b4bd4d None admin] PATH_INFO: `/v3/users` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:53.401890 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04010af-acea-459a-be6d-e27f38b4bd4d None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=86656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:39:53.402196 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04010af-acea-459a-be6d-e27f38b4bd4d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:39:53.403623 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04010af-acea-459a-be6d-e27f38b4bd4d None admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:39:53.439935 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 261/519] 10.222.0.16 () {56 vars in 1139 bytes} [Thu Jul 14 10:39:53 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:39:53.440993 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04010af-acea-459a-be6d-e27f38b4bd4d None admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:53.455780 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b317dc8-4cfa-42a7-b631-68eb0be72f98 None admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:53.490155 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2ae5e7-086d-4224-850a-7bdad39db5ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:53.490951 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2ae5e7-086d-4224-850a-7bdad39db5ca None admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:53.491237 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2ae5e7-086d-4224-850a-7bdad39db5ca None admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:53.491512 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2ae5e7-086d-4224-850a-7bdad39db5ca None admin] PATH_INFO: `/v3/users/glance` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:53.498879 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2ae5e7-086d-4224-850a-7bdad39db5ca None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:39:53.500504 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2ae5e7-086d-4224-850a-7bdad39db5ca None admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:39:53.514372 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application [None req-1f2ae5e7-086d-4224-850a-7bdad39db5ca None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 14 10:39:53.514372 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:39:53.514372 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:39:53.514372 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:39:53.514372 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:39:53.514372 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:39:53.514372 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:39:53.514372 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:39:53.514372 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:39:53.514372 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:39:53.514372 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:39:53.514372 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:39:53.514372 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 10:39:53.514372 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 10:39:53.514372 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 10:39:53.514372 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 10:39:53.515285 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:39:53.515285 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:39:53.515285 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 10:39:53.515285 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 10:39:53.515285 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 10:39:53.515285 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 10:39:53.515285 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:39:53.515285 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:39:53.515285 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:39:53.515285 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:39:53.515285 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:39:53.515285 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application with Lock( Jul 14 10:39:53.515285 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:39:53.515285 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:39:53.515285 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:39:53.515285 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:39:53.515285 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:39:53.515285 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:39:53.516199 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:39:53.516199 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:39:53.516199 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 10:39:53.516199 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 10:39:53.516199 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 10:39:53.516199 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 10:39:53.516199 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 10:39:53.516199 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 10:39:53.516199 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 14 10:39:53.516199 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application Jul 14 10:39:53.516199 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 259/520] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Jul 14 10:39:53 2022] GET /identity/v3/users/glance => generated 84 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:39:53.516736 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2ae5e7-086d-4224-850a-7bdad39db5ca None admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:53.538726 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04010af-acea-459a-be6d-e27f38b4bd4d None admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:53.564489 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=100 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:39:53.573397 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01bdbf5-ddbf-4e93-8cf1-d561205dc1da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:53.574054 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01bdbf5-ddbf-4e93-8cf1-d561205dc1da None admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:53.574340 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01bdbf5-ddbf-4e93-8cf1-d561205dc1da None admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:53.574617 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01bdbf5-ddbf-4e93-8cf1-d561205dc1da None admin] PATH_INFO: `/v3/projects` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:53.575396 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01bdbf5-ddbf-4e93-8cf1-d561205dc1da None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:39:53.575706 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01bdbf5-ddbf-4e93-8cf1-d561205dc1da None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:39:53.577175 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01bdbf5-ddbf-4e93-8cf1-d561205dc1da None admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:39:53.595200 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 262/521] 10.222.0.16 () {56 vars in 1148 bytes} [Thu Jul 14 10:39:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:39:53.595908 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=100 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:39:53.596036 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01bdbf5-ddbf-4e93-8cf1-d561205dc1da None admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:53.619293 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2ae5e7-086d-4224-850a-7bdad39db5ca None admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:53.651756 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92857055-0c5f-4bbb-8699-929af2b9b776 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:53.652547 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92857055-0c5f-4bbb-8699-929af2b9b776 None admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:53.652864 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92857055-0c5f-4bbb-8699-929af2b9b776 None admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:53.653145 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92857055-0c5f-4bbb-8699-929af2b9b776 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:53.664642 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92857055-0c5f-4bbb-8699-929af2b9b776 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:39:53.666146 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92857055-0c5f-4bbb-8699-929af2b9b776 None admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:39:53.683574 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application [None req-92857055-0c5f-4bbb-8699-929af2b9b776 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 10:39:53.683574 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:39:53.683574 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:39:53.683574 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:39:53.683574 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:39:53.683574 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:39:53.683574 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:39:53.683574 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:39:53.683574 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:39:53.683574 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:39:53.683574 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:39:53.683574 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:39:53.683574 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 10:39:53.683574 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 10:39:53.683574 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 10:39:53.684575 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 10:39:53.684575 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:39:53.684575 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:39:53.684575 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:39:53.684575 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:39:53.684575 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:39:53.684575 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:39:53.684575 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:39:53.684575 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application with Lock( Jul 14 10:39:53.684575 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:39:53.684575 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:39:53.684575 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:39:53.684575 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:39:53.684575 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:39:53.684575 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:39:53.684575 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:39:53.684575 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:39:53.685704 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 10:39:53.685704 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 10:39:53.685704 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 10:39:53.685704 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application Jul 14 10:39:53.685704 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 260/522] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Jul 14 10:39:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:39:53.686090 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92857055-0c5f-4bbb-8699-929af2b9b776 None admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:53.702492 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01bdbf5-ddbf-4e93-8cf1-d561205dc1da None admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:53.735814 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204aabdf-bbd1-4960-8fc2-460fcd9dd20e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:53.736483 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204aabdf-bbd1-4960-8fc2-460fcd9dd20e None admin] REQUEST_METHOD: `POST` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:53.736764 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204aabdf-bbd1-4960-8fc2-460fcd9dd20e None admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:53.737070 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204aabdf-bbd1-4960-8fc2-460fcd9dd20e None admin] PATH_INFO: `/v3/users` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:53.737780 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204aabdf-bbd1-4960-8fc2-460fcd9dd20e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:39:53.739225 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204aabdf-bbd1-4960-8fc2-460fcd9dd20e None admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:39:53.758224 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 263/523] 10.222.0.16 () {60 vars in 1132 bytes} [Thu Jul 14 10:39:53 2022] POST /identity/v3/users => generated 247 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:39:53.759042 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204aabdf-bbd1-4960-8fc2-460fcd9dd20e None admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:53.791916 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92857055-0c5f-4bbb-8699-929af2b9b776 None admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:53.830509 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:39:53.834066 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=100 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:39:53.844418 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d103be6-230f-44be-9544-9b9ff19bbff2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:53.845672 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d103be6-230f-44be-9544-9b9ff19bbff2 None admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:53.845971 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d103be6-230f-44be-9544-9b9ff19bbff2 None admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:53.846309 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d103be6-230f-44be-9544-9b9ff19bbff2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:53.904036 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204aabdf-bbd1-4960-8fc2-460fcd9dd20e None admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:53.937405 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d103be6-230f-44be-9544-9b9ff19bbff2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:39:53.940084 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d103be6-230f-44be-9544-9b9ff19bbff2 None admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:39:53.946506 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2581268a-82d0-44e1-9529-f6d7aa843a67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:53.947195 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2581268a-82d0-44e1-9529-f6d7aa843a67 None admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:53.947478 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2581268a-82d0-44e1-9529-f6d7aa843a67 None admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:53.947754 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2581268a-82d0-44e1-9529-f6d7aa843a67 None admin] PATH_INFO: `/v3/users` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:53.949420 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2581268a-82d0-44e1-9529-f6d7aa843a67 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=86656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:39:53.949524 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2581268a-82d0-44e1-9529-f6d7aa843a67 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:39:53.952995 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2581268a-82d0-44e1-9529-f6d7aa843a67 None admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:39:53.973244 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 264/524] 10.222.0.16 () {56 vars in 1137 bytes} [Thu Jul 14 10:39:53 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:39:53.974091 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2581268a-82d0-44e1-9529-f6d7aa843a67 None admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:54.054327 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 261/525] 10.222.0.16 () {58 vars in 1282 bytes} [Thu Jul 14 10:39:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 10:39:54.055181 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d103be6-230f-44be-9544-9b9ff19bbff2 None admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:54.077890 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=100 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:39:54.082327 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2581268a-82d0-44e1-9529-f6d7aa843a67 None admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:54.085909 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=100 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:39:54.121113 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e6ef56-264b-4619-99e7-d1629fe1b72b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:54.121774 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e6ef56-264b-4619-99e7-d1629fe1b72b None admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:54.122059 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e6ef56-264b-4619-99e7-d1629fe1b72b None admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:54.122340 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e6ef56-264b-4619-99e7-d1629fe1b72b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:54.123178 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e6ef56-264b-4619-99e7-d1629fe1b72b None admin] RBAC: Adding query filter params (role.id=d58911e96aad48cf9ca61ac5df79e21d, scope.project.id=59391272ecbe48b0aa736cb43807be1d, user.id=26aa294c913c408499a913ec25bb677d) {{(pid=86656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:39:54.123489 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e6ef56-264b-4619-99e7-d1629fe1b72b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:39:54.124954 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e6ef56-264b-4619-99e7-d1629fe1b72b None admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:39:54.131087 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 265/526] 10.222.0.16 () {56 vars in 1374 bytes} [Thu Jul 14 10:39:53 2022] GET /identity/v3/role_assignments?user.id=26aa294c913c408499a913ec25bb677d&scope.project.id=59391272ecbe48b0aa736cb43807be1d&role.id=d58911e96aad48cf9ca61ac5df79e21d => generated 259 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:39:54.132112 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e6ef56-264b-4619-99e7-d1629fe1b72b None admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:54.183755 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d103be6-230f-44be-9544-9b9ff19bbff2 None admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:54.225479 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23cc97e9-536b-4281-94b5-5597331d3c1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:54.226177 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cc97e9-536b-4281-94b5-5597331d3c1e None admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:54.226462 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cc97e9-536b-4281-94b5-5597331d3c1e None admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:54.226741 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cc97e9-536b-4281-94b5-5597331d3c1e None admin] PATH_INFO: `/v3/domains` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:54.227502 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23cc97e9-536b-4281-94b5-5597331d3c1e None admin] RBAC: Adding query filter params (name=Default) {{(pid=86655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:39:54.227812 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23cc97e9-536b-4281-94b5-5597331d3c1e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:39:54.229258 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23cc97e9-536b-4281-94b5-5597331d3c1e None admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:39:54.247985 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 262/527] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Jul 14 10:39:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:39:54.247985 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23cc97e9-536b-4281-94b5-5597331d3c1e None admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:54.264122 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e6ef56-264b-4619-99e7-d1629fe1b72b None admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:54.302402 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e33aa17-a850-45a7-9587-5f347d374f99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:54.303068 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e33aa17-a850-45a7-9587-5f347d374f99 None admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:54.303359 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e33aa17-a850-45a7-9587-5f347d374f99 None admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:54.303643 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e33aa17-a850-45a7-9587-5f347d374f99 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:54.338971 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=100 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:39:54.352715 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=100 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:39:54.370703 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23cc97e9-536b-4281-94b5-5597331d3c1e None admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:54.381407 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e33aa17-a850-45a7-9587-5f347d374f99 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:39:54.383126 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e33aa17-a850-45a7-9587-5f347d374f99 None admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:39:54.417485 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22a0200-ee81-49e6-b1af-870150342657 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:54.419524 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22a0200-ee81-49e6-b1af-870150342657 None admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:54.419995 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22a0200-ee81-49e6-b1af-870150342657 None admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:54.420465 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22a0200-ee81-49e6-b1af-870150342657 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:54.435552 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22a0200-ee81-49e6-b1af-870150342657 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:39:54.439190 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22a0200-ee81-49e6-b1af-870150342657 None admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:39:54.463714 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application [None req-a22a0200-ee81-49e6-b1af-870150342657 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 10:39:54.463714 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:39:54.463714 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:39:54.463714 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:39:54.463714 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:39:54.463714 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:39:54.463714 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:39:54.463714 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:39:54.463714 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:39:54.463714 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:39:54.463714 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:39:54.463714 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:39:54.463714 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 10:39:54.463714 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 10:39:54.463714 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 10:39:54.464630 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 10:39:54.464630 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:39:54.464630 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:39:54.464630 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:39:54.464630 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:39:54.464630 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:39:54.464630 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:39:54.464630 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:39:54.464630 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application with Lock( Jul 14 10:39:54.464630 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:39:54.464630 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:39:54.464630 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:39:54.464630 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:39:54.464630 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:39:54.464630 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:39:54.464630 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:39:54.464630 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:39:54.465520 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 10:39:54.465520 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 10:39:54.465520 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 10:39:54.465520 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application Jul 14 10:39:54.466545 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 263/528] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Jul 14 10:39:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:39:54.467249 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22a0200-ee81-49e6-b1af-870150342657 None admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:54.493435 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 266/529] 10.222.0.16 () {58 vars in 1282 bytes} [Thu Jul 14 10:39:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 10:39:54.494120 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e33aa17-a850-45a7-9587-5f347d374f99 None admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:54.564812 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=100 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:39:54.606705 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e33aa17-a850-45a7-9587-5f347d374f99 None admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:54.607310 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22a0200-ee81-49e6-b1af-870150342657 None admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:54.643955 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2883c231-69ac-472e-87d2-3ee454847838 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:54.644726 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2883c231-69ac-472e-87d2-3ee454847838 None admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:54.645045 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2883c231-69ac-472e-87d2-3ee454847838 None admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:54.645325 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2883c231-69ac-472e-87d2-3ee454847838 None admin] PATH_INFO: `/v3/domains` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:54.646044 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2883c231-69ac-472e-87d2-3ee454847838 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:39:54.646448 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2883c231-69ac-472e-87d2-3ee454847838 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:39:54.648037 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2883c231-69ac-472e-87d2-3ee454847838 None admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:39:54.649397 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febc3417-54e7-412a-9b87-ab0246e02ae4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:54.650354 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febc3417-54e7-412a-9b87-ab0246e02ae4 None admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:54.651059 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febc3417-54e7-412a-9b87-ab0246e02ae4 None admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:54.651616 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febc3417-54e7-412a-9b87-ab0246e02ae4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:54.659908 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-febc3417-54e7-412a-9b87-ab0246e02ae4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:39:54.660760 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 267/530] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Jul 14 10:39:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:39:54.661414 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-febc3417-54e7-412a-9b87-ab0246e02ae4 None admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:39:54.661767 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2883c231-69ac-472e-87d2-3ee454847838 None admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:54.664085 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=100 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:39:54.681444 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application [None req-febc3417-54e7-412a-9b87-ab0246e02ae4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 10:39:54.681444 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:39:54.681444 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:39:54.681444 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:39:54.681444 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:39:54.681444 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:39:54.681444 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:39:54.681444 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:39:54.681444 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:39:54.681444 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:39:54.681444 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:39:54.681444 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:39:54.681444 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 10:39:54.681444 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 10:39:54.681444 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 10:39:54.682609 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 10:39:54.682609 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:39:54.682609 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:39:54.682609 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:39:54.682609 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:39:54.682609 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:39:54.682609 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:39:54.682609 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:39:54.682609 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application with Lock( Jul 14 10:39:54.682609 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:39:54.682609 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:39:54.682609 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:39:54.682609 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:39:54.682609 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:39:54.682609 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:39:54.682609 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:39:54.682609 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:39:54.683474 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 10:39:54.683474 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 10:39:54.683474 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 10:39:54.683474 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 10:39:54.683474 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 10:39:54.683474 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 10:39:54.683474 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 10:39:54.683474 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application Jul 14 10:39:54.683474 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 264/531] 10.222.0.16 () {56 vars in 1111 bytes} [Thu Jul 14 10:39:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:39:54.683919 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febc3417-54e7-412a-9b87-ab0246e02ae4 None admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:54.783239 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2883c231-69ac-472e-87d2-3ee454847838 None admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:54.816265 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=100 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:39:54.822376 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febc3417-54e7-412a-9b87-ab0246e02ae4 None admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:54.829595 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b237162f-6f42-4a5a-8f51-c0126e7ddf1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:54.830723 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b237162f-6f42-4a5a-8f51-c0126e7ddf1a None admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:54.831198 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b237162f-6f42-4a5a-8f51-c0126e7ddf1a None admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:54.831661 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b237162f-6f42-4a5a-8f51-c0126e7ddf1a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:54.842475 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b237162f-6f42-4a5a-8f51-c0126e7ddf1a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:39:54.845136 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b237162f-6f42-4a5a-8f51-c0126e7ddf1a None admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:39:54.863612 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application [None req-b237162f-6f42-4a5a-8f51-c0126e7ddf1a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 10:39:54.863612 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:39:54.863612 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:39:54.863612 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:39:54.863612 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:39:54.863612 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:39:54.863612 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:39:54.863612 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:39:54.863612 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:39:54.863612 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:39:54.863612 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:39:54.863612 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:39:54.863612 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 10:39:54.863612 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 10:39:54.863612 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 10:39:54.864441 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 10:39:54.864441 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:39:54.864441 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:39:54.864441 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:39:54.864441 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:39:54.864441 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:39:54.864441 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:39:54.864441 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:39:54.864441 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application with Lock( Jul 14 10:39:54.864441 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:39:54.864441 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:39:54.864441 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:39:54.864441 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:39:54.864441 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:39:54.864441 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:39:54.864441 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:39:54.864441 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:39:54.865297 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 10:39:54.865297 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 10:39:54.865297 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 10:39:54.865297 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application Jul 14 10:39:54.865503 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be502d3-ab92-4511-889e-e2ea50ce23b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:54.865503 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be502d3-ab92-4511-889e-e2ea50ce23b9 None admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:54.865503 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be502d3-ab92-4511-889e-e2ea50ce23b9 None admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:54.865503 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be502d3-ab92-4511-889e-e2ea50ce23b9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:54.867960 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 268/532] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Jul 14 10:39:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:39:54.869126 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b237162f-6f42-4a5a-8f51-c0126e7ddf1a None admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:54.874519 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be502d3-ab92-4511-889e-e2ea50ce23b9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:39:54.876535 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be502d3-ab92-4511-889e-e2ea50ce23b9 None admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:39:54.895420 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application [None req-9be502d3-ab92-4511-889e-e2ea50ce23b9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 10:39:54.895420 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:39:54.895420 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:39:54.895420 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:39:54.895420 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:39:54.895420 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:39:54.895420 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:39:54.895420 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:39:54.895420 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:39:54.895420 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:39:54.895420 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:39:54.895420 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:39:54.895420 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 10:39:54.895420 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 10:39:54.895420 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 10:39:54.896279 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 10:39:54.896279 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:39:54.896279 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:39:54.896279 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:39:54.896279 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:39:54.896279 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:39:54.896279 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:39:54.896279 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:39:54.896279 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application with Lock( Jul 14 10:39:54.896279 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:39:54.896279 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:39:54.896279 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:39:54.896279 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:39:54.896279 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:39:54.896279 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:39:54.896279 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:39:54.896279 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:39:54.897167 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 10:39:54.897167 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 10:39:54.897167 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 10:39:54.897167 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 10:39:54.897167 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 10:39:54.897167 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 10:39:54.897167 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 10:39:54.897167 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application Jul 14 10:39:54.897167 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 265/533] 10.222.0.16 () {56 vars in 1111 bytes} [Thu Jul 14 10:39:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:39:54.897619 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be502d3-ab92-4511-889e-e2ea50ce23b9 None admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:54.963533 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=100 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:39:55.009238 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be502d3-ab92-4511-889e-e2ea50ce23b9 None admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:55.013915 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b237162f-6f42-4a5a-8f51-c0126e7ddf1a None admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:55.048122 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b73375-034d-4fa4-b34f-f42aa64c6e34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:55.048820 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b73375-034d-4fa4-b34f-f42aa64c6e34 None admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:55.049112 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b73375-034d-4fa4-b34f-f42aa64c6e34 None admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:55.049395 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b73375-034d-4fa4-b34f-f42aa64c6e34 None admin] PATH_INFO: `/v3/domains` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:55.050405 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b73375-034d-4fa4-b34f-f42aa64c6e34 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:39:55.050719 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b73375-034d-4fa4-b34f-f42aa64c6e34 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:39:55.052553 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b73375-034d-4fa4-b34f-f42aa64c6e34 None admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:39:55.060640 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54e6060-31f6-4826-aff4-f6694215ccc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:55.061943 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54e6060-31f6-4826-aff4-f6694215ccc1 None admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:55.062436 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54e6060-31f6-4826-aff4-f6694215ccc1 None admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:55.063441 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54e6060-31f6-4826-aff4-f6694215ccc1 None admin] PATH_INFO: `/v3/projects` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:55.064440 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54e6060-31f6-4826-aff4-f6694215ccc1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:39:55.064966 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54e6060-31f6-4826-aff4-f6694215ccc1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:39:55.066581 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54e6060-31f6-4826-aff4-f6694215ccc1 None admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:39:55.067892 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 266/534] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Jul 14 10:39:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:39:55.068754 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b73375-034d-4fa4-b34f-f42aa64c6e34 None admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:55.081897 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 269/535] 10.222.0.16 () {56 vars in 1148 bytes} [Thu Jul 14 10:39:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:39:55.083321 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54e6060-31f6-4826-aff4-f6694215ccc1 None admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:55.119372 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=100 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:39:55.184511 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b73375-034d-4fa4-b34f-f42aa64c6e34 None admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:55.185330 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54e6060-31f6-4826-aff4-f6694215ccc1 None admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:55.207410 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=100 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:39:55.222159 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20acfc07-6cbf-40b2-8a6d-48c446a3bd08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:55.222827 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20acfc07-6cbf-40b2-8a6d-48c446a3bd08 None admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:55.223032 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6204099e-d155-4179-b93c-dff592f39145 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:55.223168 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20acfc07-6cbf-40b2-8a6d-48c446a3bd08 None admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:55.223374 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20acfc07-6cbf-40b2-8a6d-48c446a3bd08 None admin] PATH_INFO: `/v3/projects` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:55.224182 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20acfc07-6cbf-40b2-8a6d-48c446a3bd08 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:39:55.224494 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20acfc07-6cbf-40b2-8a6d-48c446a3bd08 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:39:55.224824 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6204099e-d155-4179-b93c-dff592f39145 None admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:55.225309 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6204099e-d155-4179-b93c-dff592f39145 None admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:55.225767 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6204099e-d155-4179-b93c-dff592f39145 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:55.225973 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20acfc07-6cbf-40b2-8a6d-48c446a3bd08 None admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:39:55.233061 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6204099e-d155-4179-b93c-dff592f39145 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:39:55.235400 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6204099e-d155-4179-b93c-dff592f39145 None admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:39:55.245035 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 267/536] 10.222.0.16 () {56 vars in 1148 bytes} [Thu Jul 14 10:39:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:39:55.245704 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20acfc07-6cbf-40b2-8a6d-48c446a3bd08 None admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:55.251559 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application [None req-6204099e-d155-4179-b93c-dff592f39145 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 10:39:55.251559 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:39:55.251559 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:39:55.251559 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:39:55.251559 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:39:55.251559 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:39:55.251559 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:39:55.251559 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:39:55.251559 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:39:55.251559 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:39:55.251559 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:39:55.251559 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:39:55.251559 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 10:39:55.251559 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 10:39:55.251559 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 10:39:55.252393 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 10:39:55.252393 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:39:55.252393 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:39:55.252393 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:39:55.252393 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:39:55.252393 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:39:55.252393 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:39:55.252393 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:39:55.252393 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application with Lock( Jul 14 10:39:55.252393 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:39:55.252393 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:39:55.252393 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:39:55.252393 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:39:55.252393 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:39:55.252393 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:39:55.252393 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:39:55.252393 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:39:55.253245 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 10:39:55.253245 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 10:39:55.253245 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 10:39:55.253245 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 10:39:55.253245 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 10:39:55.253245 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 10:39:55.253245 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 10:39:55.253245 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application Jul 14 10:39:55.255726 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 270/537] 10.222.0.16 () {56 vars in 1111 bytes} [Thu Jul 14 10:39:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:39:55.256841 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6204099e-d155-4179-b93c-dff592f39145 None admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:55.366285 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20acfc07-6cbf-40b2-8a6d-48c446a3bd08 None admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:55.373498 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=100 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:39:55.382972 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6204099e-d155-4179-b93c-dff592f39145 None admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:55.405511 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2797089-2666-4b39-9f8c-6d0d928a89bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:55.406574 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2797089-2666-4b39-9f8c-6d0d928a89bf None admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:55.407052 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2797089-2666-4b39-9f8c-6d0d928a89bf None admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:55.407521 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2797089-2666-4b39-9f8c-6d0d928a89bf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:55.408683 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2797089-2666-4b39-9f8c-6d0d928a89bf None admin] RBAC: Adding query filter params (role.id=d58911e96aad48cf9ca61ac5df79e21d, scope.project.id=59391272ecbe48b0aa736cb43807be1d, user.id=68382432147a48c3b62271fd2a2eab04) {{(pid=86655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:39:55.409230 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2797089-2666-4b39-9f8c-6d0d928a89bf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:39:55.410857 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2797089-2666-4b39-9f8c-6d0d928a89bf None admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:39:55.417556 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 268/538] 10.222.0.16 () {56 vars in 1374 bytes} [Thu Jul 14 10:39:55 2022] GET /identity/v3/role_assignments?user.id=68382432147a48c3b62271fd2a2eab04&scope.project.id=59391272ecbe48b0aa736cb43807be1d&role.id=d58911e96aad48cf9ca61ac5df79e21d => generated 259 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:39:55.418736 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2797089-2666-4b39-9f8c-6d0d928a89bf None admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:55.426029 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed78790e-6641-4e00-a4bf-cd9ddaeec9b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:55.426724 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed78790e-6641-4e00-a4bf-cd9ddaeec9b2 None admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:55.427010 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed78790e-6641-4e00-a4bf-cd9ddaeec9b2 None admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:55.427291 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed78790e-6641-4e00-a4bf-cd9ddaeec9b2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:55.428225 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed78790e-6641-4e00-a4bf-cd9ddaeec9b2 None admin] RBAC: Adding query filter params (role.id=d58911e96aad48cf9ca61ac5df79e21d, scope.project.id=59391272ecbe48b0aa736cb43807be1d, user.id=4dddf93691844886982c91fea974385d) {{(pid=86656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:39:55.428549 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed78790e-6641-4e00-a4bf-cd9ddaeec9b2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:39:55.430127 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed78790e-6641-4e00-a4bf-cd9ddaeec9b2 None admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:39:55.439411 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 271/539] 10.222.0.16 () {56 vars in 1374 bytes} [Thu Jul 14 10:39:55 2022] GET /identity/v3/role_assignments?user.id=4dddf93691844886982c91fea974385d&scope.project.id=59391272ecbe48b0aa736cb43807be1d&role.id=d58911e96aad48cf9ca61ac5df79e21d => generated 259 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:39:55.479655 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=100 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:39:55.545303 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2797089-2666-4b39-9f8c-6d0d928a89bf None admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:55.585421 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c419b92-d930-43ca-952c-2f7f0f3dd0ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:55.586359 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c419b92-d930-43ca-952c-2f7f0f3dd0ab None admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:55.586804 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c419b92-d930-43ca-952c-2f7f0f3dd0ab None admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:55.587220 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c419b92-d930-43ca-952c-2f7f0f3dd0ab None admin] PATH_INFO: `/v3/projects` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:55.588227 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c419b92-d930-43ca-952c-2f7f0f3dd0ab None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:39:55.588701 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c419b92-d930-43ca-952c-2f7f0f3dd0ab None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:39:55.590386 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c419b92-d930-43ca-952c-2f7f0f3dd0ab None admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:39:55.605879 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 269/540] 10.222.0.16 () {56 vars in 1148 bytes} [Thu Jul 14 10:39:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:39:55.613946 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed78790e-6641-4e00-a4bf-cd9ddaeec9b2 None admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:55.724535 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed78790e-6641-4e00-a4bf-cd9ddaeec9b2 None admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:55.759938 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152bc426-3b22-4148-b3be-125b4bd84c7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:55.760979 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152bc426-3b22-4148-b3be-125b4bd84c7c None admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:55.761442 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152bc426-3b22-4148-b3be-125b4bd84c7c None admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:55.761890 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152bc426-3b22-4148-b3be-125b4bd84c7c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:55.762891 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152bc426-3b22-4148-b3be-125b4bd84c7c None admin] RBAC: Adding query filter params (role.id=d58911e96aad48cf9ca61ac5df79e21d, scope.project.id=59391272ecbe48b0aa736cb43807be1d, user.id=4cb877bf3f8241dcb2ecbb612c7f4f69) {{(pid=86656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:39:55.763397 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152bc426-3b22-4148-b3be-125b4bd84c7c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:39:55.765037 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152bc426-3b22-4148-b3be-125b4bd84c7c None admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:39:55.771534 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 272/541] 10.222.0.16 () {56 vars in 1374 bytes} [Thu Jul 14 10:39:55 2022] GET /identity/v3/role_assignments?user.id=4cb877bf3f8241dcb2ecbb612c7f4f69&scope.project.id=59391272ecbe48b0aa736cb43807be1d&role.id=d58911e96aad48cf9ca61ac5df79e21d => generated 259 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:39:56.160452 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ade3e07-610e-4210-81eb-b8e8e1cfdeb8 None None] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:56.160452 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ade3e07-610e-4210-81eb-b8e8e1cfdeb8 None None] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:56.160452 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ade3e07-610e-4210-81eb-b8e8e1cfdeb8 None None] PATH_INFO: `/` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:56.160452 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 270/542] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jul 14 10:39:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:39:56.168116 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625e3f65-e6ca-4cba-bf53-5cee437fbf88 None None] REQUEST_METHOD: `POST` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:56.168116 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625e3f65-e6ca-4cba-bf53-5cee437fbf88 None None] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:56.168116 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625e3f65-e6ca-4cba-bf53-5cee437fbf88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:56.194179 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.auth.core [None req-625e3f65-e6ca-4cba-bf53-5cee437fbf88 None None] MFA Rules not processed for user `ae4bcdd8106d4bebbdcae96be33505bc`. Rule list: `[]` (Enabled: `True`). {{(pid=86656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:39:56.195664 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-625e3f65-e6ca-4cba-bf53-5cee437fbf88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:39:56.233452 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=100 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:39:56.334472 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 273/543] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jul 14 10:39:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 10:39:56.382298 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ade3e07-610e-4210-81eb-b8e8e1cfdeb8 None None] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:56.544031 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb35989-4017-4caf-ab1d-968038ccbc76 None None] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:56.544264 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb35989-4017-4caf-ab1d-968038ccbc76 None None] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:56.544685 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb35989-4017-4caf-ab1d-968038ccbc76 None None] PATH_INFO: `/` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:56.546437 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 274/544] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jul 14 10:39:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:39:56.557153 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fee261-54a9-40cf-b918-fb06458eae15 None None] REQUEST_METHOD: `POST` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:56.557529 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fee261-54a9-40cf-b918-fb06458eae15 None None] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:56.557890 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fee261-54a9-40cf-b918-fb06458eae15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:56.563498 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ade3e07-610e-4210-81eb-b8e8e1cfdeb8 None None] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:56.566223 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=100 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:39:56.600703 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.auth.core [None req-e1fee261-54a9-40cf-b918-fb06458eae15 None None] MFA Rules not processed for user `ae4bcdd8106d4bebbdcae96be33505bc`. Rule list: `[]` (Enabled: `True`). {{(pid=86656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:39:56.601324 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2c37b4-b772-4685-a637-02fb5276f688 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:56.601936 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-e1fee261-54a9-40cf-b918-fb06458eae15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:39:56.602666 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2c37b4-b772-4685-a637-02fb5276f688 None admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:56.603151 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2c37b4-b772-4685-a637-02fb5276f688 None admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:56.603629 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2c37b4-b772-4685-a637-02fb5276f688 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:56.623523 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2c37b4-b772-4685-a637-02fb5276f688 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 10:39:56.639580 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application [None req-2a2c37b4-b772-4685-a637-02fb5276f688 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 14 10:39:56.639580 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:39:56.639580 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:39:56.639580 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:39:56.639580 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:39:56.639580 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:39:56.639580 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:39:56.639580 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:39:56.639580 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:39:56.639580 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:39:56.639580 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:39:56.639580 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:39:56.639580 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 10:39:56.639580 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 10:39:56.639580 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 10:39:56.639580 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 10:39:56.640485 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 10:39:56.640485 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 10:39:56.640485 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 10:39:56.640485 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 10:39:56.640485 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:39:56.640485 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:39:56.640485 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:39:56.640485 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:39:56.640485 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:39:56.640485 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:39:56.640485 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:39:56.640485 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application with Lock( Jul 14 10:39:56.640485 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:39:56.640485 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:39:56.640485 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:39:56.640485 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:39:56.641406 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:39:56.641406 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:39:56.641406 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:39:56.641406 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:39:56.641406 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 10:39:56.641406 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 10:39:56.641406 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 10:39:56.641406 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 10:39:56.641406 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 10:39:56.641406 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 10:39:56.641406 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 14 10:39:56.641406 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application Jul 14 10:39:56.648963 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 271/545] 10.222.0.16 () {56 vars in 1102 bytes} [Thu Jul 14 10:39:56 2022] GET /identity/v3/roles/service => generated 85 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:39:56.650382 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2c37b4-b772-4685-a637-02fb5276f688 None admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:56.727082 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 275/546] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jul 14 10:39:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 10:39:56.769837 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fee261-54a9-40cf-b918-fb06458eae15 None None] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:56.774148 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2c37b4-b772-4685-a637-02fb5276f688 None admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:56.849241 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4d5a16-9735-4ea4-934b-ff9ddf802956 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:56.851262 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4d5a16-9735-4ea4-934b-ff9ddf802956 None admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:56.851927 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4d5a16-9735-4ea4-934b-ff9ddf802956 None admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:56.853182 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4d5a16-9735-4ea4-934b-ff9ddf802956 None admin] PATH_INFO: `/v3/roles` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:56.853984 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4d5a16-9735-4ea4-934b-ff9ddf802956 None admin] RBAC: Adding query filter params (name=service) {{(pid=86655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:39:56.854304 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4d5a16-9735-4ea4-934b-ff9ddf802956 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:39:56.855695 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4d5a16-9735-4ea4-934b-ff9ddf802956 None admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:39:56.873856 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 272/547] 10.222.0.16 () {56 vars in 1103 bytes} [Thu Jul 14 10:39:56 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:39:56.879699 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4d5a16-9735-4ea4-934b-ff9ddf802956 None admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:56.913118 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=100 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:39:56.925415 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fee261-54a9-40cf-b918-fb06458eae15 None None] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:56.930288 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=100 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:39:56.998016 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f3c228-19ac-4655-88ff-06889624e6bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:56.999263 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f3c228-19ac-4655-88ff-06889624e6bc None admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:56.999777 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f3c228-19ac-4655-88ff-06889624e6bc None admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:57.000488 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f3c228-19ac-4655-88ff-06889624e6bc None admin] PATH_INFO: `/v3/roles/service` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:57.033381 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f3c228-19ac-4655-88ff-06889624e6bc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 10:39:57.037863 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4d5a16-9735-4ea4-934b-ff9ddf802956 None admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:57.041156 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application [None req-95f3c228-19ac-4655-88ff-06889624e6bc None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 14 10:39:57.041156 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:39:57.041156 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:39:57.041156 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:39:57.041156 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:39:57.041156 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:39:57.041156 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:39:57.041156 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:39:57.041156 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:39:57.041156 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:39:57.041156 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:39:57.041156 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:39:57.041156 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 10:39:57.041156 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 10:39:57.041156 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 10:39:57.041156 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 10:39:57.042037 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 10:39:57.042037 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 10:39:57.042037 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 10:39:57.042037 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 10:39:57.042037 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:39:57.042037 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:39:57.042037 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:39:57.042037 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:39:57.042037 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:39:57.042037 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:39:57.042037 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:39:57.042037 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application with Lock( Jul 14 10:39:57.042037 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:39:57.042037 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:39:57.042037 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:39:57.042037 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:39:57.043236 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:39:57.043236 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:39:57.043236 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:39:57.043236 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:39:57.043236 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 10:39:57.043236 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 10:39:57.043236 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 10:39:57.043236 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 10:39:57.043236 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 10:39:57.043236 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 10:39:57.043236 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 14 10:39:57.043236 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application Jul 14 10:39:57.043236 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 276/548] 10.222.0.16 () {56 vars in 1102 bytes} [Thu Jul 14 10:39:56 2022] GET /identity/v3/roles/service => generated 85 bytes in 273 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:39:57.049727 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f3c228-19ac-4655-88ff-06889624e6bc None admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:57.100705 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7280fd-92b0-45bb-a55d-008a5580118c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:57.101449 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7280fd-92b0-45bb-a55d-008a5580118c None admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:57.101735 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7280fd-92b0-45bb-a55d-008a5580118c None admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:57.102012 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7280fd-92b0-45bb-a55d-008a5580118c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:57.117816 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7280fd-92b0-45bb-a55d-008a5580118c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:39:57.119709 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7280fd-92b0-45bb-a55d-008a5580118c None admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:39:57.154602 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application [None req-6d7280fd-92b0-45bb-a55d-008a5580118c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 10:39:57.154602 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:39:57.154602 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:39:57.154602 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:39:57.154602 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:39:57.154602 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:39:57.154602 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:39:57.154602 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:39:57.154602 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:39:57.154602 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:39:57.154602 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:39:57.154602 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:39:57.154602 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 10:39:57.154602 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 10:39:57.154602 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 10:39:57.155480 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 10:39:57.155480 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:39:57.155480 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:39:57.155480 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:39:57.155480 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:39:57.155480 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:39:57.155480 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:39:57.155480 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:39:57.155480 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application with Lock( Jul 14 10:39:57.155480 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:39:57.155480 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:39:57.155480 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:39:57.155480 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:39:57.155480 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:39:57.155480 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:39:57.155480 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:39:57.155480 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:39:57.157540 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 10:39:57.157540 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 10:39:57.157540 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 10:39:57.157540 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application Jul 14 10:39:57.157540 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 273/549] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Jul 14 10:39:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:39:57.160810 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7280fd-92b0-45bb-a55d-008a5580118c None admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:57.217773 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f3c228-19ac-4655-88ff-06889624e6bc None admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:57.273818 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd35d3bc-beef-4698-8e27-e265329f7134 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:57.274490 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd35d3bc-beef-4698-8e27-e265329f7134 None admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:57.274774 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd35d3bc-beef-4698-8e27-e265329f7134 None admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:57.275047 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd35d3bc-beef-4698-8e27-e265329f7134 None admin] PATH_INFO: `/v3/roles` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:57.275805 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd35d3bc-beef-4698-8e27-e265329f7134 None admin] RBAC: Adding query filter params (name=service) {{(pid=86656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:39:57.276116 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd35d3bc-beef-4698-8e27-e265329f7134 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:39:57.280079 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd35d3bc-beef-4698-8e27-e265329f7134 None admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:39:57.309273 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 277/550] 10.222.0.16 () {56 vars in 1103 bytes} [Thu Jul 14 10:39:57 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:39:57.310242 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd35d3bc-beef-4698-8e27-e265329f7134 None admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:57.321109 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=100 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:39:57.329538 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=100 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:39:57.361993 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7280fd-92b0-45bb-a55d-008a5580118c None admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:57.450232 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd35d3bc-beef-4698-8e27-e265329f7134 None admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:57.466063 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743fc6c7-161d-447d-86b4-4141bf86230a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:57.466756 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743fc6c7-161d-447d-86b4-4141bf86230a None admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:57.467046 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743fc6c7-161d-447d-86b4-4141bf86230a None admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:57.467330 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743fc6c7-161d-447d-86b4-4141bf86230a None admin] PATH_INFO: `/v3/domains` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:57.468077 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743fc6c7-161d-447d-86b4-4141bf86230a None admin] RBAC: Adding query filter params (name=Default) {{(pid=86655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:39:57.468397 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743fc6c7-161d-447d-86b4-4141bf86230a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:39:57.470171 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743fc6c7-161d-447d-86b4-4141bf86230a None admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:39:57.487080 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6dd777-1635-4ac5-8705-c7ea810325eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:57.488273 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6dd777-1635-4ac5-8705-c7ea810325eb None admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:57.488733 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6dd777-1635-4ac5-8705-c7ea810325eb None admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:57.489168 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6dd777-1635-4ac5-8705-c7ea810325eb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:57.495367 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 274/551] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Jul 14 10:39:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 337 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:39:57.505299 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6dd777-1635-4ac5-8705-c7ea810325eb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:39:57.507029 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6dd777-1635-4ac5-8705-c7ea810325eb None admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:39:57.509258 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743fc6c7-161d-447d-86b4-4141bf86230a None admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:57.525602 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application [None req-1c6dd777-1635-4ac5-8705-c7ea810325eb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 10:39:57.525602 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:39:57.525602 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:39:57.525602 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:39:57.525602 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:39:57.525602 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:39:57.525602 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:39:57.525602 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:39:57.525602 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:39:57.525602 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:39:57.525602 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:39:57.525602 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:39:57.525602 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 10:39:57.525602 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 10:39:57.525602 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 10:39:57.526743 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 10:39:57.526743 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:39:57.526743 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:39:57.526743 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:39:57.526743 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:39:57.526743 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:39:57.526743 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:39:57.526743 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:39:57.526743 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application with Lock( Jul 14 10:39:57.526743 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:39:57.526743 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:39:57.526743 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:39:57.526743 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:39:57.526743 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:39:57.526743 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:39:57.526743 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:39:57.526743 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:39:57.527859 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 10:39:57.527859 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 10:39:57.527859 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 10:39:57.527859 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application Jul 14 10:39:57.529791 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 278/552] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Jul 14 10:39:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:39:57.535344 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6dd777-1635-4ac5-8705-c7ea810325eb None admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:57.597200 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=100 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:39:57.641547 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6dd777-1635-4ac5-8705-c7ea810325eb None admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:57.680303 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743fc6c7-161d-447d-86b4-4141bf86230a None admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:57.695665 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ec0ebd-a589-4a30-aa18-ff045daabf60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:57.696346 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ec0ebd-a589-4a30-aa18-ff045daabf60 None admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:57.696631 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ec0ebd-a589-4a30-aa18-ff045daabf60 None admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:57.696937 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ec0ebd-a589-4a30-aa18-ff045daabf60 None admin] PATH_INFO: `/v3/domains` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:57.697957 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ec0ebd-a589-4a30-aa18-ff045daabf60 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:39:57.698270 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ec0ebd-a589-4a30-aa18-ff045daabf60 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:39:57.699657 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ec0ebd-a589-4a30-aa18-ff045daabf60 None admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:39:57.725493 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 279/553] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Jul 14 10:39:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 10:39:57.730828 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ec0ebd-a589-4a30-aa18-ff045daabf60 None admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:57.754049 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfc72d7-8939-42d2-9858-4113ee0d53ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:57.754860 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfc72d7-8939-42d2-9858-4113ee0d53ac None admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:57.755145 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfc72d7-8939-42d2-9858-4113ee0d53ac None admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:57.755425 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfc72d7-8939-42d2-9858-4113ee0d53ac None admin] PATH_INFO: `/v3/users/swift` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:57.771810 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dfc72d7-8939-42d2-9858-4113ee0d53ac None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:39:57.773325 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dfc72d7-8939-42d2-9858-4113ee0d53ac None admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:39:57.777094 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=100 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:39:57.803823 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application [None req-9dfc72d7-8939-42d2-9858-4113ee0d53ac None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 14 10:39:57.803823 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:39:57.803823 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:39:57.803823 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:39:57.803823 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:39:57.803823 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:39:57.803823 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:39:57.803823 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:39:57.803823 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:39:57.803823 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:39:57.803823 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:39:57.803823 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:39:57.803823 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 10:39:57.803823 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 10:39:57.803823 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 10:39:57.803823 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 10:39:57.804849 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:39:57.804849 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:39:57.804849 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 10:39:57.804849 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 10:39:57.804849 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 10:39:57.804849 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 10:39:57.804849 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:39:57.804849 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:39:57.804849 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:39:57.804849 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:39:57.804849 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:39:57.804849 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application with Lock( Jul 14 10:39:57.804849 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:39:57.804849 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:39:57.804849 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:39:57.804849 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:39:57.804849 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:39:57.804849 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:39:57.805821 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:39:57.805821 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:39:57.805821 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 10:39:57.805821 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 10:39:57.805821 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 10:39:57.805821 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 10:39:57.805821 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 10:39:57.805821 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 10:39:57.805821 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 14 10:39:57.805821 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application Jul 14 10:39:57.805821 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 275/554] 10.222.0.16 () {56 vars in 1096 bytes} [Thu Jul 14 10:39:57 2022] GET /identity/v3/users/swift => generated 83 bytes in 297 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:39:57.812150 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81ae57d-1c9f-4bd7-8713-9ad297621a48 None None] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:57.812150 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81ae57d-1c9f-4bd7-8713-9ad297621a48 None None] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:57.812150 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81ae57d-1c9f-4bd7-8713-9ad297621a48 None None] PATH_INFO: `/` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:57.812150 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 276/555] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jul 14 10:39:57 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:39:57.813744 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81ae57d-1c9f-4bd7-8713-9ad297621a48 None None] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:57.873217 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ec0ebd-a589-4a30-aa18-ff045daabf60 None admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:57.891696 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=100 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:39:57.910171 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578e4329-b1d0-45f6-b059-f6fdf3538c48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:57.911320 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578e4329-b1d0-45f6-b059-f6fdf3538c48 None admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:57.911800 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578e4329-b1d0-45f6-b059-f6fdf3538c48 None admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:57.912268 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578e4329-b1d0-45f6-b059-f6fdf3538c48 None admin] PATH_INFO: `/v3/users/nova` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:57.920115 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578e4329-b1d0-45f6-b059-f6fdf3538c48 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:39:57.921983 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578e4329-b1d0-45f6-b059-f6fdf3538c48 None admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:39:57.935588 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81ae57d-1c9f-4bd7-8713-9ad297621a48 None None] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:57.938853 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application [None req-578e4329-b1d0-45f6-b059-f6fdf3538c48 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 14 10:39:57.938853 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:39:57.938853 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:39:57.938853 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:39:57.938853 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:39:57.938853 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:39:57.938853 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:39:57.938853 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:39:57.938853 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:39:57.938853 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:39:57.938853 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:39:57.938853 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:39:57.938853 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 10:39:57.938853 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 10:39:57.938853 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 10:39:57.938853 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 10:39:57.939760 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:39:57.939760 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:39:57.939760 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 10:39:57.939760 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 10:39:57.939760 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 10:39:57.939760 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 10:39:57.939760 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:39:57.939760 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:39:57.939760 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:39:57.939760 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:39:57.939760 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:39:57.939760 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application with Lock( Jul 14 10:39:57.939760 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:39:57.939760 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:39:57.939760 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:39:57.939760 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:39:57.939760 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:39:57.939760 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:39:57.941587 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:39:57.941587 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:39:57.941587 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 10:39:57.941587 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 10:39:57.941587 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 10:39:57.941587 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 10:39:57.941587 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 10:39:57.941587 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 10:39:57.941587 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 14 10:39:57.941587 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application Jul 14 10:39:57.943901 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 280/556] 10.222.0.16 () {56 vars in 1093 bytes} [Thu Jul 14 10:39:57 2022] GET /identity/v3/users/nova => generated 82 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 10:39:57.945448 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf0ef9b-19f2-4d30-9380-dd77ba335508 None None] REQUEST_METHOD: `POST` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:57.945939 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf0ef9b-19f2-4d30-9380-dd77ba335508 None None] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:57.946414 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf0ef9b-19f2-4d30-9380-dd77ba335508 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:57.963443 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.auth.core [None req-1cf0ef9b-19f2-4d30-9380-dd77ba335508 None None] MFA Rules not processed for user `ae4bcdd8106d4bebbdcae96be33505bc`. Rule list: `[]` (Enabled: `True`). {{(pid=86656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:39:57.964981 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-1cf0ef9b-19f2-4d30-9380-dd77ba335508 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:39:57.979857 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59017f1b-8e4d-454e-a407-ccfaa106293a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:57.980599 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59017f1b-8e4d-454e-a407-ccfaa106293a None admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:57.980924 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59017f1b-8e4d-454e-a407-ccfaa106293a None admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:57.981208 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59017f1b-8e4d-454e-a407-ccfaa106293a None admin] PATH_INFO: `/v3/users` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:57.982237 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59017f1b-8e4d-454e-a407-ccfaa106293a None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=86655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:39:57.982559 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59017f1b-8e4d-454e-a407-ccfaa106293a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:39:57.984149 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59017f1b-8e4d-454e-a407-ccfaa106293a None admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:39:58.009418 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 277/557] 10.222.0.16 () {56 vars in 1135 bytes} [Thu Jul 14 10:39:57 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:39:58.010434 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59017f1b-8e4d-454e-a407-ccfaa106293a None admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:58.038338 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 281/558] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jul 14 10:39:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 10:39:58.039511 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf0ef9b-19f2-4d30-9380-dd77ba335508 None None] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:58.092030 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=100 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:39:58.141831 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59017f1b-8e4d-454e-a407-ccfaa106293a None admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:58.144825 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf0ef9b-19f2-4d30-9380-dd77ba335508 None None] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:58.158173 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=100 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:39:58.181000 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8380e165-8e81-4f29-bd14-b0a3b3a9cb20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:58.181681 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8380e165-8e81-4f29-bd14-b0a3b3a9cb20 None admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:58.181971 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8380e165-8e81-4f29-bd14-b0a3b3a9cb20 None admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:58.182255 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8380e165-8e81-4f29-bd14-b0a3b3a9cb20 None admin] PATH_INFO: `/v3/users` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:58.183105 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8380e165-8e81-4f29-bd14-b0a3b3a9cb20 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:39:58.183421 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8380e165-8e81-4f29-bd14-b0a3b3a9cb20 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:39:58.184894 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8380e165-8e81-4f29-bd14-b0a3b3a9cb20 None admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:39:58.188197 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666b02e9-2d8b-4445-a67a-aa268d8c1196 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:58.189143 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666b02e9-2d8b-4445-a67a-aa268d8c1196 None admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:58.189587 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666b02e9-2d8b-4445-a67a-aa268d8c1196 None admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:58.190005 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666b02e9-2d8b-4445-a67a-aa268d8c1196 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:58.204763 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 278/559] 10.222.0.16 () {56 vars in 1133 bytes} [Thu Jul 14 10:39:58 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:39:58.206136 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34726324-dade-46a8-bee8-2932b4c0b00b None None] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:58.206431 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34726324-dade-46a8-bee8-2932b4c0b00b None None] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:58.206712 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34726324-dade-46a8-bee8-2932b4c0b00b None None] PATH_INFO: `/` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:58.208119 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 279/560] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jul 14 10:39:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:39:58.208651 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34726324-dade-46a8-bee8-2932b4c0b00b None None] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:58.273171 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666b02e9-2d8b-4445-a67a-aa268d8c1196 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:39:58.274653 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666b02e9-2d8b-4445-a67a-aa268d8c1196 None admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:39:58.318487 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34726324-dade-46a8-bee8-2932b4c0b00b None None] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:58.333864 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=100 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:39:58.354580 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cb1091-9b81-46c0-89a3-76e15c0309d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:58.355383 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cb1091-9b81-46c0-89a3-76e15c0309d8 None admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:58.355668 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cb1091-9b81-46c0-89a3-76e15c0309d8 None admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:58.355945 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cb1091-9b81-46c0-89a3-76e15c0309d8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:58.368914 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78cb1091-9b81-46c0-89a3-76e15c0309d8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 10:39:58.377919 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application [None req-78cb1091-9b81-46c0-89a3-76e15c0309d8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 14 10:39:58.377919 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:39:58.377919 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:39:58.377919 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:39:58.377919 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:39:58.377919 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:39:58.377919 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:39:58.377919 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:39:58.377919 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:39:58.377919 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:39:58.377919 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:39:58.377919 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:39:58.377919 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 10:39:58.377919 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 10:39:58.377919 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 10:39:58.377919 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 10:39:58.378835 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 10:39:58.378835 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 10:39:58.378835 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 10:39:58.378835 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 10:39:58.378835 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:39:58.378835 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:39:58.378835 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:39:58.378835 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:39:58.378835 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:39:58.378835 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:39:58.378835 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:39:58.378835 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application with Lock( Jul 14 10:39:58.378835 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:39:58.378835 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:39:58.378835 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:39:58.378835 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:39:58.379638 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:39:58.379638 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:39:58.379638 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:39:58.379638 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:39:58.379638 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 10:39:58.379638 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 10:39:58.379638 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 10:39:58.379638 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 10:39:58.379638 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 10:39:58.379638 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 10:39:58.379638 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 14 10:39:58.379638 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application Jul 14 10:39:58.384021 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 280/561] 10.222.0.16 () {56 vars in 1102 bytes} [Thu Jul 14 10:39:58 2022] GET /identity/v3/roles/service => generated 85 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:39:58.384892 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cb1091-9b81-46c0-89a3-76e15c0309d8 None admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:58.399270 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 282/562] 10.222.0.16 () {58 vars in 1282 bytes} [Thu Jul 14 10:39:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 10:39:58.399270 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66db51d-c52b-4fe7-832e-7092fffbea62 None None] REQUEST_METHOD: `POST` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:58.399270 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66db51d-c52b-4fe7-832e-7092fffbea62 None None] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:58.399270 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66db51d-c52b-4fe7-832e-7092fffbea62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:58.413913 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.auth.core [None req-e66db51d-c52b-4fe7-832e-7092fffbea62 None None] MFA Rules not processed for user `ae4bcdd8106d4bebbdcae96be33505bc`. Rule list: `[]` (Enabled: `True`). {{(pid=86656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:39:58.415273 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-e66db51d-c52b-4fe7-832e-7092fffbea62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:39:58.417519 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=100 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:39:58.486078 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 283/563] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jul 14 10:39:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 10:39:58.486924 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66db51d-c52b-4fe7-832e-7092fffbea62 None None] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:58.495949 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cb1091-9b81-46c0-89a3-76e15c0309d8 None admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:58.530530 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb313be-4960-4658-9061-5cba4fd6f3a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:58.531953 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb313be-4960-4658-9061-5cba4fd6f3a5 None admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:58.532254 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb313be-4960-4658-9061-5cba4fd6f3a5 None admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:58.532536 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb313be-4960-4658-9061-5cba4fd6f3a5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:58.542931 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb313be-4960-4658-9061-5cba4fd6f3a5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:39:58.544390 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb313be-4960-4658-9061-5cba4fd6f3a5 None admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:39:58.564189 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application [None req-cdb313be-4960-4658-9061-5cba4fd6f3a5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 10:39:58.564189 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:39:58.564189 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:39:58.564189 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:39:58.564189 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:39:58.564189 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:39:58.564189 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:39:58.564189 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:39:58.564189 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:39:58.564189 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:39:58.564189 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:39:58.564189 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:39:58.564189 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 10:39:58.564189 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 10:39:58.564189 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 10:39:58.565360 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 10:39:58.565360 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:39:58.565360 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:39:58.565360 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:39:58.565360 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:39:58.565360 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:39:58.565360 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:39:58.565360 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:39:58.565360 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application with Lock( Jul 14 10:39:58.565360 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:39:58.565360 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:39:58.565360 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:39:58.565360 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:39:58.565360 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:39:58.565360 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:39:58.565360 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:39:58.565360 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:39:58.566263 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 10:39:58.566263 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 10:39:58.566263 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 10:39:58.566263 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application Jul 14 10:39:58.566263 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 281/564] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Jul 14 10:39:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:39:58.566546 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb313be-4960-4658-9061-5cba4fd6f3a5 None admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:58.593483 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66db51d-c52b-4fe7-832e-7092fffbea62 None None] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:58.595185 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=100 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:39:58.627941 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6055ac-3497-4756-8c12-5de92faf43a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:58.628603 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6055ac-3497-4756-8c12-5de92faf43a1 None admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:58.628942 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6055ac-3497-4756-8c12-5de92faf43a1 None admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:58.629220 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6055ac-3497-4756-8c12-5de92faf43a1 None admin] PATH_INFO: `/v3/roles` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:58.629962 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6055ac-3497-4756-8c12-5de92faf43a1 None admin] RBAC: Adding query filter params (name=service) {{(pid=86656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:39:58.630268 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6055ac-3497-4756-8c12-5de92faf43a1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:39:58.631646 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6055ac-3497-4756-8c12-5de92faf43a1 None admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:39:58.636524 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=100 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:39:58.640319 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 284/565] 10.222.0.16 () {56 vars in 1103 bytes} [Thu Jul 14 10:39:58 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:39:58.642414 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac66fdd-f8cf-41de-ae42-afaa088cd40a None None] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:58.642707 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac66fdd-f8cf-41de-ae42-afaa088cd40a None None] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:58.643107 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac66fdd-f8cf-41de-ae42-afaa088cd40a None None] PATH_INFO: `/` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:58.645125 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 285/566] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jul 14 10:39:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:39:58.645839 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac66fdd-f8cf-41de-ae42-afaa088cd40a None None] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:58.674372 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb313be-4960-4658-9061-5cba4fd6f3a5 None admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:58.708755 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb9be03-4bc9-436a-aac5-2ccb3d74f910 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:58.709567 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb9be03-4bc9-436a-aac5-2ccb3d74f910 None admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:58.709849 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb9be03-4bc9-436a-aac5-2ccb3d74f910 None admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:58.710121 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb9be03-4bc9-436a-aac5-2ccb3d74f910 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:58.720527 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb9be03-4bc9-436a-aac5-2ccb3d74f910 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:39:58.722014 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb9be03-4bc9-436a-aac5-2ccb3d74f910 None admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:39:58.738579 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application [None req-5fb9be03-4bc9-436a-aac5-2ccb3d74f910 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 10:39:58.738579 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:39:58.738579 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:39:58.738579 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:39:58.738579 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:39:58.738579 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:39:58.738579 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:39:58.738579 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:39:58.738579 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:39:58.738579 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:39:58.738579 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:39:58.738579 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:39:58.738579 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 10:39:58.738579 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 10:39:58.738579 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 10:39:58.739636 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 10:39:58.739636 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:39:58.739636 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:39:58.739636 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:39:58.739636 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:39:58.739636 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:39:58.739636 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:39:58.739636 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:39:58.739636 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application with Lock( Jul 14 10:39:58.739636 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:39:58.739636 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:39:58.739636 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:39:58.739636 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:39:58.739636 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:39:58.739636 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:39:58.739636 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:39:58.739636 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:39:58.740707 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 10:39:58.740707 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 10:39:58.740707 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 10:39:58.740707 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application Jul 14 10:39:58.740707 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 282/567] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Jul 14 10:39:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:39:58.740707 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb9be03-4bc9-436a-aac5-2ccb3d74f910 None admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:58.753423 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac66fdd-f8cf-41de-ae42-afaa088cd40a None None] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:58.788582 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e93a3e-3d31-453b-851e-979cd2f22dca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:58.789458 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e93a3e-3d31-453b-851e-979cd2f22dca None admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:58.789739 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e93a3e-3d31-453b-851e-979cd2f22dca None admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:58.790013 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e93a3e-3d31-453b-851e-979cd2f22dca None admin] PATH_INFO: `/v3/roles/service` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:58.800128 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e93a3e-3d31-453b-851e-979cd2f22dca None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 10:39:58.807818 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application [None req-b3e93a3e-3d31-453b-851e-979cd2f22dca None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 14 10:39:58.807818 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:39:58.807818 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:39:58.807818 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:39:58.807818 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:39:58.807818 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:39:58.807818 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:39:58.807818 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:39:58.807818 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:39:58.807818 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:39:58.807818 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:39:58.807818 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:39:58.807818 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 10:39:58.807818 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 10:39:58.807818 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 10:39:58.807818 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 10:39:58.808712 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 10:39:58.808712 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 10:39:58.808712 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 10:39:58.808712 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 10:39:58.808712 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:39:58.808712 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:39:58.808712 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:39:58.808712 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:39:58.808712 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:39:58.808712 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:39:58.808712 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:39:58.808712 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application with Lock( Jul 14 10:39:58.808712 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:39:58.808712 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:39:58.808712 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:39:58.808712 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:39:58.809605 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:39:58.809605 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:39:58.809605 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:39:58.809605 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:39:58.809605 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 10:39:58.809605 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 10:39:58.809605 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 10:39:58.809605 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 10:39:58.809605 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 10:39:58.809605 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 10:39:58.809605 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 14 10:39:58.809605 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application Jul 14 10:39:58.809605 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 286/568] 10.222.0.16 () {56 vars in 1102 bytes} [Thu Jul 14 10:39:58 2022] GET /identity/v3/roles/service => generated 85 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:39:58.810336 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e93a3e-3d31-453b-851e-979cd2f22dca None admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:58.827716 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=100 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:39:58.851270 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb9be03-4bc9-436a-aac5-2ccb3d74f910 None admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:58.869115 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=100 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:39:58.884810 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5695a312-a7b0-43b6-bcc7-47b1621b9654 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:58.885470 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5695a312-a7b0-43b6-bcc7-47b1621b9654 None admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:58.885752 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5695a312-a7b0-43b6-bcc7-47b1621b9654 None admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:58.886028 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5695a312-a7b0-43b6-bcc7-47b1621b9654 None admin] PATH_INFO: `/v3/domains` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:58.886752 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5695a312-a7b0-43b6-bcc7-47b1621b9654 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:39:58.887378 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5695a312-a7b0-43b6-bcc7-47b1621b9654 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:39:58.888410 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5695a312-a7b0-43b6-bcc7-47b1621b9654 None admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:39:58.900398 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 283/569] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Jul 14 10:39:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:39:58.901610 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18b862c-858e-4350-a313-09735177e2be None None] REQUEST_METHOD: `POST` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:58.901896 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18b862c-858e-4350-a313-09735177e2be None None] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:58.902173 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18b862c-858e-4350-a313-09735177e2be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:58.917147 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e93a3e-3d31-453b-851e-979cd2f22dca None admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:58.917464 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.auth.core [None req-d18b862c-858e-4350-a313-09735177e2be None None] MFA Rules not processed for user `ae4bcdd8106d4bebbdcae96be33505bc`. Rule list: `[]` (Enabled: `True`). {{(pid=86655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:39:58.918653 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-d18b862c-858e-4350-a313-09735177e2be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:39:58.951638 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de114e4c-0ace-48d3-9ee9-0234380bfa9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:58.952352 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de114e4c-0ace-48d3-9ee9-0234380bfa9c None admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:58.952640 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de114e4c-0ace-48d3-9ee9-0234380bfa9c None admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:58.952986 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de114e4c-0ace-48d3-9ee9-0234380bfa9c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:58.963892 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de114e4c-0ace-48d3-9ee9-0234380bfa9c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:39:58.965363 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de114e4c-0ace-48d3-9ee9-0234380bfa9c None admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:39:58.982263 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application [None req-de114e4c-0ace-48d3-9ee9-0234380bfa9c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 10:39:58.982263 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:39:58.982263 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:39:58.982263 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:39:58.982263 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:39:58.982263 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:39:58.982263 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:39:58.982263 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:39:58.982263 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:39:58.982263 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:39:58.982263 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:39:58.982263 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:39:58.982263 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 10:39:58.982263 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 10:39:58.982263 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 10:39:58.983138 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 10:39:58.983138 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:39:58.983138 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:39:58.983138 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:39:58.983138 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:39:58.983138 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:39:58.983138 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:39:58.983138 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:39:58.983138 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application with Lock( Jul 14 10:39:58.983138 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:39:58.983138 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:39:58.983138 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:39:58.983138 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:39:58.983138 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:39:58.983138 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:39:58.983138 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:39:58.983138 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:39:58.984004 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 10:39:58.984004 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 10:39:58.984004 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 10:39:58.984004 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application Jul 14 10:39:58.984004 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 287/570] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Jul 14 10:39:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:39:58.985216 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de114e4c-0ace-48d3-9ee9-0234380bfa9c None admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:58.990497 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 284/571] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jul 14 10:39:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 10:39:58.991339 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18b862c-858e-4350-a313-09735177e2be None None] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:59.057957 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=100 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:39:59.088638 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de114e4c-0ace-48d3-9ee9-0234380bfa9c None admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:59.090523 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18b862c-858e-4350-a313-09735177e2be None None] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:59.101905 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=100 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:39:59.126572 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8520851d-91f1-4638-a474-19454a2b8ed9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:59.126776 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e9fd2d-6d11-4ea5-9719-44aec948a315 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:59.127246 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8520851d-91f1-4638-a474-19454a2b8ed9 None admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:59.127340 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e9fd2d-6d11-4ea5-9719-44aec948a315 None admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:59.127517 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8520851d-91f1-4638-a474-19454a2b8ed9 None admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:59.127603 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e9fd2d-6d11-4ea5-9719-44aec948a315 None admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:59.127796 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e9fd2d-6d11-4ea5-9719-44aec948a315 None admin] PATH_INFO: `/v3/roles` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:59.127884 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8520851d-91f1-4638-a474-19454a2b8ed9 None admin] PATH_INFO: `/v3/domains` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:59.128523 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8520851d-91f1-4638-a474-19454a2b8ed9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:39:59.128618 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e9fd2d-6d11-4ea5-9719-44aec948a315 None admin] RBAC: Adding query filter params (name=service) {{(pid=86655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:39:59.128865 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8520851d-91f1-4638-a474-19454a2b8ed9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:39:59.128958 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e9fd2d-6d11-4ea5-9719-44aec948a315 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:39:59.130234 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e9fd2d-6d11-4ea5-9719-44aec948a315 None admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:39:59.130322 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8520851d-91f1-4638-a474-19454a2b8ed9 None admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:39:59.138203 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 285/572] 10.222.0.16 () {56 vars in 1103 bytes} [Thu Jul 14 10:39:58 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:39:59.139142 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e9fd2d-6d11-4ea5-9719-44aec948a315 None admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:59.147844 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 288/573] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Jul 14 10:39:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:39:59.147844 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8520851d-91f1-4638-a474-19454a2b8ed9 None admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:59.236111 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e9fd2d-6d11-4ea5-9719-44aec948a315 None admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:59.247352 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8520851d-91f1-4638-a474-19454a2b8ed9 None admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:59.263953 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=100 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:39:59.271151 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6666b38-a1e3-4042-9ad1-0df4738af7ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:59.272089 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6666b38-a1e3-4042-9ad1-0df4738af7ce None admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:59.272452 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6666b38-a1e3-4042-9ad1-0df4738af7ce None admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:59.272860 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6666b38-a1e3-4042-9ad1-0df4738af7ce None admin] PATH_INFO: `/v3/projects/service` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:59.280103 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6666b38-a1e3-4042-9ad1-0df4738af7ce None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:39:59.282356 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1780d11c-8a50-4276-a192-2d1cf3a9fbb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:59.282798 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6666b38-a1e3-4042-9ad1-0df4738af7ce None admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:39:59.283024 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1780d11c-8a50-4276-a192-2d1cf3a9fbb7 None admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:59.283307 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1780d11c-8a50-4276-a192-2d1cf3a9fbb7 None admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:59.283583 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1780d11c-8a50-4276-a192-2d1cf3a9fbb7 None admin] PATH_INFO: `/v3/domains` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:59.284305 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1780d11c-8a50-4276-a192-2d1cf3a9fbb7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:39:59.284614 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1780d11c-8a50-4276-a192-2d1cf3a9fbb7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:39:59.286021 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1780d11c-8a50-4276-a192-2d1cf3a9fbb7 None admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:39:59.296612 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application [None req-d6666b38-a1e3-4042-9ad1-0df4738af7ce None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 10:39:59.296612 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:39:59.296612 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:39:59.296612 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:39:59.296612 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:39:59.296612 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:39:59.296612 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:39:59.296612 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:39:59.296612 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:39:59.296612 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:39:59.296612 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:39:59.296612 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:39:59.296612 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 10:39:59.296612 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 10:39:59.296612 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 10:39:59.297584 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 10:39:59.297584 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:39:59.297584 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:39:59.297584 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:39:59.297584 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:39:59.297584 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:39:59.297584 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:39:59.297584 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:39:59.297584 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application with Lock( Jul 14 10:39:59.297584 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:39:59.297584 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:39:59.297584 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:39:59.297584 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:39:59.297584 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:39:59.297584 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:39:59.297584 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:39:59.297584 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:39:59.298451 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 10:39:59.298451 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 10:39:59.298451 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 10:39:59.298451 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 10:39:59.298451 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 10:39:59.298451 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 10:39:59.298451 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 10:39:59.298451 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application Jul 14 10:39:59.298862 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 289/574] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Jul 14 10:39:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:39:59.298862 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1780d11c-8a50-4276-a192-2d1cf3a9fbb7 None admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:59.298986 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 286/575] 10.222.0.16 () {56 vars in 1111 bytes} [Thu Jul 14 10:39:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:39:59.299409 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6666b38-a1e3-4042-9ad1-0df4738af7ce None admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:59.334039 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=100 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:39:59.399592 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6666b38-a1e3-4042-9ad1-0df4738af7ce None admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:59.402684 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1780d11c-8a50-4276-a192-2d1cf3a9fbb7 None admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:59.431998 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81eb9c8b-fe42-4c33-af69-2f5bc49d21bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:59.432794 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81eb9c8b-fe42-4c33-af69-2f5bc49d21bc None admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:59.433094 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81eb9c8b-fe42-4c33-af69-2f5bc49d21bc None admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:59.433367 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81eb9c8b-fe42-4c33-af69-2f5bc49d21bc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:59.435356 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f3eb20-7388-4ad9-a461-d4be6213f770 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:59.436403 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f3eb20-7388-4ad9-a461-d4be6213f770 None admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:59.436690 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f3eb20-7388-4ad9-a461-d4be6213f770 None admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:59.436996 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f3eb20-7388-4ad9-a461-d4be6213f770 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:59.443805 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81eb9c8b-fe42-4c33-af69-2f5bc49d21bc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:39:59.445279 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81eb9c8b-fe42-4c33-af69-2f5bc49d21bc None admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:39:59.447421 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f3eb20-7388-4ad9-a461-d4be6213f770 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 10:39:59.455734 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application [None req-e5f3eb20-7388-4ad9-a461-d4be6213f770 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 14 10:39:59.455734 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:39:59.455734 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:39:59.455734 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:39:59.455734 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:39:59.455734 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:39:59.455734 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:39:59.455734 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:39:59.455734 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:39:59.455734 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:39:59.455734 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:39:59.455734 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:39:59.455734 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 10:39:59.455734 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 10:39:59.455734 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 10:39:59.455734 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 10:39:59.456671 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 10:39:59.456671 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 10:39:59.456671 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 10:39:59.456671 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 10:39:59.456671 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:39:59.456671 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:39:59.456671 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:39:59.456671 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:39:59.456671 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:39:59.456671 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:39:59.456671 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:39:59.456671 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application with Lock( Jul 14 10:39:59.456671 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:39:59.456671 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:39:59.456671 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:39:59.456671 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:39:59.457555 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:39:59.457555 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:39:59.457555 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:39:59.457555 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:39:59.457555 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 10:39:59.457555 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 10:39:59.457555 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 10:39:59.457555 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 10:39:59.457555 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 10:39:59.457555 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 10:39:59.457555 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 14 10:39:59.457555 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application Jul 14 10:39:59.457555 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 290/576] 10.222.0.16 () {56 vars in 1102 bytes} [Thu Jul 14 10:39:59 2022] GET /identity/v3/roles/service => generated 85 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:39:59.458993 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f3eb20-7388-4ad9-a461-d4be6213f770 None admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:59.462824 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application [None req-81eb9c8b-fe42-4c33-af69-2f5bc49d21bc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 10:39:59.462824 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:39:59.462824 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:39:59.462824 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:39:59.462824 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:39:59.462824 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:39:59.462824 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:39:59.462824 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:39:59.462824 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:39:59.462824 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:39:59.462824 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:39:59.462824 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:39:59.462824 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 10:39:59.462824 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 10:39:59.462824 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 10:39:59.463986 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 10:39:59.463986 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:39:59.463986 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:39:59.463986 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:39:59.463986 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:39:59.463986 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:39:59.463986 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:39:59.463986 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:39:59.463986 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application with Lock( Jul 14 10:39:59.463986 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:39:59.463986 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:39:59.463986 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:39:59.463986 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:39:59.463986 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:39:59.463986 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:39:59.463986 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:39:59.463986 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:39:59.465197 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 10:39:59.465197 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 10:39:59.465197 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 10:39:59.465197 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application Jul 14 10:39:59.465197 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 287/577] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Jul 14 10:39:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:39:59.465197 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81eb9c8b-fe42-4c33-af69-2f5bc49d21bc None admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:59.510116 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=100 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:39:59.554148 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=100 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:39:59.564181 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f3eb20-7388-4ad9-a461-d4be6213f770 None admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:59.567111 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81eb9c8b-fe42-4c33-af69-2f5bc49d21bc None admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:59.599550 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89783bb-2a9c-4eef-a518-cf1419d2c7b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:59.600507 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89783bb-2a9c-4eef-a518-cf1419d2c7b4 None admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:59.600923 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89783bb-2a9c-4eef-a518-cf1419d2c7b4 None admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:59.601320 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89783bb-2a9c-4eef-a518-cf1419d2c7b4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:59.603352 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7c0513-6b04-4739-bd5f-17481eb2019e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:59.604143 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7c0513-6b04-4739-bd5f-17481eb2019e None admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:59.604428 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7c0513-6b04-4739-bd5f-17481eb2019e None admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:59.604708 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7c0513-6b04-4739-bd5f-17481eb2019e None admin] PATH_INFO: `/v3/users/neutron` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:59.607916 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89783bb-2a9c-4eef-a518-cf1419d2c7b4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:39:59.609405 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89783bb-2a9c-4eef-a518-cf1419d2c7b4 None admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:39:59.612571 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7c0513-6b04-4739-bd5f-17481eb2019e None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:39:59.614031 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7c0513-6b04-4739-bd5f-17481eb2019e None admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:39:59.623670 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application [None req-e89783bb-2a9c-4eef-a518-cf1419d2c7b4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 10:39:59.623670 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:39:59.623670 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:39:59.623670 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:39:59.623670 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:39:59.623670 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:39:59.623670 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:39:59.623670 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:39:59.623670 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:39:59.623670 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:39:59.623670 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:39:59.623670 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:39:59.623670 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 10:39:59.623670 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 10:39:59.623670 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 10:39:59.624535 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 10:39:59.624535 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:39:59.624535 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:39:59.624535 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:39:59.624535 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:39:59.624535 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:39:59.624535 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:39:59.624535 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:39:59.624535 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application with Lock( Jul 14 10:39:59.624535 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:39:59.624535 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:39:59.624535 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:39:59.624535 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:39:59.624535 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:39:59.624535 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:39:59.624535 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:39:59.624535 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:39:59.626001 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 10:39:59.626001 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 10:39:59.626001 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 10:39:59.626001 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 10:39:59.626001 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 10:39:59.626001 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 10:39:59.626001 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 10:39:59.626001 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application Jul 14 10:39:59.626001 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 291/578] 10.222.0.16 () {56 vars in 1111 bytes} [Thu Jul 14 10:39:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:39:59.626473 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89783bb-2a9c-4eef-a518-cf1419d2c7b4 None admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:59.629687 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application [None req-3e7c0513-6b04-4739-bd5f-17481eb2019e None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 14 10:39:59.629687 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:39:59.629687 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:39:59.629687 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:39:59.629687 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:39:59.629687 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:39:59.629687 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:39:59.629687 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:39:59.629687 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:39:59.629687 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:39:59.629687 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:39:59.629687 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:39:59.629687 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 10:39:59.629687 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 10:39:59.629687 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 10:39:59.629687 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 10:39:59.631402 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:39:59.631402 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:39:59.631402 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 10:39:59.631402 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 10:39:59.631402 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 10:39:59.631402 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 10:39:59.631402 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:39:59.631402 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:39:59.631402 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:39:59.631402 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:39:59.631402 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:39:59.631402 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application with Lock( Jul 14 10:39:59.631402 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:39:59.631402 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:39:59.631402 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:39:59.631402 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:39:59.631402 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:39:59.631402 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:39:59.632820 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:39:59.632820 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:39:59.632820 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 10:39:59.632820 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 10:39:59.632820 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 10:39:59.632820 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 10:39:59.632820 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 10:39:59.632820 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 10:39:59.632820 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 14 10:39:59.632820 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application Jul 14 10:39:59.632820 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 288/579] 10.222.0.16 () {56 vars in 1102 bytes} [Thu Jul 14 10:39:59 2022] GET /identity/v3/users/neutron => generated 85 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:39:59.632820 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7c0513-6b04-4739-bd5f-17481eb2019e None admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:59.728794 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89783bb-2a9c-4eef-a518-cf1419d2c7b4 None admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:59.731773 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7c0513-6b04-4739-bd5f-17481eb2019e None admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:59.733311 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=100 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:39:59.763094 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b7577a-13b4-469d-a814-e6f18f562472 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:59.763689 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b7577a-13b4-469d-a814-e6f18f562472 None admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:59.763974 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b7577a-13b4-469d-a814-e6f18f562472 None admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:59.764254 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b7577a-13b4-469d-a814-e6f18f562472 None admin] PATH_INFO: `/v3/projects` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:59.765077 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b7577a-13b4-469d-a814-e6f18f562472 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:39:59.765913 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b7577a-13b4-469d-a814-e6f18f562472 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:39:59.767596 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b7577a-13b4-469d-a814-e6f18f562472 None admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:39:59.768252 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961ed683-844f-4940-a584-d91a4eb56556 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:59.768960 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961ed683-844f-4940-a584-d91a4eb56556 None admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:59.769255 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961ed683-844f-4940-a584-d91a4eb56556 None admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:59.769535 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961ed683-844f-4940-a584-d91a4eb56556 None admin] PATH_INFO: `/v3/roles` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:59.770294 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961ed683-844f-4940-a584-d91a4eb56556 None admin] RBAC: Adding query filter params (name=service) {{(pid=86655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:39:59.770603 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961ed683-844f-4940-a584-d91a4eb56556 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:39:59.772006 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961ed683-844f-4940-a584-d91a4eb56556 None admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:39:59.780570 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 289/580] 10.222.0.16 () {56 vars in 1103 bytes} [Thu Jul 14 10:39:59 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:39:59.786628 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 292/581] 10.222.0.16 () {56 vars in 1148 bytes} [Thu Jul 14 10:39:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:39:59.787289 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961ed683-844f-4940-a584-d91a4eb56556 None admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:59.787381 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b7577a-13b4-469d-a814-e6f18f562472 None admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:59.799108 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=100 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:39:59.884151 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b7577a-13b4-469d-a814-e6f18f562472 None admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:59.888507 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961ed683-844f-4940-a584-d91a4eb56556 None admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:39:59.918053 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298d7271-55bf-4511-8144-67300ea02750 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:59.918715 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298d7271-55bf-4511-8144-67300ea02750 None admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:59.919002 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298d7271-55bf-4511-8144-67300ea02750 None admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:59.919281 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298d7271-55bf-4511-8144-67300ea02750 None admin] PATH_INFO: `/v3/projects` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:59.920071 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298d7271-55bf-4511-8144-67300ea02750 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:39:59.920383 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298d7271-55bf-4511-8144-67300ea02750 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:39:59.921873 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298d7271-55bf-4511-8144-67300ea02750 None admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:39:59.926273 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742d84c5-762d-4c3a-a7bc-e35bc43a470e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:39:59.926928 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742d84c5-762d-4c3a-a7bc-e35bc43a470e None admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:39:59.927214 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742d84c5-762d-4c3a-a7bc-e35bc43a470e None admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:39:59.927492 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742d84c5-762d-4c3a-a7bc-e35bc43a470e None admin] PATH_INFO: `/v3/domains` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:39:59.928229 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742d84c5-762d-4c3a-a7bc-e35bc43a470e None admin] RBAC: Adding query filter params (name=Default) {{(pid=86655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:39:59.928539 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742d84c5-762d-4c3a-a7bc-e35bc43a470e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:39:59.929934 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742d84c5-762d-4c3a-a7bc-e35bc43a470e None admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:39:59.934217 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 293/582] 10.222.0.16 () {56 vars in 1148 bytes} [Thu Jul 14 10:39:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:39:59.935009 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298d7271-55bf-4511-8144-67300ea02750 None admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:59.945151 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 290/583] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Jul 14 10:39:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:39:59.945985 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742d84c5-762d-4c3a-a7bc-e35bc43a470e None admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:39:59.974167 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=100 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:00.006093 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=100 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:00.036765 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298d7271-55bf-4511-8144-67300ea02750 None admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:00.049665 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742d84c5-762d-4c3a-a7bc-e35bc43a470e None admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:00.070860 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae76b644-eb0b-47f6-b669-4e080af13758 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:00.071533 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae76b644-eb0b-47f6-b669-4e080af13758 None admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:00.071821 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae76b644-eb0b-47f6-b669-4e080af13758 None admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:00.072107 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae76b644-eb0b-47f6-b669-4e080af13758 None admin] PATH_INFO: `/v3/users` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:00.072974 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae76b644-eb0b-47f6-b669-4e080af13758 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=86656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:40:00.073286 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae76b644-eb0b-47f6-b669-4e080af13758 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:00.074737 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae76b644-eb0b-47f6-b669-4e080af13758 None admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:00.083175 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c44969d-b269-4bda-8220-08984ee95903 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:00.083986 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c44969d-b269-4bda-8220-08984ee95903 None admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:00.084272 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c44969d-b269-4bda-8220-08984ee95903 None admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:00.084547 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c44969d-b269-4bda-8220-08984ee95903 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:00.091689 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 294/584] 10.222.0.16 () {56 vars in 1139 bytes} [Thu Jul 14 10:39:59 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:40:00.092464 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae76b644-eb0b-47f6-b669-4e080af13758 None admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:00.098813 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c44969d-b269-4bda-8220-08984ee95903 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:00.100248 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c44969d-b269-4bda-8220-08984ee95903 None admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:00.117987 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application [None req-6c44969d-b269-4bda-8220-08984ee95903 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 10:40:00.117987 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:40:00.117987 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:40:00.117987 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:40:00.117987 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:40:00.117987 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:40:00.117987 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:40:00.117987 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:40:00.117987 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:40:00.117987 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:40:00.117987 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:40:00.117987 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:40:00.117987 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 10:40:00.117987 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 10:40:00.117987 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 10:40:00.118930 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 10:40:00.118930 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:40:00.118930 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:40:00.118930 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:40:00.118930 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:40:00.118930 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:40:00.118930 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:40:00.118930 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:40:00.118930 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application with Lock( Jul 14 10:40:00.118930 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:40:00.118930 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:40:00.118930 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:40:00.118930 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:40:00.118930 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:40:00.118930 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:40:00.118930 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:40:00.118930 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:40:00.120016 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 10:40:00.120016 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 10:40:00.120016 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 10:40:00.120016 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application Jul 14 10:40:00.120016 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 291/585] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Jul 14 10:39:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:40:00.120016 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c44969d-b269-4bda-8220-08984ee95903 None admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:00.196384 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae76b644-eb0b-47f6-b669-4e080af13758 None admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:00.200531 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=100 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:00.223857 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c44969d-b269-4bda-8220-08984ee95903 None admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:00.224629 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=100 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:00.230663 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e236ce8-070c-4dc0-b3c7-eb9e422a256e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:00.231545 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e236ce8-070c-4dc0-b3c7-eb9e422a256e None admin] REQUEST_METHOD: `PUT` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:00.231827 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e236ce8-070c-4dc0-b3c7-eb9e422a256e None admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:00.232102 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e236ce8-070c-4dc0-b3c7-eb9e422a256e None admin] PATH_INFO: `/v3/projects/59391272ecbe48b0aa736cb43807be1d/users/26aa294c913c408499a913ec25bb677d/roles/d58911e96aad48cf9ca61ac5df79e21d` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:00.246552 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e236ce8-070c-4dc0-b3c7-eb9e422a256e None admin] RBAC: Authorizing `identity:create_grant(project_id=59391272ecbe48b0aa736cb43807be1d, user_id=26aa294c913c408499a913ec25bb677d, role_id=d58911e96aad48cf9ca61ac5df79e21d)` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:00.247986 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e236ce8-070c-4dc0-b3c7-eb9e422a256e None admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:00.257910 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf03fa6d-dcd6-488b-ab9d-b4829bf4dbd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:00.258570 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf03fa6d-dcd6-488b-ab9d-b4829bf4dbd7 None admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:00.258858 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf03fa6d-dcd6-488b-ab9d-b4829bf4dbd7 None admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:00.259139 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf03fa6d-dcd6-488b-ab9d-b4829bf4dbd7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:00.259988 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf03fa6d-dcd6-488b-ab9d-b4829bf4dbd7 None admin] RBAC: Adding query filter params (role.id=d58911e96aad48cf9ca61ac5df79e21d, scope.project.id=59391272ecbe48b0aa736cb43807be1d, user.id=8a23de49b80643eaab7a212f2884d62e) {{(pid=86655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:40:00.260280 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 295/586] 10.222.0.16 () {58 vars in 1439 bytes} [Thu Jul 14 10:40:00 2022] PUT /identity/v3/projects/59391272ecbe48b0aa736cb43807be1d/users/26aa294c913c408499a913ec25bb677d/roles/d58911e96aad48cf9ca61ac5df79e21d => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:40:00.260419 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf03fa6d-dcd6-488b-ab9d-b4829bf4dbd7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:00.261165 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e236ce8-070c-4dc0-b3c7-eb9e422a256e None admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:00.261824 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf03fa6d-dcd6-488b-ab9d-b4829bf4dbd7 None admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:00.268381 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 292/587] 10.222.0.16 () {56 vars in 1374 bytes} [Thu Jul 14 10:40:00 2022] GET /identity/v3/role_assignments?user.id=8a23de49b80643eaab7a212f2884d62e&scope.project.id=59391272ecbe48b0aa736cb43807be1d&role.id=d58911e96aad48cf9ca61ac5df79e21d => generated 259 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:40:00.269349 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf03fa6d-dcd6-488b-ab9d-b4829bf4dbd7 None admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:00.412579 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf03fa6d-dcd6-488b-ab9d-b4829bf4dbd7 None admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:00.428208 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e236ce8-070c-4dc0-b3c7-eb9e422a256e None admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:00.460239 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd620b79-d135-4d83-91de-19227e416859 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:00.461215 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd620b79-d135-4d83-91de-19227e416859 None admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:00.461503 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd620b79-d135-4d83-91de-19227e416859 None admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:00.461779 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd620b79-d135-4d83-91de-19227e416859 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:00.473003 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd620b79-d135-4d83-91de-19227e416859 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:00.476963 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=100 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:00.477557 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd620b79-d135-4d83-91de-19227e416859 None admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:00.482818 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562c0170-b252-48cf-b877-dc0436603781 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:00.484028 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562c0170-b252-48cf-b877-dc0436603781 None admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:00.484946 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562c0170-b252-48cf-b877-dc0436603781 None admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:00.485515 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562c0170-b252-48cf-b877-dc0436603781 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:00.494789 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562c0170-b252-48cf-b877-dc0436603781 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:00.496244 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562c0170-b252-48cf-b877-dc0436603781 None admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:00.501791 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application [None req-cd620b79-d135-4d83-91de-19227e416859 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 10:40:00.501791 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:40:00.501791 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:40:00.501791 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:40:00.501791 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:40:00.501791 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:40:00.501791 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:40:00.501791 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:40:00.501791 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:40:00.501791 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:40:00.501791 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:40:00.501791 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:40:00.501791 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 10:40:00.501791 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 10:40:00.501791 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 10:40:00.502636 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 10:40:00.502636 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:40:00.502636 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:40:00.502636 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:40:00.502636 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:40:00.502636 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:40:00.502636 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:40:00.502636 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:40:00.502636 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application with Lock( Jul 14 10:40:00.502636 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:40:00.502636 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:40:00.502636 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:40:00.502636 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:40:00.502636 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:40:00.502636 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:40:00.502636 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:40:00.502636 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:40:00.503513 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 10:40:00.503513 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 10:40:00.503513 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 10:40:00.503513 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application Jul 14 10:40:00.505755 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 293/588] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Jul 14 10:40:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:40:00.506755 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd620b79-d135-4d83-91de-19227e416859 None admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:00.513689 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application [None req-562c0170-b252-48cf-b877-dc0436603781 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 14 10:40:00.513689 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:40:00.513689 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:40:00.513689 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:40:00.513689 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:40:00.513689 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:40:00.513689 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:40:00.513689 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:40:00.513689 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:40:00.513689 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:40:00.513689 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:40:00.513689 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:40:00.513689 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 10:40:00.513689 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 10:40:00.513689 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 10:40:00.513689 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 10:40:00.514819 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:40:00.514819 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:40:00.514819 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 10:40:00.514819 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 10:40:00.514819 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 10:40:00.514819 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 10:40:00.514819 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:40:00.514819 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:40:00.514819 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:40:00.514819 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:40:00.514819 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:40:00.514819 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application with Lock( Jul 14 10:40:00.514819 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:40:00.514819 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:40:00.514819 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:40:00.514819 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:40:00.514819 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:40:00.514819 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:40:00.516197 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:40:00.516197 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:40:00.516197 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 10:40:00.516197 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 10:40:00.516197 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 10:40:00.516197 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 10:40:00.516197 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 10:40:00.516197 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 10:40:00.516197 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 14 10:40:00.516197 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application Jul 14 10:40:00.516197 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 296/589] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Jul 14 10:40:00 2022] GET /identity/v3/users/cinder => generated 84 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:40:00.516197 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562c0170-b252-48cf-b877-dc0436603781 None admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:00.566786 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:00.629173 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562c0170-b252-48cf-b877-dc0436603781 None admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:00.631414 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd620b79-d135-4d83-91de-19227e416859 None admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:00.665388 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d78034-b640-41b5-b5e5-1f8f38a9bc9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:00.666287 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d78034-b640-41b5-b5e5-1f8f38a9bc9d None admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:00.666721 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d78034-b640-41b5-b5e5-1f8f38a9bc9d None admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:00.667160 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d78034-b640-41b5-b5e5-1f8f38a9bc9d None admin] PATH_INFO: `/v3/domains` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:00.668140 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d78034-b640-41b5-b5e5-1f8f38a9bc9d None admin] RBAC: Adding query filter params (name=Default) {{(pid=86656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:40:00.668693 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d78034-b640-41b5-b5e5-1f8f38a9bc9d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:00.670481 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d78034-b640-41b5-b5e5-1f8f38a9bc9d None admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:00.671005 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a63fe6-9a1c-4aca-97e3-75c3ef5cfebc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:00.672225 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a63fe6-9a1c-4aca-97e3-75c3ef5cfebc None admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:00.672514 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a63fe6-9a1c-4aca-97e3-75c3ef5cfebc None admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:00.672800 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a63fe6-9a1c-4aca-97e3-75c3ef5cfebc None admin] PATH_INFO: `/v3/domains` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:00.673659 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a63fe6-9a1c-4aca-97e3-75c3ef5cfebc None admin] RBAC: Adding query filter params (name=Default) {{(pid=86655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:40:00.673971 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a63fe6-9a1c-4aca-97e3-75c3ef5cfebc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:00.675454 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a63fe6-9a1c-4aca-97e3-75c3ef5cfebc None admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:00.684434 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 297/590] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Jul 14 10:40:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:40:00.685660 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d78034-b640-41b5-b5e5-1f8f38a9bc9d None admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:00.688428 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 294/591] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Jul 14 10:40:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:40:00.690871 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a63fe6-9a1c-4aca-97e3-75c3ef5cfebc None admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:00.750437 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=100 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:00.803290 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=100 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:00.808270 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d78034-b640-41b5-b5e5-1f8f38a9bc9d None admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:00.814276 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a63fe6-9a1c-4aca-97e3-75c3ef5cfebc None admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:00.852594 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a93ba68-3a8f-4e34-8f30-e17096dc7057 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:00.853611 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a93ba68-3a8f-4e34-8f30-e17096dc7057 None admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:00.854233 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a93ba68-3a8f-4e34-8f30-e17096dc7057 None admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:00.854972 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a93ba68-3a8f-4e34-8f30-e17096dc7057 None admin] PATH_INFO: `/v3/users` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:00.856271 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a93ba68-3a8f-4e34-8f30-e17096dc7057 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=86656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:40:00.856877 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a93ba68-3a8f-4e34-8f30-e17096dc7057 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:00.858691 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a93ba68-3a8f-4e34-8f30-e17096dc7057 None admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:00.859956 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54643287-1753-43ad-8bda-d0c6a153738e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:00.860887 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54643287-1753-43ad-8bda-d0c6a153738e None admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:00.861252 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54643287-1753-43ad-8bda-d0c6a153738e None admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:00.861596 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54643287-1753-43ad-8bda-d0c6a153738e None admin] PATH_INFO: `/v3/projects/service` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:00.870692 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54643287-1753-43ad-8bda-d0c6a153738e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:00.873227 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54643287-1753-43ad-8bda-d0c6a153738e None admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:00.882646 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 298/592] 10.222.0.16 () {56 vars in 1137 bytes} [Thu Jul 14 10:40:00 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:40:00.883795 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a93ba68-3a8f-4e34-8f30-e17096dc7057 None admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:00.895834 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application [None req-54643287-1753-43ad-8bda-d0c6a153738e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 10:40:00.895834 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:40:00.895834 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:40:00.895834 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:40:00.895834 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:40:00.895834 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:40:00.895834 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:40:00.895834 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:40:00.895834 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:40:00.895834 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:40:00.895834 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:40:00.895834 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:40:00.895834 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 10:40:00.895834 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 10:40:00.895834 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 10:40:00.896706 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 10:40:00.896706 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:40:00.896706 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:40:00.896706 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:40:00.896706 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:40:00.896706 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:40:00.896706 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:40:00.896706 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:40:00.896706 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application with Lock( Jul 14 10:40:00.896706 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:40:00.896706 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:40:00.896706 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:40:00.896706 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:40:00.896706 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:40:00.896706 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:40:00.896706 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:40:00.896706 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:40:00.897779 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 10:40:00.897779 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 10:40:00.897779 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 10:40:00.897779 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 10:40:00.897779 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 10:40:00.897779 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 10:40:00.897779 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 10:40:00.897779 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application Jul 14 10:40:00.897779 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 295/593] 10.222.0.16 () {56 vars in 1111 bytes} [Thu Jul 14 10:40:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:40:00.898440 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54643287-1753-43ad-8bda-d0c6a153738e None admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:01.012740 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54643287-1753-43ad-8bda-d0c6a153738e None admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:01.023751 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a93ba68-3a8f-4e34-8f30-e17096dc7057 None admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:01.027409 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=100 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:01.052365 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535e6442-872b-413e-a919-1eb28124f9ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:01.053495 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535e6442-872b-413e-a919-1eb28124f9ed None admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:01.053991 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535e6442-872b-413e-a919-1eb28124f9ed None admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:01.054464 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535e6442-872b-413e-a919-1eb28124f9ed None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:01.066485 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535e6442-872b-413e-a919-1eb28124f9ed None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:01.067894 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd30c7d-a335-4b8c-ac6f-5a2cb20b6c1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:01.068469 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535e6442-872b-413e-a919-1eb28124f9ed None admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:01.068703 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd30c7d-a335-4b8c-ac6f-5a2cb20b6c1c None admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:01.069026 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd30c7d-a335-4b8c-ac6f-5a2cb20b6c1c None admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:01.069309 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd30c7d-a335-4b8c-ac6f-5a2cb20b6c1c None admin] PATH_INFO: `/v3/users/glance` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:01.077772 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd30c7d-a335-4b8c-ac6f-5a2cb20b6c1c None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:01.079937 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd30c7d-a335-4b8c-ac6f-5a2cb20b6c1c None admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:01.087767 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application [None req-535e6442-872b-413e-a919-1eb28124f9ed None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 10:40:01.087767 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:40:01.087767 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:40:01.087767 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:40:01.087767 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:40:01.087767 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:40:01.087767 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:40:01.087767 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:40:01.087767 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:40:01.087767 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:40:01.087767 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:40:01.087767 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:40:01.087767 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 10:40:01.087767 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 10:40:01.087767 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 10:40:01.088600 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 10:40:01.088600 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:40:01.088600 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:40:01.088600 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:40:01.088600 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:40:01.088600 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:40:01.088600 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:40:01.088600 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:40:01.088600 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application with Lock( Jul 14 10:40:01.088600 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:40:01.088600 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:40:01.088600 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:40:01.088600 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:40:01.088600 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:40:01.088600 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:40:01.088600 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:40:01.088600 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:40:01.089495 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 10:40:01.089495 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 10:40:01.089495 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 10:40:01.089495 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application Jul 14 10:40:01.091694 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 296/594] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Jul 14 10:40:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:40:01.092635 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535e6442-872b-413e-a919-1eb28124f9ed None admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:01.099156 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application [None req-4bd30c7d-a335-4b8c-ac6f-5a2cb20b6c1c None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 14 10:40:01.099156 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:40:01.099156 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:40:01.099156 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:40:01.099156 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:40:01.099156 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:40:01.099156 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:40:01.099156 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:40:01.099156 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:40:01.099156 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:40:01.099156 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:40:01.099156 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:40:01.099156 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 10:40:01.099156 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 10:40:01.099156 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 10:40:01.099156 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 10:40:01.100052 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:40:01.100052 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:40:01.100052 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 10:40:01.100052 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 10:40:01.100052 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 10:40:01.100052 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 10:40:01.100052 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:40:01.100052 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:40:01.100052 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:40:01.100052 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:40:01.100052 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:40:01.100052 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application with Lock( Jul 14 10:40:01.100052 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:40:01.100052 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:40:01.100052 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:40:01.100052 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:40:01.100052 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:40:01.100052 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:40:01.100992 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:40:01.100992 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:40:01.100992 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 10:40:01.100992 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 10:40:01.100992 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 10:40:01.100992 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 10:40:01.100992 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 10:40:01.100992 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 10:40:01.100992 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 14 10:40:01.100992 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application Jul 14 10:40:01.103363 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 299/595] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Jul 14 10:40:00 2022] GET /identity/v3/users/glance => generated 84 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:40:01.104437 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd30c7d-a335-4b8c-ac6f-5a2cb20b6c1c None admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:01.127083 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=100 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:01.217885 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd30c7d-a335-4b8c-ac6f-5a2cb20b6c1c None admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:01.218559 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535e6442-872b-413e-a919-1eb28124f9ed None admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:01.254354 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c39117-67ec-4898-a2f7-700f8f0df35a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:01.255029 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c39117-67ec-4898-a2f7-700f8f0df35a None admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:01.255292 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9121f16e-6a1c-456f-8ef5-53e31d8791ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:01.255424 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c39117-67ec-4898-a2f7-700f8f0df35a None admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:01.255606 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c39117-67ec-4898-a2f7-700f8f0df35a None admin] PATH_INFO: `/v3/domains` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:01.256315 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c39117-67ec-4898-a2f7-700f8f0df35a None admin] RBAC: Adding query filter params (name=Default) {{(pid=86656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:40:01.256629 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c39117-67ec-4898-a2f7-700f8f0df35a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:01.256885 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9121f16e-6a1c-456f-8ef5-53e31d8791ce None admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:01.257376 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9121f16e-6a1c-456f-8ef5-53e31d8791ce None admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:01.257889 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9121f16e-6a1c-456f-8ef5-53e31d8791ce None admin] PATH_INFO: `/v3/projects` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:01.258054 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c39117-67ec-4898-a2f7-700f8f0df35a None admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:01.259081 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9121f16e-6a1c-456f-8ef5-53e31d8791ce None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:40:01.259927 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9121f16e-6a1c-456f-8ef5-53e31d8791ce None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:01.261599 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9121f16e-6a1c-456f-8ef5-53e31d8791ce None admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:01.272921 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 300/596] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Jul 14 10:40:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:40:01.274122 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c39117-67ec-4898-a2f7-700f8f0df35a None admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:01.279213 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 297/597] 10.222.0.16 () {56 vars in 1148 bytes} [Thu Jul 14 10:40:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:40:01.280357 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9121f16e-6a1c-456f-8ef5-53e31d8791ce None admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:01.321075 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=100 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:01.377765 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=100 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:01.405560 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9121f16e-6a1c-456f-8ef5-53e31d8791ce None admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:01.406227 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c39117-67ec-4898-a2f7-700f8f0df35a None admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:01.449820 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766d9c71-fbab-4ec9-bdcd-7f294ad059c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:01.450033 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1e89c2-8127-494a-a00e-52b06ca8599f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:01.450571 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1e89c2-8127-494a-a00e-52b06ca8599f None admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:01.450651 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766d9c71-fbab-4ec9-bdcd-7f294ad059c4 None admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:01.450897 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1e89c2-8127-494a-a00e-52b06ca8599f None admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:01.450994 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766d9c71-fbab-4ec9-bdcd-7f294ad059c4 None admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:01.451065 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1e89c2-8127-494a-a00e-52b06ca8599f None admin] PATH_INFO: `/v3/users` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:01.451143 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766d9c71-fbab-4ec9-bdcd-7f294ad059c4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:01.451909 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1e89c2-8127-494a-a00e-52b06ca8599f None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=86656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:40:01.452227 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1e89c2-8127-494a-a00e-52b06ca8599f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:01.454953 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1e89c2-8127-494a-a00e-52b06ca8599f None admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:01.460248 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766d9c71-fbab-4ec9-bdcd-7f294ad059c4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:01.461723 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766d9c71-fbab-4ec9-bdcd-7f294ad059c4 None admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:01.475125 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 301/598] 10.222.0.16 () {56 vars in 1137 bytes} [Thu Jul 14 10:40:01 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:40:01.475957 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1e89c2-8127-494a-a00e-52b06ca8599f None admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:01.485474 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application [None req-766d9c71-fbab-4ec9-bdcd-7f294ad059c4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 10:40:01.485474 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:40:01.485474 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:40:01.485474 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:40:01.485474 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:40:01.485474 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:40:01.485474 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:40:01.485474 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:40:01.485474 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:40:01.485474 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:40:01.485474 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:40:01.485474 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:40:01.485474 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 10:40:01.485474 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 10:40:01.485474 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 10:40:01.486385 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 10:40:01.486385 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:40:01.486385 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:40:01.486385 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:40:01.486385 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:40:01.486385 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:40:01.486385 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:40:01.486385 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:40:01.486385 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application with Lock( Jul 14 10:40:01.486385 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:40:01.486385 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:40:01.486385 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:40:01.486385 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:40:01.486385 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:40:01.486385 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:40:01.486385 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:40:01.486385 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:40:01.487665 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 10:40:01.487665 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 10:40:01.487665 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 10:40:01.487665 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 10:40:01.487665 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 10:40:01.487665 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 10:40:01.487665 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 10:40:01.487665 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application Jul 14 10:40:01.487665 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 298/599] 10.222.0.16 () {56 vars in 1111 bytes} [Thu Jul 14 10:40:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:40:01.488465 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766d9c71-fbab-4ec9-bdcd-7f294ad059c4 None admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:01.597722 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=100 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:01.611032 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1e89c2-8127-494a-a00e-52b06ca8599f None admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:01.618423 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766d9c71-fbab-4ec9-bdcd-7f294ad059c4 None admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:01.653755 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7d944d-cf40-4f77-bebf-058045635634 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:01.654660 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7d944d-cf40-4f77-bebf-058045635634 None admin] REQUEST_METHOD: `PUT` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:01.655058 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7d944d-cf40-4f77-bebf-058045635634 None admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:01.655443 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7d944d-cf40-4f77-bebf-058045635634 None admin] PATH_INFO: `/v3/projects/59391272ecbe48b0aa736cb43807be1d/users/4dddf93691844886982c91fea974385d/roles/d58911e96aad48cf9ca61ac5df79e21d` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:01.656837 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac8401d-c4f0-47b1-a88e-4f2b32f0eefc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:01.657690 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac8401d-c4f0-47b1-a88e-4f2b32f0eefc None admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:01.657977 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac8401d-c4f0-47b1-a88e-4f2b32f0eefc None admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:01.658254 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac8401d-c4f0-47b1-a88e-4f2b32f0eefc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:01.663295 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=100 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:01.670443 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac8401d-c4f0-47b1-a88e-4f2b32f0eefc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:01.671963 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac8401d-c4f0-47b1-a88e-4f2b32f0eefc None admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:01.676156 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7d944d-cf40-4f77-bebf-058045635634 None admin] RBAC: Authorizing `identity:create_grant(project_id=59391272ecbe48b0aa736cb43807be1d, user_id=4dddf93691844886982c91fea974385d, role_id=d58911e96aad48cf9ca61ac5df79e21d)` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:01.677824 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7d944d-cf40-4f77-bebf-058045635634 None admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:01.691796 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application [None req-fac8401d-c4f0-47b1-a88e-4f2b32f0eefc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 10:40:01.691796 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:40:01.691796 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:40:01.691796 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:40:01.691796 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:40:01.691796 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:40:01.691796 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:40:01.691796 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:40:01.691796 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:40:01.691796 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:40:01.691796 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:40:01.691796 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:40:01.691796 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 10:40:01.691796 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 10:40:01.691796 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 10:40:01.693936 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 10:40:01.693936 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:40:01.693936 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:40:01.693936 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:40:01.693936 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:40:01.693936 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:40:01.693936 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:40:01.693936 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:40:01.693936 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application with Lock( Jul 14 10:40:01.693936 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:40:01.693936 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:40:01.693936 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:40:01.693936 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:40:01.693936 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:40:01.693936 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:40:01.693936 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:40:01.693936 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:40:01.696063 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 10:40:01.696063 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 10:40:01.696063 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 10:40:01.696063 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application Jul 14 10:40:01.696063 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 299/600] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Jul 14 10:40:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:40:01.696063 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac8401d-c4f0-47b1-a88e-4f2b32f0eefc None admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:01.698674 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 302/601] 10.222.0.16 () {58 vars in 1439 bytes} [Thu Jul 14 10:40:01 2022] PUT /identity/v3/projects/59391272ecbe48b0aa736cb43807be1d/users/4dddf93691844886982c91fea974385d/roles/d58911e96aad48cf9ca61ac5df79e21d => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:40:01.706983 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7d944d-cf40-4f77-bebf-058045635634 None admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:01.911838 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac8401d-c4f0-47b1-a88e-4f2b32f0eefc None admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:01.923272 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7d944d-cf40-4f77-bebf-058045635634 None admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:01.958945 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c63713-d415-4ed5-bb52-ca794ee50b3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:01.959623 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c63713-d415-4ed5-bb52-ca794ee50b3a None admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:01.959910 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c63713-d415-4ed5-bb52-ca794ee50b3a None admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:01.960188 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c63713-d415-4ed5-bb52-ca794ee50b3a None admin] PATH_INFO: `/v3/projects` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:01.961289 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c63713-d415-4ed5-bb52-ca794ee50b3a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:40:01.962017 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c63713-d415-4ed5-bb52-ca794ee50b3a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:01.963860 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c63713-d415-4ed5-bb52-ca794ee50b3a None admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:01.966515 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873a5c78-7168-46a7-88b6-abbe8ae63637 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:01.967003 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=100 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:01.967333 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873a5c78-7168-46a7-88b6-abbe8ae63637 None admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:01.967898 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873a5c78-7168-46a7-88b6-abbe8ae63637 None admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:01.968015 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873a5c78-7168-46a7-88b6-abbe8ae63637 None admin] PATH_INFO: `/v3/domains` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:01.970026 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873a5c78-7168-46a7-88b6-abbe8ae63637 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:40:01.971018 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873a5c78-7168-46a7-88b6-abbe8ae63637 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:01.972928 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873a5c78-7168-46a7-88b6-abbe8ae63637 None admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:01.980039 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 300/602] 10.222.0.16 () {56 vars in 1148 bytes} [Thu Jul 14 10:40:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:40:01.987246 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c63713-d415-4ed5-bb52-ca794ee50b3a None admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:01.993028 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 303/603] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Jul 14 10:40:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:40:01.998885 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873a5c78-7168-46a7-88b6-abbe8ae63637 None admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:02.086772 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:02.167587 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873a5c78-7168-46a7-88b6-abbe8ae63637 None admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:02.197124 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c63713-d415-4ed5-bb52-ca794ee50b3a None admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:02.229841 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c4c3b9-4774-42f6-a3bb-00f24de680e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:02.230639 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c4c3b9-4774-42f6-a3bb-00f24de680e4 None admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:02.230919 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c4c3b9-4774-42f6-a3bb-00f24de680e4 None admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:02.231193 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c4c3b9-4774-42f6-a3bb-00f24de680e4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:02.242692 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c4c3b9-4774-42f6-a3bb-00f24de680e4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:02.244143 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c4c3b9-4774-42f6-a3bb-00f24de680e4 None admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:02.269504 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7a9d58-a7ca-4c44-b8ff-92515e41069f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:02.270036 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application [None req-04c4c3b9-4774-42f6-a3bb-00f24de680e4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 10:40:02.270036 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:40:02.270036 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:40:02.270036 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:40:02.270036 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:40:02.270036 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:40:02.270036 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:40:02.270036 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:40:02.270036 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:40:02.270036 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:40:02.270036 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:40:02.270036 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:40:02.270036 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 10:40:02.270036 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 10:40:02.270036 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 10:40:02.270873 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 10:40:02.270873 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:40:02.270873 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:40:02.270873 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:40:02.270873 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:40:02.270873 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:40:02.270873 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:40:02.270873 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:40:02.270873 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application with Lock( Jul 14 10:40:02.270873 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:40:02.270873 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:40:02.270873 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:40:02.270873 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:40:02.270873 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:40:02.270873 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:40:02.270873 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:40:02.270873 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:40:02.271758 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 10:40:02.271758 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 10:40:02.271758 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 10:40:02.271758 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 10:40:02.271758 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 10:40:02.271758 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 10:40:02.271758 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 10:40:02.271758 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application Jul 14 10:40:02.271758 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 304/604] 10.222.0.16 () {56 vars in 1111 bytes} [Thu Jul 14 10:40:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 273 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 10:40:02.273735 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7a9d58-a7ca-4c44-b8ff-92515e41069f None admin] REQUEST_METHOD: `PUT` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:02.274268 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7a9d58-a7ca-4c44-b8ff-92515e41069f None admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:02.274750 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7a9d58-a7ca-4c44-b8ff-92515e41069f None admin] PATH_INFO: `/v3/projects/59391272ecbe48b0aa736cb43807be1d/users/68382432147a48c3b62271fd2a2eab04/roles/d58911e96aad48cf9ca61ac5df79e21d` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:02.276725 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c4c3b9-4774-42f6-a3bb-00f24de680e4 None admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:02.294331 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7a9d58-a7ca-4c44-b8ff-92515e41069f None admin] RBAC: Authorizing `identity:create_grant(project_id=59391272ecbe48b0aa736cb43807be1d, user_id=68382432147a48c3b62271fd2a2eab04, role_id=d58911e96aad48cf9ca61ac5df79e21d)` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:02.296220 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7a9d58-a7ca-4c44-b8ff-92515e41069f None admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:02.321617 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 301/605] 10.222.0.16 () {58 vars in 1439 bytes} [Thu Jul 14 10:40:01 2022] PUT /identity/v3/projects/59391272ecbe48b0aa736cb43807be1d/users/68382432147a48c3b62271fd2a2eab04/roles/d58911e96aad48cf9ca61ac5df79e21d => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:40:02.417695 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef5fbbf-9381-45e2-8546-2438506dc8e0 None None] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:02.418016 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef5fbbf-9381-45e2-8546-2438506dc8e0 None None] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:02.418199 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef5fbbf-9381-45e2-8546-2438506dc8e0 None None] PATH_INFO: `/` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:02.419891 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 302/606] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jul 14 10:40:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:40:02.425570 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16187834-25fb-4a7e-ac27-9443fda9a0f4 None None] REQUEST_METHOD: `POST` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:02.425879 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16187834-25fb-4a7e-ac27-9443fda9a0f4 None None] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:02.426161 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16187834-25fb-4a7e-ac27-9443fda9a0f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:02.459768 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.auth.core [None req-16187834-25fb-4a7e-ac27-9443fda9a0f4 None None] MFA Rules not processed for user `ae4bcdd8106d4bebbdcae96be33505bc`. Rule list: `[]` (Enabled: `True`). {{(pid=86655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:40:02.462201 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c4c3b9-4774-42f6-a3bb-00f24de680e4 None admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:02.465238 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-16187834-25fb-4a7e-ac27-9443fda9a0f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:40:02.489223 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=100 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:02.537966 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c6a834-17c4-4967-b18c-1aa43ae1467c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:02.538649 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c6a834-17c4-4967-b18c-1aa43ae1467c None admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:02.538938 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c6a834-17c4-4967-b18c-1aa43ae1467c None admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:02.539396 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c6a834-17c4-4967-b18c-1aa43ae1467c None admin] PATH_INFO: `/v3/projects` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:02.541101 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c6a834-17c4-4967-b18c-1aa43ae1467c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:40:02.541424 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c6a834-17c4-4967-b18c-1aa43ae1467c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:02.542884 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c6a834-17c4-4967-b18c-1aa43ae1467c None admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:02.549565 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:02.559734 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 305/607] 10.222.0.16 () {56 vars in 1148 bytes} [Thu Jul 14 10:40:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 10:40:02.561986 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbff759d-aabd-4b60-9599-d9f5a677d1d7 None None] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:02.562457 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbff759d-aabd-4b60-9599-d9f5a677d1d7 None None] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:02.562748 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbff759d-aabd-4b60-9599-d9f5a677d1d7 None None] PATH_INFO: `/` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:02.564872 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 306/608] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jul 14 10:40:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:40:02.565653 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbff759d-aabd-4b60-9599-d9f5a677d1d7 None None] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:02.584086 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 303/609] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jul 14 10:40:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 14 10:40:02.585421 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3112a9ec-709d-4f25-9beb-00d3268a087f None None] REQUEST_METHOD: `POST` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:02.585712 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3112a9ec-709d-4f25-9beb-00d3268a087f None None] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:02.585990 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3112a9ec-709d-4f25-9beb-00d3268a087f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:02.603949 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.auth.core [None req-3112a9ec-709d-4f25-9beb-00d3268a087f None None] MFA Rules not processed for user `ae4bcdd8106d4bebbdcae96be33505bc`. Rule list: `[]` (Enabled: `True`). {{(pid=86655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:40:02.605202 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-3112a9ec-709d-4f25-9beb-00d3268a087f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:40:02.692689 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 304/610] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jul 14 10:40:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 10:40:02.693062 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbff759d-aabd-4b60-9599-d9f5a677d1d7 None None] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:02.693557 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3112a9ec-709d-4f25-9beb-00d3268a087f None None] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:02.728158 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedd0de1-d45f-4f3d-8143-df69490be404 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:02.729093 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedd0de1-d45f-4f3d-8143-df69490be404 None admin] REQUEST_METHOD: `PUT` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:02.729379 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedd0de1-d45f-4f3d-8143-df69490be404 None admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:02.729653 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedd0de1-d45f-4f3d-8143-df69490be404 None admin] PATH_INFO: `/v3/projects/59391272ecbe48b0aa736cb43807be1d/users/4cb877bf3f8241dcb2ecbb612c7f4f69/roles/d58911e96aad48cf9ca61ac5df79e21d` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:02.746083 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fedd0de1-d45f-4f3d-8143-df69490be404 None admin] RBAC: Authorizing `identity:create_grant(project_id=59391272ecbe48b0aa736cb43807be1d, user_id=4cb877bf3f8241dcb2ecbb612c7f4f69, role_id=d58911e96aad48cf9ca61ac5df79e21d)` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:02.747549 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fedd0de1-d45f-4f3d-8143-df69490be404 None admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:02.767443 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 307/611] 10.222.0.16 () {58 vars in 1439 bytes} [Thu Jul 14 10:40:02 2022] PUT /identity/v3/projects/59391272ecbe48b0aa736cb43807be1d/users/4cb877bf3f8241dcb2ecbb612c7f4f69/roles/d58911e96aad48cf9ca61ac5df79e21d => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:40:02.768296 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedd0de1-d45f-4f3d-8143-df69490be404 None admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:02.804756 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:02.847678 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3112a9ec-709d-4f25-9beb-00d3268a087f None None] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:02.856090 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=100 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:02.887325 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db279dca-7493-48c9-a1b1-f843399986e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:02.888269 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db279dca-7493-48c9-a1b1-f843399986e7 None admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:02.888625 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db279dca-7493-48c9-a1b1-f843399986e7 None admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:02.888999 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db279dca-7493-48c9-a1b1-f843399986e7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:02.920067 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db279dca-7493-48c9-a1b1-f843399986e7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 10:40:02.923623 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedd0de1-d45f-4f3d-8143-df69490be404 None admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:02.928078 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application [None req-db279dca-7493-48c9-a1b1-f843399986e7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 14 10:40:02.928078 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:40:02.928078 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:40:02.928078 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:40:02.928078 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:40:02.928078 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:40:02.928078 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:40:02.928078 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:40:02.928078 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:40:02.928078 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:40:02.928078 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:40:02.928078 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:40:02.928078 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 10:40:02.928078 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 10:40:02.928078 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 10:40:02.928078 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 10:40:02.929085 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 10:40:02.929085 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 10:40:02.929085 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 10:40:02.929085 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 10:40:02.929085 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:40:02.929085 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:40:02.929085 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:40:02.929085 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:40:02.929085 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:40:02.929085 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:40:02.929085 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:40:02.929085 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application with Lock( Jul 14 10:40:02.929085 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:40:02.929085 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:40:02.929085 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:40:02.929085 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:40:02.929933 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:40:02.929933 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:40:02.929933 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:40:02.929933 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:40:02.929933 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 10:40:02.929933 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 10:40:02.929933 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 10:40:02.929933 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 10:40:02.929933 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 10:40:02.929933 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 10:40:02.929933 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 14 10:40:02.929933 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application Jul 14 10:40:02.929933 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 305/612] 10.222.0.16 () {56 vars in 1102 bytes} [Thu Jul 14 10:40:02 2022] GET /identity/v3/roles/service => generated 85 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:40:02.946378 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db279dca-7493-48c9-a1b1-f843399986e7 None admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:02.968712 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2482bc7e-4352-488a-9f58-83d458315807 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:02.969671 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2482bc7e-4352-488a-9f58-83d458315807 None admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:02.969960 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2482bc7e-4352-488a-9f58-83d458315807 None admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:02.970235 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2482bc7e-4352-488a-9f58-83d458315807 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:02.982648 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2482bc7e-4352-488a-9f58-83d458315807 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 10:40:02.992746 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application [None req-2482bc7e-4352-488a-9f58-83d458315807 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 14 10:40:02.992746 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:40:02.992746 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:40:02.992746 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:40:02.992746 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:40:02.992746 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:40:02.992746 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:40:02.992746 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:40:02.992746 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:40:02.992746 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:40:02.992746 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:40:02.992746 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:40:02.992746 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 10:40:02.992746 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 10:40:02.992746 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 10:40:02.992746 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 10:40:02.994949 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 10:40:02.994949 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 10:40:02.994949 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 10:40:02.994949 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 10:40:02.994949 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:40:02.994949 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:40:02.994949 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:40:02.994949 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:40:02.994949 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:40:02.994949 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:40:02.994949 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:40:02.994949 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application with Lock( Jul 14 10:40:02.994949 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:40:02.994949 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:40:02.994949 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:40:02.994949 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:40:02.996983 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:40:02.996983 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:40:02.996983 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:40:02.996983 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:40:02.996983 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 10:40:02.996983 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 10:40:02.996983 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 10:40:02.996983 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 10:40:02.996983 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 10:40:02.996983 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 10:40:02.996983 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 14 10:40:02.996983 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application Jul 14 10:40:02.996983 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 308/613] 10.222.0.16 () {56 vars in 1102 bytes} [Thu Jul 14 10:40:02 2022] GET /identity/v3/roles/service => generated 85 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:40:03.004794 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2482bc7e-4352-488a-9f58-83d458315807 None admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:03.113192 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=100 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:03.136796 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db279dca-7493-48c9-a1b1-f843399986e7 None admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:03.140379 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2482bc7e-4352-488a-9f58-83d458315807 None admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:03.200298 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7780946-b581-4dd1-ad85-a2c04853b0c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:03.200924 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7780946-b581-4dd1-ad85-a2c04853b0c6 None admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:03.201211 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7780946-b581-4dd1-ad85-a2c04853b0c6 None admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:03.201489 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7780946-b581-4dd1-ad85-a2c04853b0c6 None admin] PATH_INFO: `/v3/roles` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:03.202255 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7780946-b581-4dd1-ad85-a2c04853b0c6 None admin] RBAC: Adding query filter params (name=service) {{(pid=86655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:40:03.202564 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7780946-b581-4dd1-ad85-a2c04853b0c6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:03.207777 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca76580-e944-4127-adb3-1f1fafcc398e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:03.208455 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca76580-e944-4127-adb3-1f1fafcc398e None admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:03.208743 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca76580-e944-4127-adb3-1f1fafcc398e None admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:03.209042 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca76580-e944-4127-adb3-1f1fafcc398e None admin] PATH_INFO: `/v3/roles` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:03.209703 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7780946-b581-4dd1-ad85-a2c04853b0c6 None admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:03.209881 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca76580-e944-4127-adb3-1f1fafcc398e None admin] RBAC: Adding query filter params (name=service) {{(pid=86656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:40:03.210087 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca76580-e944-4127-adb3-1f1fafcc398e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:03.211649 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca76580-e944-4127-adb3-1f1fafcc398e None admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:03.225891 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 309/614] 10.222.0.16 () {56 vars in 1103 bytes} [Thu Jul 14 10:40:02 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 10:40:03.233524 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca76580-e944-4127-adb3-1f1fafcc398e None admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:03.234049 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 306/615] 10.222.0.16 () {56 vars in 1103 bytes} [Thu Jul 14 10:40:02 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:40:03.237931 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7780946-b581-4dd1-ad85-a2c04853b0c6 None admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:03.285950 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=100 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:03.388164 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7780946-b581-4dd1-ad85-a2c04853b0c6 None admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:03.439239 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca76580-e944-4127-adb3-1f1fafcc398e None admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:03.454296 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82d2e0f-53c0-4e7f-ae0c-257b81ee575d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:03.455033 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82d2e0f-53c0-4e7f-ae0c-257b81ee575d None admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:03.455318 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82d2e0f-53c0-4e7f-ae0c-257b81ee575d None admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:03.455594 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82d2e0f-53c0-4e7f-ae0c-257b81ee575d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:03.469369 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82d2e0f-53c0-4e7f-ae0c-257b81ee575d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:03.470897 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82d2e0f-53c0-4e7f-ae0c-257b81ee575d None admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:03.494854 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application [None req-a82d2e0f-53c0-4e7f-ae0c-257b81ee575d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 10:40:03.494854 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:40:03.494854 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:40:03.494854 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:40:03.494854 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:40:03.494854 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:40:03.494854 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:40:03.494854 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:40:03.494854 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:40:03.494854 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:40:03.494854 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:40:03.494854 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:40:03.494854 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 10:40:03.494854 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 10:40:03.494854 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 10:40:03.496683 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 10:40:03.496683 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:40:03.496683 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:40:03.496683 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:40:03.496683 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:40:03.496683 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:40:03.496683 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:40:03.496683 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:40:03.496683 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application with Lock( Jul 14 10:40:03.496683 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:40:03.496683 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:40:03.496683 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:40:03.496683 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:40:03.496683 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:40:03.496683 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:40:03.496683 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:40:03.496683 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:40:03.497847 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 10:40:03.497847 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 10:40:03.497847 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 10:40:03.497847 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application Jul 14 10:40:03.500926 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 307/616] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Jul 14 10:40:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 10:40:03.505372 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82d2e0f-53c0-4e7f-ae0c-257b81ee575d None admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:03.507733 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdf9da6-03bc-4ec3-9fd0-7b7766c1715f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:03.508661 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdf9da6-03bc-4ec3-9fd0-7b7766c1715f None admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:03.509083 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdf9da6-03bc-4ec3-9fd0-7b7766c1715f None admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:03.509463 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdf9da6-03bc-4ec3-9fd0-7b7766c1715f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:03.517243 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=100 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:03.522552 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bdf9da6-03bc-4ec3-9fd0-7b7766c1715f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:03.524548 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bdf9da6-03bc-4ec3-9fd0-7b7766c1715f None admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:03.543311 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application [None req-0bdf9da6-03bc-4ec3-9fd0-7b7766c1715f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 10:40:03.543311 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:40:03.543311 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:40:03.543311 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:40:03.543311 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:40:03.543311 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:40:03.543311 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:40:03.543311 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:40:03.543311 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:40:03.543311 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:40:03.543311 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:40:03.543311 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:40:03.543311 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 10:40:03.543311 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 10:40:03.543311 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 10:40:03.544410 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 10:40:03.544410 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:40:03.544410 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:40:03.544410 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:40:03.544410 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:40:03.544410 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:40:03.544410 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:40:03.544410 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:40:03.544410 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application with Lock( Jul 14 10:40:03.544410 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:40:03.544410 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:40:03.544410 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:40:03.544410 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:40:03.544410 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:40:03.544410 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:40:03.544410 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:40:03.544410 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:40:03.545633 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 10:40:03.545633 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 10:40:03.545633 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 10:40:03.545633 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application Jul 14 10:40:03.547793 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 310/617] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Jul 14 10:40:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 315 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:40:03.553287 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdf9da6-03bc-4ec3-9fd0-7b7766c1715f None admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:03.625149 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=100 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:03.627501 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82d2e0f-53c0-4e7f-ae0c-257b81ee575d None admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:03.665817 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889df67e-ab61-4bf3-9505-00cc7fbf8ec8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:03.666600 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889df67e-ab61-4bf3-9505-00cc7fbf8ec8 None admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:03.666981 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889df67e-ab61-4bf3-9505-00cc7fbf8ec8 None admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:03.667418 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889df67e-ab61-4bf3-9505-00cc7fbf8ec8 None admin] PATH_INFO: `/v3/domains` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:03.668246 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889df67e-ab61-4bf3-9505-00cc7fbf8ec8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:40:03.668628 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889df67e-ab61-4bf3-9505-00cc7fbf8ec8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:03.670274 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889df67e-ab61-4bf3-9505-00cc7fbf8ec8 None admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:03.683434 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 308/618] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Jul 14 10:40:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:40:03.691757 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889df67e-ab61-4bf3-9505-00cc7fbf8ec8 None admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:03.808602 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdf9da6-03bc-4ec3-9fd0-7b7766c1715f None admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:03.842140 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889df67e-ab61-4bf3-9505-00cc7fbf8ec8 None admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:03.878525 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e2421a-691c-4a9e-93ab-5a9790aa81fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:03.879387 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e2421a-691c-4a9e-93ab-5a9790aa81fc None admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:03.879675 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e2421a-691c-4a9e-93ab-5a9790aa81fc None admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:03.879951 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e2421a-691c-4a9e-93ab-5a9790aa81fc None admin] PATH_INFO: `/v3/users/swift` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:03.881476 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475b3268-3315-4be5-80ac-99fd26e31ece None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:03.882156 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475b3268-3315-4be5-80ac-99fd26e31ece None admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:03.882438 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475b3268-3315-4be5-80ac-99fd26e31ece None admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:03.882714 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475b3268-3315-4be5-80ac-99fd26e31ece None admin] PATH_INFO: `/v3/domains` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:03.883449 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475b3268-3315-4be5-80ac-99fd26e31ece None admin] RBAC: Adding query filter params (name=Default) {{(pid=86656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:40:03.883758 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475b3268-3315-4be5-80ac-99fd26e31ece None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:03.885156 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475b3268-3315-4be5-80ac-99fd26e31ece None admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:03.887383 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e2421a-691c-4a9e-93ab-5a9790aa81fc None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:03.888951 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e2421a-691c-4a9e-93ab-5a9790aa81fc None admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:03.892486 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=100 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:03.906595 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 311/619] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Jul 14 10:40:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 354 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 10:40:03.912017 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application [None req-a3e2421a-691c-4a9e-93ab-5a9790aa81fc None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 14 10:40:03.912017 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:40:03.912017 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:40:03.912017 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:40:03.912017 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:40:03.912017 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:40:03.912017 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:40:03.912017 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:40:03.912017 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:40:03.912017 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:40:03.912017 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:40:03.912017 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:40:03.912017 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 10:40:03.912017 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 10:40:03.912017 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 10:40:03.912017 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 10:40:03.913152 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:40:03.913152 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:40:03.913152 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 10:40:03.913152 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 10:40:03.913152 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 10:40:03.913152 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 10:40:03.913152 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:40:03.913152 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:40:03.913152 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:40:03.913152 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:40:03.913152 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:40:03.913152 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application with Lock( Jul 14 10:40:03.913152 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:40:03.913152 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:40:03.913152 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:40:03.913152 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:40:03.913152 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:40:03.913152 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:40:03.914091 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:40:03.914091 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:40:03.914091 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 10:40:03.914091 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 10:40:03.914091 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 10:40:03.914091 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 10:40:03.914091 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 10:40:03.914091 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 10:40:03.914091 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 14 10:40:03.914091 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application Jul 14 10:40:03.914636 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475b3268-3315-4be5-80ac-99fd26e31ece None admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:03.916885 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 309/620] 10.222.0.16 () {56 vars in 1096 bytes} [Thu Jul 14 10:40:03 2022] GET /identity/v3/users/swift => generated 83 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:40:03.920791 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e2421a-691c-4a9e-93ab-5a9790aa81fc None admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:04.014840 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=100 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:04.096339 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e2421a-691c-4a9e-93ab-5a9790aa81fc None admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:04.111500 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475b3268-3315-4be5-80ac-99fd26e31ece None admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:04.133202 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c811d2-af38-43c1-9ce3-c94cb6867f1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:04.134121 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c811d2-af38-43c1-9ce3-c94cb6867f1f None admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:04.134574 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c811d2-af38-43c1-9ce3-c94cb6867f1f None admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:04.134992 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c811d2-af38-43c1-9ce3-c94cb6867f1f None admin] PATH_INFO: `/v3/users` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:04.136120 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c811d2-af38-43c1-9ce3-c94cb6867f1f None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=86655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:40:04.136582 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c811d2-af38-43c1-9ce3-c94cb6867f1f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:04.138193 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c811d2-af38-43c1-9ce3-c94cb6867f1f None admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:04.161898 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 310/621] 10.222.0.16 () {56 vars in 1135 bytes} [Thu Jul 14 10:40:03 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 10:40:04.163485 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c811d2-af38-43c1-9ce3-c94cb6867f1f None admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:04.174927 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a3929f-927a-4d0b-80a7-9410dc2b5024 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:04.175736 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a3929f-927a-4d0b-80a7-9410dc2b5024 None admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:04.176083 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a3929f-927a-4d0b-80a7-9410dc2b5024 None admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:04.176367 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a3929f-927a-4d0b-80a7-9410dc2b5024 None admin] PATH_INFO: `/v3/users/nova` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:04.184316 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a3929f-927a-4d0b-80a7-9410dc2b5024 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:04.186227 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a3929f-927a-4d0b-80a7-9410dc2b5024 None admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:04.202048 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application [None req-48a3929f-927a-4d0b-80a7-9410dc2b5024 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 14 10:40:04.202048 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:40:04.202048 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:40:04.202048 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:40:04.202048 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:40:04.202048 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:40:04.202048 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:40:04.202048 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:40:04.202048 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:40:04.202048 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:40:04.202048 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:40:04.202048 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:40:04.202048 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 10:40:04.202048 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 10:40:04.202048 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 10:40:04.202048 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 10:40:04.203729 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:40:04.203729 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:40:04.203729 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 10:40:04.203729 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 10:40:04.203729 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 10:40:04.203729 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 10:40:04.203729 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:40:04.203729 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:40:04.203729 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:40:04.203729 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:40:04.203729 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:40:04.203729 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application with Lock( Jul 14 10:40:04.203729 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:40:04.203729 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:40:04.203729 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:40:04.203729 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:40:04.203729 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:40:04.203729 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:40:04.204970 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:40:04.204970 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:40:04.204970 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 10:40:04.204970 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 10:40:04.204970 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 10:40:04.204970 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 10:40:04.204970 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 10:40:04.204970 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 10:40:04.204970 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 14 10:40:04.204970 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application Jul 14 10:40:04.208559 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 312/622] 10.222.0.16 () {56 vars in 1093 bytes} [Thu Jul 14 10:40:03 2022] GET /identity/v3/users/nova => generated 82 bytes in 291 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:40:04.209945 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821ff9d6-b11f-43ed-b5e8-07127630a8f0 None None] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:04.210246 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821ff9d6-b11f-43ed-b5e8-07127630a8f0 None None] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:04.210532 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821ff9d6-b11f-43ed-b5e8-07127630a8f0 None None] PATH_INFO: `/` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:04.212079 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 313/623] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jul 14 10:40:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:40:04.212809 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821ff9d6-b11f-43ed-b5e8-07127630a8f0 None None] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:04.235407 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=100 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:04.287443 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c811d2-af38-43c1-9ce3-c94cb6867f1f None admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:04.330285 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab468a96-7129-4d08-9e03-030929fefe78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:04.331093 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab468a96-7129-4d08-9e03-030929fefe78 None admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:04.331626 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab468a96-7129-4d08-9e03-030929fefe78 None admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:04.331754 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab468a96-7129-4d08-9e03-030929fefe78 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:04.345061 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab468a96-7129-4d08-9e03-030929fefe78 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:04.346419 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab468a96-7129-4d08-9e03-030929fefe78 None admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:04.356601 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821ff9d6-b11f-43ed-b5e8-07127630a8f0 None None] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:04.369039 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=100 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:04.373253 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application [None req-ab468a96-7129-4d08-9e03-030929fefe78 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 10:40:04.373253 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:40:04.373253 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:40:04.373253 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:40:04.373253 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:40:04.373253 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:40:04.373253 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:40:04.373253 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:40:04.373253 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:40:04.373253 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:40:04.373253 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:40:04.373253 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:40:04.373253 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 10:40:04.373253 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 10:40:04.373253 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 10:40:04.374142 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 10:40:04.374142 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:40:04.374142 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:40:04.374142 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:40:04.374142 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:40:04.374142 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:40:04.374142 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:40:04.374142 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:40:04.374142 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application with Lock( Jul 14 10:40:04.374142 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:40:04.374142 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:40:04.374142 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:40:04.374142 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:40:04.374142 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:40:04.374142 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:40:04.374142 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:40:04.374142 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:40:04.375817 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 10:40:04.375817 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 10:40:04.375817 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 10:40:04.375817 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application Jul 14 10:40:04.383600 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 311/624] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Jul 14 10:40:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:40:04.383600 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a08a30-0e36-4614-a0ef-1d9f6b786acb None None] REQUEST_METHOD: `POST` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:04.383600 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a08a30-0e36-4614-a0ef-1d9f6b786acb None None] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:04.383600 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a08a30-0e36-4614-a0ef-1d9f6b786acb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:04.403427 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad41f003-e2c6-43b9-92ad-4d8cf35cd648 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:04.404162 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad41f003-e2c6-43b9-92ad-4d8cf35cd648 None admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:04.404454 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad41f003-e2c6-43b9-92ad-4d8cf35cd648 None admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:04.404733 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad41f003-e2c6-43b9-92ad-4d8cf35cd648 None admin] PATH_INFO: `/v3/users` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:04.405877 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad41f003-e2c6-43b9-92ad-4d8cf35cd648 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:40:04.406199 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad41f003-e2c6-43b9-92ad-4d8cf35cd648 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:04.406458 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.auth.core [None req-15a08a30-0e36-4614-a0ef-1d9f6b786acb None None] MFA Rules not processed for user `ae4bcdd8106d4bebbdcae96be33505bc`. Rule list: `[]` (Enabled: `True`). {{(pid=86655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:40:04.407745 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad41f003-e2c6-43b9-92ad-4d8cf35cd648 None admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:04.408159 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-15a08a30-0e36-4614-a0ef-1d9f6b786acb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:40:04.431273 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 314/625] 10.222.0.16 () {56 vars in 1133 bytes} [Thu Jul 14 10:40:04 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:40:04.432214 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad41f003-e2c6-43b9-92ad-4d8cf35cd648 None admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:04.495235 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 312/626] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jul 14 10:40:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 10:40:04.496113 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a08a30-0e36-4614-a0ef-1d9f6b786acb None None] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:04.545207 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=100 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:04.585539 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad41f003-e2c6-43b9-92ad-4d8cf35cd648 None admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:04.609207 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a08a30-0e36-4614-a0ef-1d9f6b786acb None None] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:04.633659 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a30dd3-aced-4200-9a74-0ca81dcda4bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:04.634742 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a30dd3-aced-4200-9a74-0ca81dcda4bb None admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:04.635036 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a30dd3-aced-4200-9a74-0ca81dcda4bb None admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:04.635315 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a30dd3-aced-4200-9a74-0ca81dcda4bb None admin] PATH_INFO: `/v3/domains` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:04.636313 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a30dd3-aced-4200-9a74-0ca81dcda4bb None admin] RBAC: Adding query filter params (name=Default) {{(pid=86656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:40:04.636646 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a30dd3-aced-4200-9a74-0ca81dcda4bb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:04.638922 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a30dd3-aced-4200-9a74-0ca81dcda4bb None admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:04.645707 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2ee13e-6ecd-4ecf-8f0e-d166e8334334 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:04.646488 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2ee13e-6ecd-4ecf-8f0e-d166e8334334 None admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:04.646943 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2ee13e-6ecd-4ecf-8f0e-d166e8334334 None admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:04.647327 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2ee13e-6ecd-4ecf-8f0e-d166e8334334 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:04.653132 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 315/627] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Jul 14 10:40:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:40:04.654050 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a30dd3-aced-4200-9a74-0ca81dcda4bb None admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:04.685152 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=100 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:04.721621 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2ee13e-6ecd-4ecf-8f0e-d166e8334334 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:04.723319 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2ee13e-6ecd-4ecf-8f0e-d166e8334334 None admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:04.761342 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a30dd3-aced-4200-9a74-0ca81dcda4bb None admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:04.773710 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=100 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:04.806337 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462819e2-025e-436a-95ac-8044c5cd2f8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:04.807149 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462819e2-025e-436a-95ac-8044c5cd2f8c None admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:04.807444 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462819e2-025e-436a-95ac-8044c5cd2f8c None admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:04.807721 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462819e2-025e-436a-95ac-8044c5cd2f8c None admin] PATH_INFO: `/v3/roles/service` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:04.819077 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462819e2-025e-436a-95ac-8044c5cd2f8c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 10:40:04.826788 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application [None req-462819e2-025e-436a-95ac-8044c5cd2f8c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 14 10:40:04.826788 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:40:04.826788 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:40:04.826788 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:40:04.826788 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:40:04.826788 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:40:04.826788 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:40:04.826788 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:40:04.826788 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:40:04.826788 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:40:04.826788 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:40:04.826788 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:40:04.826788 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 10:40:04.826788 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 10:40:04.826788 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 10:40:04.826788 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 10:40:04.828122 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 10:40:04.828122 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 10:40:04.828122 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 10:40:04.828122 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 10:40:04.828122 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:40:04.828122 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:40:04.828122 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:40:04.828122 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:40:04.828122 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:40:04.828122 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:40:04.828122 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:40:04.828122 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application with Lock( Jul 14 10:40:04.828122 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:40:04.828122 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:40:04.828122 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:40:04.828122 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:40:04.834126 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:40:04.834126 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:40:04.834126 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:40:04.834126 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:40:04.834126 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 10:40:04.834126 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 10:40:04.834126 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 10:40:04.834126 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 10:40:04.834126 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 10:40:04.834126 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 10:40:04.834126 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 14 10:40:04.834126 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application Jul 14 10:40:04.834126 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 316/628] 10.222.0.16 () {56 vars in 1102 bytes} [Thu Jul 14 10:40:04 2022] GET /identity/v3/roles/service => generated 85 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:40:04.834126 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462819e2-025e-436a-95ac-8044c5cd2f8c None admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:04.850187 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 313/629] 10.222.0.16 () {58 vars in 1282 bytes} [Thu Jul 14 10:40:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 10:40:04.851748 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a39b9b-0c82-4b43-9a47-57dd0901f3fd None None] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:04.852189 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a39b9b-0c82-4b43-9a47-57dd0901f3fd None None] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:04.852471 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a39b9b-0c82-4b43-9a47-57dd0901f3fd None None] PATH_INFO: `/` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:04.853926 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 314/630] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jul 14 10:40:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:40:04.854469 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a39b9b-0c82-4b43-9a47-57dd0901f3fd None None] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:04.928229 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=100 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:04.941692 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462819e2-025e-436a-95ac-8044c5cd2f8c None admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:04.973807 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a39b9b-0c82-4b43-9a47-57dd0901f3fd None None] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:04.975588 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b31ee2-57c7-4e10-a994-6bf64f8b2d35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:04.976395 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b31ee2-57c7-4e10-a994-6bf64f8b2d35 None admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:04.976679 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b31ee2-57c7-4e10-a994-6bf64f8b2d35 None admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:04.976993 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b31ee2-57c7-4e10-a994-6bf64f8b2d35 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:04.984689 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b31ee2-57c7-4e10-a994-6bf64f8b2d35 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:04.986197 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b31ee2-57c7-4e10-a994-6bf64f8b2d35 None admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:05.000887 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application [None req-95b31ee2-57c7-4e10-a994-6bf64f8b2d35 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 10:40:05.000887 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:40:05.000887 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:40:05.000887 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:40:05.000887 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:40:05.000887 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:40:05.000887 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:40:05.000887 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:40:05.000887 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:40:05.000887 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:40:05.000887 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:40:05.000887 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:40:05.000887 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 10:40:05.000887 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 10:40:05.000887 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 10:40:05.001797 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 10:40:05.001797 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:40:05.001797 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:40:05.001797 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:40:05.001797 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:40:05.001797 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:40:05.001797 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:40:05.001797 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:40:05.001797 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application with Lock( Jul 14 10:40:05.001797 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:40:05.001797 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:40:05.001797 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:40:05.001797 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:40:05.001797 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:40:05.001797 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:40:05.001797 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:40:05.001797 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:40:05.002716 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 10:40:05.002716 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 10:40:05.002716 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 10:40:05.002716 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 10:40:05.002716 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 10:40:05.002716 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 10:40:05.002716 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 10:40:05.002716 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application Jul 14 10:40:05.002716 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 317/631] 10.222.0.16 () {56 vars in 1111 bytes} [Thu Jul 14 10:40:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:40:05.003220 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b31ee2-57c7-4e10-a994-6bf64f8b2d35 None admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:05.016094 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286e10a3-7936-4b2d-8de4-dc04529a5027 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:05.016807 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286e10a3-7936-4b2d-8de4-dc04529a5027 None admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:05.017099 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286e10a3-7936-4b2d-8de4-dc04529a5027 None admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:05.017429 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286e10a3-7936-4b2d-8de4-dc04529a5027 None admin] PATH_INFO: `/v3/roles` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:05.018212 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286e10a3-7936-4b2d-8de4-dc04529a5027 None admin] RBAC: Adding query filter params (name=service) {{(pid=86655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:40:05.018517 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286e10a3-7936-4b2d-8de4-dc04529a5027 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:05.019901 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286e10a3-7936-4b2d-8de4-dc04529a5027 None admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:05.028123 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 315/632] 10.222.0.16 () {56 vars in 1103 bytes} [Thu Jul 14 10:40:04 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:40:05.029370 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967b1ac4-d414-42db-8ad2-0ec9e8fba2f3 None None] REQUEST_METHOD: `POST` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:05.029665 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967b1ac4-d414-42db-8ad2-0ec9e8fba2f3 None None] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:05.029949 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967b1ac4-d414-42db-8ad2-0ec9e8fba2f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:05.035498 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=100 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:05.049706 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.auth.core [None req-967b1ac4-d414-42db-8ad2-0ec9e8fba2f3 None None] MFA Rules not processed for user `ae4bcdd8106d4bebbdcae96be33505bc`. Rule list: `[]` (Enabled: `True`). {{(pid=86655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:40:05.050927 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-967b1ac4-d414-42db-8ad2-0ec9e8fba2f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:40:05.114136 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b31ee2-57c7-4e10-a994-6bf64f8b2d35 None admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:05.132804 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 316/633] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jul 14 10:40:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 10:40:05.132804 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967b1ac4-d414-42db-8ad2-0ec9e8fba2f3 None None] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:05.165364 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fc3004-172c-4234-b5cb-88b021ac2e27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:05.166165 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fc3004-172c-4234-b5cb-88b021ac2e27 None admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:05.166455 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fc3004-172c-4234-b5cb-88b021ac2e27 None admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:05.166737 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fc3004-172c-4234-b5cb-88b021ac2e27 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:05.177404 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72fc3004-172c-4234-b5cb-88b021ac2e27 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:05.178925 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72fc3004-172c-4234-b5cb-88b021ac2e27 None admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:05.188196 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=100 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:05.198145 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application [None req-72fc3004-172c-4234-b5cb-88b021ac2e27 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 10:40:05.198145 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:40:05.198145 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:40:05.198145 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:40:05.198145 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:40:05.198145 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:40:05.198145 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:40:05.198145 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:40:05.198145 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:40:05.198145 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:40:05.198145 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:40:05.198145 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:40:05.198145 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 10:40:05.198145 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 10:40:05.198145 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 10:40:05.199207 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 10:40:05.199207 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:40:05.199207 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:40:05.199207 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:40:05.199207 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:40:05.199207 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:40:05.199207 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:40:05.199207 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:40:05.199207 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application with Lock( Jul 14 10:40:05.199207 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:40:05.199207 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:40:05.199207 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:40:05.199207 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:40:05.199207 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:40:05.199207 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:40:05.199207 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:40:05.199207 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:40:05.200261 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 10:40:05.200261 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 10:40:05.200261 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 10:40:05.200261 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application Jul 14 10:40:05.202126 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 318/634] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Jul 14 10:40:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:40:05.203551 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fc3004-172c-4234-b5cb-88b021ac2e27 None admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:05.251020 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967b1ac4-d414-42db-8ad2-0ec9e8fba2f3 None None] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:05.279715 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=100 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:05.285749 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd77a1b-13de-4f5c-9234-63784c888b32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:05.286416 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd77a1b-13de-4f5c-9234-63784c888b32 None admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:05.286702 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd77a1b-13de-4f5c-9234-63784c888b32 None admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:05.286981 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd77a1b-13de-4f5c-9234-63784c888b32 None admin] PATH_INFO: `/v3/projects` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:05.287777 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd77a1b-13de-4f5c-9234-63784c888b32 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:40:05.288298 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd77a1b-13de-4f5c-9234-63784c888b32 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:05.289565 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd77a1b-13de-4f5c-9234-63784c888b32 None admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:05.301203 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 317/635] 10.222.0.16 () {56 vars in 1148 bytes} [Thu Jul 14 10:40:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:40:05.301986 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd77a1b-13de-4f5c-9234-63784c888b32 None admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:05.303727 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fc3004-172c-4234-b5cb-88b021ac2e27 None admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:05.338597 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3236101-0ef0-4389-a40e-57cc4f433494 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:05.339388 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3236101-0ef0-4389-a40e-57cc4f433494 None admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:05.339675 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3236101-0ef0-4389-a40e-57cc4f433494 None admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:05.339951 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3236101-0ef0-4389-a40e-57cc4f433494 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:05.350464 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3236101-0ef0-4389-a40e-57cc4f433494 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:05.351913 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3236101-0ef0-4389-a40e-57cc4f433494 None admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:05.369043 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application [None req-a3236101-0ef0-4389-a40e-57cc4f433494 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 10:40:05.369043 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:40:05.369043 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:40:05.369043 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:40:05.369043 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:40:05.369043 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:40:05.369043 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:40:05.369043 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:40:05.369043 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:40:05.369043 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:40:05.369043 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:40:05.369043 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:40:05.369043 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 10:40:05.369043 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 10:40:05.369043 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 10:40:05.370053 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 10:40:05.370053 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:40:05.370053 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:40:05.370053 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:40:05.370053 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:40:05.370053 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:40:05.370053 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:40:05.370053 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:40:05.370053 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application with Lock( Jul 14 10:40:05.370053 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:40:05.370053 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:40:05.370053 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:40:05.370053 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:40:05.370053 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:40:05.370053 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:40:05.370053 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:40:05.370053 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:40:05.370944 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 10:40:05.370944 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 10:40:05.370944 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 10:40:05.370944 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application Jul 14 10:40:05.370944 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 319/636] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Jul 14 10:40:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:40:05.371230 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3236101-0ef0-4389-a40e-57cc4f433494 None admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:05.407341 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd77a1b-13de-4f5c-9234-63784c888b32 None admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:05.424114 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=100 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:05.441712 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8dea5d-92ea-4d5c-a175-8b87de5555ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:05.442437 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8dea5d-92ea-4d5c-a175-8b87de5555ba None admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:05.442721 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8dea5d-92ea-4d5c-a175-8b87de5555ba None admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:05.442994 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8dea5d-92ea-4d5c-a175-8b87de5555ba None admin] PATH_INFO: `/v3/roles/service` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:05.452900 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8dea5d-92ea-4d5c-a175-8b87de5555ba None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 10:40:05.460615 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application [None req-de8dea5d-92ea-4d5c-a175-8b87de5555ba None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 14 10:40:05.460615 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:40:05.460615 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:40:05.460615 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:40:05.460615 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:40:05.460615 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:40:05.460615 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:40:05.460615 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:40:05.460615 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:40:05.460615 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:40:05.460615 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:40:05.460615 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:40:05.460615 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 10:40:05.460615 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 10:40:05.460615 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 10:40:05.460615 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 10:40:05.461560 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 10:40:05.461560 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 10:40:05.461560 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 10:40:05.461560 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 10:40:05.461560 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:40:05.461560 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:40:05.461560 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:40:05.461560 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:40:05.461560 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:40:05.461560 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:40:05.461560 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:40:05.461560 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application with Lock( Jul 14 10:40:05.461560 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:40:05.461560 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:40:05.461560 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:40:05.461560 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:40:05.462433 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:40:05.462433 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:40:05.462433 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:40:05.462433 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:40:05.462433 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 10:40:05.462433 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 10:40:05.462433 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 10:40:05.462433 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 10:40:05.462433 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 10:40:05.462433 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 10:40:05.462433 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 14 10:40:05.462433 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application Jul 14 10:40:05.465056 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 318/637] 10.222.0.16 () {56 vars in 1102 bytes} [Thu Jul 14 10:40:05 2022] GET /identity/v3/roles/service => generated 85 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:40:05.466190 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874ee50f-c727-4774-84e8-98f590b61722 None None] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:05.466500 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874ee50f-c727-4774-84e8-98f590b61722 None None] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:05.466759 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874ee50f-c727-4774-84e8-98f590b61722 None None] PATH_INFO: `/` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:05.468027 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 319/638] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jul 14 10:40:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:40:05.469225 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874ee50f-c727-4774-84e8-98f590b61722 None None] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:05.472088 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3236101-0ef0-4389-a40e-57cc4f433494 None admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:05.506342 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b155c795-0d2e-42e4-9358-7983d8c2051f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:05.507006 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b155c795-0d2e-42e4-9358-7983d8c2051f None admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:05.507291 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b155c795-0d2e-42e4-9358-7983d8c2051f None admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:05.507572 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b155c795-0d2e-42e4-9358-7983d8c2051f None admin] PATH_INFO: `/v3/domains` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:05.508297 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b155c795-0d2e-42e4-9358-7983d8c2051f None admin] RBAC: Adding query filter params (name=Default) {{(pid=86656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:40:05.508609 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b155c795-0d2e-42e4-9358-7983d8c2051f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:05.510011 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b155c795-0d2e-42e4-9358-7983d8c2051f None admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:05.521726 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 320/639] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Jul 14 10:40:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:40:05.522511 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b155c795-0d2e-42e4-9358-7983d8c2051f None admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:05.529303 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=100 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:05.580038 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874ee50f-c727-4774-84e8-98f590b61722 None None] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:05.613883 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3b5745-6023-4f76-bbca-6cd2b54e0f35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:05.614776 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3b5745-6023-4f76-bbca-6cd2b54e0f35 None admin] REQUEST_METHOD: `PUT` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:05.615067 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3b5745-6023-4f76-bbca-6cd2b54e0f35 None admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:05.615346 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3b5745-6023-4f76-bbca-6cd2b54e0f35 None admin] PATH_INFO: `/v3/projects/59391272ecbe48b0aa736cb43807be1d/users/8a23de49b80643eaab7a212f2884d62e/roles/d58911e96aad48cf9ca61ac5df79e21d` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:05.618105 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b155c795-0d2e-42e4-9358-7983d8c2051f None admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:05.631205 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3b5745-6023-4f76-bbca-6cd2b54e0f35 None admin] RBAC: Authorizing `identity:create_grant(project_id=59391272ecbe48b0aa736cb43807be1d, user_id=8a23de49b80643eaab7a212f2884d62e, role_id=d58911e96aad48cf9ca61ac5df79e21d)` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:05.631641 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=100 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:05.632679 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3b5745-6023-4f76-bbca-6cd2b54e0f35 None admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:05.645819 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 320/640] 10.222.0.16 () {58 vars in 1439 bytes} [Thu Jul 14 10:40:05 2022] PUT /identity/v3/projects/59391272ecbe48b0aa736cb43807be1d/users/8a23de49b80643eaab7a212f2884d62e/roles/d58911e96aad48cf9ca61ac5df79e21d => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:40:05.646605 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3b5745-6023-4f76-bbca-6cd2b54e0f35 None admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:05.664051 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decc8b04-5c8d-4120-82a6-77d7685f96b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:05.665165 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decc8b04-5c8d-4120-82a6-77d7685f96b7 None admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:05.665617 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decc8b04-5c8d-4120-82a6-77d7685f96b7 None admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:05.665906 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decc8b04-5c8d-4120-82a6-77d7685f96b7 None admin] PATH_INFO: `/v3/domains` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:05.666662 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-decc8b04-5c8d-4120-82a6-77d7685f96b7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:40:05.667315 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-decc8b04-5c8d-4120-82a6-77d7685f96b7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:05.668523 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-decc8b04-5c8d-4120-82a6-77d7685f96b7 None admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:05.682201 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 321/641] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Jul 14 10:40:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:40:05.683673 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdcec43-1dbd-4039-951d-6cc5acf7ea0d None None] REQUEST_METHOD: `POST` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:05.684282 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdcec43-1dbd-4039-951d-6cc5acf7ea0d None None] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:05.684758 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdcec43-1dbd-4039-951d-6cc5acf7ea0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:05.704692 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.auth.core [None req-ebdcec43-1dbd-4039-951d-6cc5acf7ea0d None None] MFA Rules not processed for user `ae4bcdd8106d4bebbdcae96be33505bc`. Rule list: `[]` (Enabled: `True`). {{(pid=86656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:40:05.705894 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-ebdcec43-1dbd-4039-951d-6cc5acf7ea0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:40:05.773320 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3b5745-6023-4f76-bbca-6cd2b54e0f35 None admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:05.775223 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:05.788922 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 322/642] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jul 14 10:40:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 10:40:05.790122 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebdcec43-1dbd-4039-951d-6cc5acf7ea0d None None] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:05.830989 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f597cec-1786-4df4-af96-476fc7021f04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:05.831806 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f597cec-1786-4df4-af96-476fc7021f04 None admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:05.832088 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f597cec-1786-4df4-af96-476fc7021f04 None admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:05.832365 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f597cec-1786-4df4-af96-476fc7021f04 None admin] PATH_INFO: `/v3/roles` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:05.833236 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f597cec-1786-4df4-af96-476fc7021f04 None admin] RBAC: Adding query filter params (name=service) {{(pid=86655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:40:05.833546 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f597cec-1786-4df4-af96-476fc7021f04 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:05.834915 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f597cec-1786-4df4-af96-476fc7021f04 None admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:05.844473 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 321/643] 10.222.0.16 () {56 vars in 1103 bytes} [Thu Jul 14 10:40:05 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:40:05.845243 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f597cec-1786-4df4-af96-476fc7021f04 None admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:05.902770 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebdcec43-1dbd-4039-951d-6cc5acf7ea0d None None] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:05.904364 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=100 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:05.939688 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d302dd47-6b14-48f9-9364-f6f3bf06d574 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:05.940587 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d302dd47-6b14-48f9-9364-f6f3bf06d574 None admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:05.940908 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d302dd47-6b14-48f9-9364-f6f3bf06d574 None admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:05.941185 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d302dd47-6b14-48f9-9364-f6f3bf06d574 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:05.948401 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d302dd47-6b14-48f9-9364-f6f3bf06d574 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:05.949883 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d302dd47-6b14-48f9-9364-f6f3bf06d574 None admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:05.960408 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f597cec-1786-4df4-af96-476fc7021f04 None admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:05.963806 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application [None req-d302dd47-6b14-48f9-9364-f6f3bf06d574 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 10:40:05.963806 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:40:05.963806 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:40:05.963806 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:40:05.963806 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:40:05.963806 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:40:05.963806 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:40:05.963806 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:40:05.963806 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:40:05.963806 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:40:05.963806 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:40:05.963806 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:40:05.963806 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 10:40:05.963806 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 10:40:05.963806 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 10:40:05.964722 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 10:40:05.964722 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:40:05.964722 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:40:05.964722 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:40:05.964722 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:40:05.964722 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:40:05.964722 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:40:05.964722 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:40:05.964722 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application with Lock( Jul 14 10:40:05.964722 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:40:05.964722 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:40:05.964722 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:40:05.964722 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:40:05.964722 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:40:05.964722 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:40:05.964722 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:40:05.964722 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:40:05.965638 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 10:40:05.965638 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 10:40:05.965638 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 10:40:05.965638 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 10:40:05.965638 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 10:40:05.965638 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 10:40:05.965638 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 10:40:05.965638 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application Jul 14 10:40:05.969612 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 323/644] 10.222.0.16 () {56 vars in 1111 bytes} [Thu Jul 14 10:40:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:40:05.970539 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d302dd47-6b14-48f9-9364-f6f3bf06d574 None admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:06.002819 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a103b43d-8c06-4f3f-af61-424a0571555d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:06.003662 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a103b43d-8c06-4f3f-af61-424a0571555d None admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:06.003957 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a103b43d-8c06-4f3f-af61-424a0571555d None admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:06.004243 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a103b43d-8c06-4f3f-af61-424a0571555d None admin] PATH_INFO: `/v3/users/neutron` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:06.012364 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a103b43d-8c06-4f3f-af61-424a0571555d None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:06.013851 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a103b43d-8c06-4f3f-af61-424a0571555d None admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:06.029280 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application [None req-a103b43d-8c06-4f3f-af61-424a0571555d None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 14 10:40:06.029280 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:40:06.029280 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:40:06.029280 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:40:06.029280 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:40:06.029280 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:40:06.029280 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:40:06.029280 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:40:06.029280 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:40:06.029280 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:40:06.029280 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:40:06.029280 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:40:06.029280 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 10:40:06.029280 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 10:40:06.029280 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 10:40:06.029280 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 10:40:06.030207 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:40:06.030207 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:40:06.030207 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 10:40:06.030207 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 10:40:06.030207 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 10:40:06.030207 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 10:40:06.030207 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:40:06.030207 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:40:06.030207 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:40:06.030207 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:40:06.030207 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:40:06.030207 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application with Lock( Jul 14 10:40:06.030207 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:40:06.030207 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:40:06.030207 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:40:06.030207 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:40:06.030207 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:40:06.030207 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:40:06.031264 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:40:06.031264 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:40:06.031264 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 10:40:06.031264 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 10:40:06.031264 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 10:40:06.031264 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 10:40:06.031264 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 10:40:06.031264 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 10:40:06.031264 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 14 10:40:06.031264 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application Jul 14 10:40:06.031264 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 322/645] 10.222.0.16 () {56 vars in 1102 bytes} [Thu Jul 14 10:40:05 2022] GET /identity/v3/users/neutron => generated 85 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:40:06.031961 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a103b43d-8c06-4f3f-af61-424a0571555d None admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:06.063357 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=100 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:06.082725 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d302dd47-6b14-48f9-9364-f6f3bf06d574 None admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:06.117278 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8668c2ed-fa32-43a4-a611-1b4866783f9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:06.118079 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8668c2ed-fa32-43a4-a611-1b4866783f9c None admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:06.118361 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8668c2ed-fa32-43a4-a611-1b4866783f9c None admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:06.118635 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8668c2ed-fa32-43a4-a611-1b4866783f9c None admin] PATH_INFO: `/v3/roles/service` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:06.131679 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8668c2ed-fa32-43a4-a611-1b4866783f9c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 10:40:06.139419 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application [None req-8668c2ed-fa32-43a4-a611-1b4866783f9c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 14 10:40:06.139419 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:40:06.139419 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:40:06.139419 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:40:06.139419 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:40:06.139419 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:40:06.139419 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:40:06.139419 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:40:06.139419 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:40:06.139419 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:40:06.139419 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:40:06.139419 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:40:06.139419 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 10:40:06.139419 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 10:40:06.139419 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 10:40:06.139419 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 10:40:06.140923 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 10:40:06.140923 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 10:40:06.140923 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 10:40:06.140923 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 10:40:06.140923 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:40:06.140923 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:40:06.140923 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:40:06.140923 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:40:06.140923 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:40:06.140923 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:40:06.140923 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:40:06.140923 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application with Lock( Jul 14 10:40:06.140923 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:40:06.140923 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:40:06.140923 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:40:06.140923 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:40:06.141944 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:40:06.141944 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:40:06.141944 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:40:06.141944 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:40:06.141944 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 10:40:06.141944 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 10:40:06.141944 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 10:40:06.141944 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 10:40:06.141944 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 10:40:06.141944 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 10:40:06.141944 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 14 10:40:06.141944 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application Jul 14 10:40:06.146114 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 324/646] 10.222.0.16 () {56 vars in 1102 bytes} [Thu Jul 14 10:40:05 2022] GET /identity/v3/roles/service => generated 85 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:40:06.146606 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8668c2ed-fa32-43a4-a611-1b4866783f9c None admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:06.152191 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a103b43d-8c06-4f3f-af61-424a0571555d None admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:06.171340 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=100 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:06.191627 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8028a5aa-a286-48c7-b023-d12748a07699 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:06.192741 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8028a5aa-a286-48c7-b023-d12748a07699 None admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:06.193059 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8028a5aa-a286-48c7-b023-d12748a07699 None admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:06.193615 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8028a5aa-a286-48c7-b023-d12748a07699 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:06.207808 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8028a5aa-a286-48c7-b023-d12748a07699 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:06.209709 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8028a5aa-a286-48c7-b023-d12748a07699 None admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:06.229551 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application [None req-8028a5aa-a286-48c7-b023-d12748a07699 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 10:40:06.229551 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:40:06.229551 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:40:06.229551 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:40:06.229551 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:40:06.229551 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:40:06.229551 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:40:06.229551 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:40:06.229551 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:40:06.229551 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:40:06.229551 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:40:06.229551 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:40:06.229551 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 10:40:06.229551 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 10:40:06.229551 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 10:40:06.230496 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 10:40:06.230496 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:40:06.230496 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:40:06.230496 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:40:06.230496 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:40:06.230496 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:40:06.230496 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:40:06.230496 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:40:06.230496 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application with Lock( Jul 14 10:40:06.230496 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:40:06.230496 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:40:06.230496 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:40:06.230496 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:40:06.230496 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:40:06.230496 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:40:06.230496 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:40:06.230496 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:40:06.231399 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 10:40:06.231399 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 10:40:06.231399 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 10:40:06.231399 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application Jul 14 10:40:06.231399 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 323/647] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Jul 14 10:40:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:40:06.231678 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8028a5aa-a286-48c7-b023-d12748a07699 None admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:06.254917 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8668c2ed-fa32-43a4-a611-1b4866783f9c None admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:06.289415 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ace92f4-7019-4643-9d3c-1f977562951c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:06.290105 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ace92f4-7019-4643-9d3c-1f977562951c None admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:06.290387 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ace92f4-7019-4643-9d3c-1f977562951c None admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:06.290663 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ace92f4-7019-4643-9d3c-1f977562951c None admin] PATH_INFO: `/v3/projects` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:06.291445 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ace92f4-7019-4643-9d3c-1f977562951c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:40:06.291756 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ace92f4-7019-4643-9d3c-1f977562951c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:06.293295 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ace92f4-7019-4643-9d3c-1f977562951c None admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:06.305782 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 325/648] 10.222.0.16 () {56 vars in 1148 bytes} [Thu Jul 14 10:40:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:40:06.311700 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ace92f4-7019-4643-9d3c-1f977562951c None admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:06.313899 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=100 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:06.338075 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8028a5aa-a286-48c7-b023-d12748a07699 None admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:06.374283 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c54c34-f698-46ac-8c59-ed6d195a4413 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:06.375636 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c54c34-f698-46ac-8c59-ed6d195a4413 None admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:06.375923 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c54c34-f698-46ac-8c59-ed6d195a4413 None admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:06.376501 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c54c34-f698-46ac-8c59-ed6d195a4413 None admin] PATH_INFO: `/v3/users` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:06.377385 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c54c34-f698-46ac-8c59-ed6d195a4413 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=86655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:40:06.377693 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c54c34-f698-46ac-8c59-ed6d195a4413 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:06.379115 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c54c34-f698-46ac-8c59-ed6d195a4413 None admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:06.400950 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 324/649] 10.222.0.16 () {56 vars in 1139 bytes} [Thu Jul 14 10:40:06 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:40:06.401946 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c54c34-f698-46ac-8c59-ed6d195a4413 None admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:06.408006 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=100 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:06.428003 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ace92f4-7019-4643-9d3c-1f977562951c None admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:06.464637 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66fe71b-b24a-4a87-a5a5-2c696bd85777 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:06.465542 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66fe71b-b24a-4a87-a5a5-2c696bd85777 None admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:06.465965 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66fe71b-b24a-4a87-a5a5-2c696bd85777 None admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:06.466413 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66fe71b-b24a-4a87-a5a5-2c696bd85777 None admin] PATH_INFO: `/v3/roles` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:06.467301 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66fe71b-b24a-4a87-a5a5-2c696bd85777 None admin] RBAC: Adding query filter params (name=service) {{(pid=86656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:40:06.467756 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66fe71b-b24a-4a87-a5a5-2c696bd85777 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:06.469573 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66fe71b-b24a-4a87-a5a5-2c696bd85777 None admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:06.478088 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 326/650] 10.222.0.16 () {56 vars in 1103 bytes} [Thu Jul 14 10:40:06 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:40:06.479147 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66fe71b-b24a-4a87-a5a5-2c696bd85777 None admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:06.509273 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c54c34-f698-46ac-8c59-ed6d195a4413 None admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:06.545209 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ace4fb6-dc98-4c9d-9578-50142c3811cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:06.545875 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ace4fb6-dc98-4c9d-9578-50142c3811cd None admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:06.546162 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ace4fb6-dc98-4c9d-9578-50142c3811cd None admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:06.547110 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ace4fb6-dc98-4c9d-9578-50142c3811cd None admin] PATH_INFO: `/v3/domains` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:06.548049 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ace4fb6-dc98-4c9d-9578-50142c3811cd None admin] RBAC: Adding query filter params (name=Default) {{(pid=86655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:40:06.548362 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ace4fb6-dc98-4c9d-9578-50142c3811cd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:06.549767 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ace4fb6-dc98-4c9d-9578-50142c3811cd None admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:06.551467 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=100 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:06.567367 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 325/651] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Jul 14 10:40:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:40:06.567367 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ace4fb6-dc98-4c9d-9578-50142c3811cd None admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:06.593647 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66fe71b-b24a-4a87-a5a5-2c696bd85777 None admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:06.632493 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37dcfb9-bd2c-4d92-8c96-292c09cb0e86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:06.633301 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37dcfb9-bd2c-4d92-8c96-292c09cb0e86 None admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:06.633488 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37dcfb9-bd2c-4d92-8c96-292c09cb0e86 None admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:06.633753 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37dcfb9-bd2c-4d92-8c96-292c09cb0e86 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:06.634583 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37dcfb9-bd2c-4d92-8c96-292c09cb0e86 None admin] RBAC: Adding query filter params (role.id=d58911e96aad48cf9ca61ac5df79e21d, scope.project.id=59391272ecbe48b0aa736cb43807be1d, user.id=26aa294c913c408499a913ec25bb677d) {{(pid=86656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:40:06.634897 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37dcfb9-bd2c-4d92-8c96-292c09cb0e86 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:06.636325 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37dcfb9-bd2c-4d92-8c96-292c09cb0e86 None admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:06.652957 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 327/652] 10.222.0.16 () {56 vars in 1374 bytes} [Thu Jul 14 10:40:06 2022] GET /identity/v3/role_assignments?user.id=26aa294c913c408499a913ec25bb677d&scope.project.id=59391272ecbe48b0aa736cb43807be1d&role.id=d58911e96aad48cf9ca61ac5df79e21d => generated 608 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:40:06.652957 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37dcfb9-bd2c-4d92-8c96-292c09cb0e86 None admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:06.665477 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=100 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:06.688822 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ace4fb6-dc98-4c9d-9578-50142c3811cd None admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:06.741525 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31db43e7-e5df-446a-819f-2b4a11d17e9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:06.743587 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31db43e7-e5df-446a-819f-2b4a11d17e9c None admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:06.744092 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31db43e7-e5df-446a-819f-2b4a11d17e9c None admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:06.744583 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31db43e7-e5df-446a-819f-2b4a11d17e9c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:06.778759 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37dcfb9-bd2c-4d92-8c96-292c09cb0e86 None admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:06.823852 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1a7cbd-e27f-41df-a6b3-90050fd398fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:06.827703 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1a7cbd-e27f-41df-a6b3-90050fd398fa None admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:06.827703 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1a7cbd-e27f-41df-a6b3-90050fd398fa None admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:06.827703 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1a7cbd-e27f-41df-a6b3-90050fd398fa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:06.838577 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1a7cbd-e27f-41df-a6b3-90050fd398fa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:06.840235 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1a7cbd-e27f-41df-a6b3-90050fd398fa None admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:06.841245 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=100 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:06.850496 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31db43e7-e5df-446a-819f-2b4a11d17e9c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:06.851968 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31db43e7-e5df-446a-819f-2b4a11d17e9c None admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:06.862132 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application [None req-fd1a7cbd-e27f-41df-a6b3-90050fd398fa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 10:40:06.862132 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:40:06.862132 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:40:06.862132 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:40:06.862132 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:40:06.862132 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:40:06.862132 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:40:06.862132 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:40:06.862132 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:40:06.862132 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:40:06.862132 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:40:06.862132 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:40:06.862132 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 10:40:06.862132 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 10:40:06.862132 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 10:40:06.863097 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 10:40:06.863097 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:40:06.863097 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:40:06.863097 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:40:06.863097 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:40:06.863097 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:40:06.863097 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:40:06.863097 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:40:06.863097 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application with Lock( Jul 14 10:40:06.863097 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:40:06.863097 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:40:06.863097 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:40:06.863097 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:40:06.863097 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:40:06.863097 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:40:06.863097 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:40:06.863097 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:40:06.863994 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 10:40:06.863994 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 10:40:06.863994 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 10:40:06.863994 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application Jul 14 10:40:06.863994 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 328/653] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Jul 14 10:40:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:40:06.864279 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1a7cbd-e27f-41df-a6b3-90050fd398fa None admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:06.942616 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=100 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:06.983768 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 326/654] 10.222.0.16 () {58 vars in 1282 bytes} [Thu Jul 14 10:40:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 420 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 10:40:06.985079 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31db43e7-e5df-446a-819f-2b4a11d17e9c None admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:06.987271 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1a7cbd-e27f-41df-a6b3-90050fd398fa None admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:07.023575 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2f50dd-473b-4d7b-8412-59dbb292dd6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:07.024548 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2f50dd-473b-4d7b-8412-59dbb292dd6e None admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:07.024988 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2f50dd-473b-4d7b-8412-59dbb292dd6e None admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:07.025369 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2f50dd-473b-4d7b-8412-59dbb292dd6e None admin] PATH_INFO: `/v3/users/cinder` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:07.039082 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2f50dd-473b-4d7b-8412-59dbb292dd6e None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:07.041052 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2f50dd-473b-4d7b-8412-59dbb292dd6e None admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:07.059631 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application [None req-4a2f50dd-473b-4d7b-8412-59dbb292dd6e None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 14 10:40:07.059631 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:40:07.059631 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:40:07.059631 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:40:07.059631 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:40:07.059631 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:40:07.059631 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:40:07.059631 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:40:07.059631 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:40:07.059631 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:40:07.059631 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:40:07.059631 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:40:07.059631 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 10:40:07.059631 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 10:40:07.059631 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 10:40:07.059631 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 10:40:07.060649 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:40:07.060649 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:40:07.060649 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 10:40:07.060649 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 10:40:07.060649 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 10:40:07.060649 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 10:40:07.060649 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:40:07.060649 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:40:07.060649 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:40:07.060649 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:40:07.060649 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:40:07.060649 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application with Lock( Jul 14 10:40:07.060649 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:40:07.060649 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:40:07.060649 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:40:07.060649 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:40:07.060649 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:40:07.060649 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:40:07.062370 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:40:07.062370 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:40:07.062370 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 10:40:07.062370 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 10:40:07.062370 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 10:40:07.062370 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 10:40:07.062370 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 10:40:07.062370 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 10:40:07.062370 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 14 10:40:07.062370 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application Jul 14 10:40:07.063304 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 329/655] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Jul 14 10:40:06 2022] GET /identity/v3/users/cinder => generated 84 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:40:07.064410 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2f50dd-473b-4d7b-8412-59dbb292dd6e None admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:07.092563 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=100 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:07.105197 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31db43e7-e5df-446a-819f-2b4a11d17e9c None admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:07.142098 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2daa6d60-4ceb-4b86-871e-5f43eb93ae8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:07.142771 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2daa6d60-4ceb-4b86-871e-5f43eb93ae8c None admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:07.143052 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2daa6d60-4ceb-4b86-871e-5f43eb93ae8c None admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:07.143331 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2daa6d60-4ceb-4b86-871e-5f43eb93ae8c None admin] PATH_INFO: `/v3/domains` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:07.144059 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2daa6d60-4ceb-4b86-871e-5f43eb93ae8c None admin] RBAC: Adding query filter params (name=Default) {{(pid=86655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:40:07.144364 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2daa6d60-4ceb-4b86-871e-5f43eb93ae8c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:07.145764 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2daa6d60-4ceb-4b86-871e-5f43eb93ae8c None admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:07.157885 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 327/656] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Jul 14 10:40:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:40:07.158791 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2daa6d60-4ceb-4b86-871e-5f43eb93ae8c None admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:07.191461 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2f50dd-473b-4d7b-8412-59dbb292dd6e None admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:07.212993 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=100 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:07.230263 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d87732-3b30-437e-a0a9-2dee98527e72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:07.231440 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d87732-3b30-437e-a0a9-2dee98527e72 None admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:07.231934 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d87732-3b30-437e-a0a9-2dee98527e72 None admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:07.232416 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d87732-3b30-437e-a0a9-2dee98527e72 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:07.244910 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d87732-3b30-437e-a0a9-2dee98527e72 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:07.246943 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d87732-3b30-437e-a0a9-2dee98527e72 None admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:07.263823 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2daa6d60-4ceb-4b86-871e-5f43eb93ae8c None admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:07.266645 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application [None req-c4d87732-3b30-437e-a0a9-2dee98527e72 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 10:40:07.266645 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:40:07.266645 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:40:07.266645 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:40:07.266645 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:40:07.266645 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:40:07.266645 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:40:07.266645 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:40:07.266645 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:40:07.266645 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:40:07.266645 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:40:07.266645 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:40:07.266645 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 10:40:07.266645 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 10:40:07.266645 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 10:40:07.267541 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 10:40:07.267541 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:40:07.267541 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:40:07.267541 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:40:07.267541 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:40:07.267541 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:40:07.267541 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:40:07.267541 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:40:07.267541 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application with Lock( Jul 14 10:40:07.267541 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:40:07.267541 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:40:07.267541 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:40:07.267541 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:40:07.267541 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:40:07.267541 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:40:07.267541 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:40:07.267541 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:40:07.268432 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 10:40:07.268432 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 10:40:07.268432 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 10:40:07.268432 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application Jul 14 10:40:07.270731 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 330/657] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Jul 14 10:40:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:40:07.271749 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d87732-3b30-437e-a0a9-2dee98527e72 None admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:07.304724 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8ca822-537b-44b3-b23a-6dac109637f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:07.305416 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8ca822-537b-44b3-b23a-6dac109637f6 None admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:07.305702 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8ca822-537b-44b3-b23a-6dac109637f6 None admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:07.305981 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8ca822-537b-44b3-b23a-6dac109637f6 None admin] PATH_INFO: `/v3/users` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:07.306832 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8ca822-537b-44b3-b23a-6dac109637f6 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=86655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:40:07.307140 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8ca822-537b-44b3-b23a-6dac109637f6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:07.308567 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8ca822-537b-44b3-b23a-6dac109637f6 None admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:07.332674 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 328/658] 10.222.0.16 () {56 vars in 1137 bytes} [Thu Jul 14 10:40:07 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:40:07.333595 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8ca822-537b-44b3-b23a-6dac109637f6 None admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:07.348626 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=100 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:07.387844 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d87732-3b30-437e-a0a9-2dee98527e72 None admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:07.428939 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5f0a3f-a19a-4bbd-ad2a-4f3d1fe4d4f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:07.430107 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5f0a3f-a19a-4bbd-ad2a-4f3d1fe4d4f4 None admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:07.430601 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5f0a3f-a19a-4bbd-ad2a-4f3d1fe4d4f4 None admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:07.431112 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5f0a3f-a19a-4bbd-ad2a-4f3d1fe4d4f4 None admin] PATH_INFO: `/v3/users/glance` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:07.441655 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5f0a3f-a19a-4bbd-ad2a-4f3d1fe4d4f4 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:07.442415 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8ca822-537b-44b3-b23a-6dac109637f6 None admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:07.443696 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5f0a3f-a19a-4bbd-ad2a-4f3d1fe4d4f4 None admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:07.459860 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application [None req-6e5f0a3f-a19a-4bbd-ad2a-4f3d1fe4d4f4 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 14 10:40:07.459860 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:40:07.459860 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:40:07.459860 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:40:07.459860 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:40:07.459860 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:40:07.459860 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:40:07.459860 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:40:07.459860 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:40:07.459860 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:40:07.459860 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:40:07.459860 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:40:07.459860 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 10:40:07.459860 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 10:40:07.459860 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 10:40:07.459860 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 10:40:07.460915 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:40:07.460915 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:40:07.460915 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 10:40:07.460915 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 10:40:07.460915 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 10:40:07.460915 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 10:40:07.460915 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:40:07.460915 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:40:07.460915 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:40:07.460915 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:40:07.460915 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:40:07.460915 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application with Lock( Jul 14 10:40:07.460915 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:40:07.460915 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:40:07.460915 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:40:07.460915 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:40:07.460915 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:40:07.460915 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:40:07.461852 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:40:07.461852 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:40:07.461852 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 10:40:07.461852 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 10:40:07.461852 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 10:40:07.461852 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 10:40:07.461852 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 10:40:07.461852 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 10:40:07.461852 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 14 10:40:07.461852 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application Jul 14 10:40:07.464746 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 331/659] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Jul 14 10:40:07 2022] GET /identity/v3/users/glance => generated 84 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:40:07.465793 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5f0a3f-a19a-4bbd-ad2a-4f3d1fe4d4f4 None admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:07.480865 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a114c9a-6eff-4b85-b560-d0f13aaec5f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:07.481765 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a114c9a-6eff-4b85-b560-d0f13aaec5f8 None admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:07.481895 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a114c9a-6eff-4b85-b560-d0f13aaec5f8 None admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:07.482116 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a114c9a-6eff-4b85-b560-d0f13aaec5f8 None admin] PATH_INFO: `/v3/domains` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:07.482854 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a114c9a-6eff-4b85-b560-d0f13aaec5f8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:40:07.483159 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a114c9a-6eff-4b85-b560-d0f13aaec5f8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:07.484800 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a114c9a-6eff-4b85-b560-d0f13aaec5f8 None admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:07.496812 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 329/660] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Jul 14 10:40:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:40:07.502149 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a114c9a-6eff-4b85-b560-d0f13aaec5f8 None admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:07.507968 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=100 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:07.575037 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=100 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:07.586855 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5f0a3f-a19a-4bbd-ad2a-4f3d1fe4d4f4 None admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:07.608201 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a114c9a-6eff-4b85-b560-d0f13aaec5f8 None admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:07.623575 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccfd843-ffdb-46b7-ac6b-d5a700fdeafb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:07.625555 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccfd843-ffdb-46b7-ac6b-d5a700fdeafb None admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:07.626347 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccfd843-ffdb-46b7-ac6b-d5a700fdeafb None admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:07.626847 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccfd843-ffdb-46b7-ac6b-d5a700fdeafb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:07.643693 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8269d0f6-de6e-4596-95a4-3c2a4bb266d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:07.644282 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8269d0f6-de6e-4596-95a4-3c2a4bb266d9 None admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:07.644564 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8269d0f6-de6e-4596-95a4-3c2a4bb266d9 None admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:07.644867 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8269d0f6-de6e-4596-95a4-3c2a4bb266d9 None admin] PATH_INFO: `/v3/users` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:07.645716 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8269d0f6-de6e-4596-95a4-3c2a4bb266d9 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=86655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:40:07.646023 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8269d0f6-de6e-4596-95a4-3c2a4bb266d9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:07.647448 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8269d0f6-de6e-4596-95a4-3c2a4bb266d9 None admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:07.665876 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 330/661] 10.222.0.16 () {56 vars in 1137 bytes} [Thu Jul 14 10:40:07 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:40:07.666818 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8269d0f6-de6e-4596-95a4-3c2a4bb266d9 None admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:07.712634 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dccfd843-ffdb-46b7-ac6b-d5a700fdeafb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:07.714134 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dccfd843-ffdb-46b7-ac6b-d5a700fdeafb None admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:07.746958 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=100 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:07.792133 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8269d0f6-de6e-4596-95a4-3c2a4bb266d9 None admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:07.823805 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=100 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:07.831480 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c262d94-e0f4-418e-90fa-ffdbd1d65ae8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:07.836258 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 332/662] 10.222.0.16 () {58 vars in 1282 bytes} [Thu Jul 14 10:40:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 10:40:07.836392 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c262d94-e0f4-418e-90fa-ffdbd1d65ae8 None admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:07.836392 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c262d94-e0f4-418e-90fa-ffdbd1d65ae8 None admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:07.836546 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccfd843-ffdb-46b7-ac6b-d5a700fdeafb None admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:07.836619 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c262d94-e0f4-418e-90fa-ffdbd1d65ae8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:07.848808 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c262d94-e0f4-418e-90fa-ffdbd1d65ae8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:07.848808 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c262d94-e0f4-418e-90fa-ffdbd1d65ae8 None admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:07.862594 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application [None req-3c262d94-e0f4-418e-90fa-ffdbd1d65ae8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 10:40:07.862594 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:40:07.862594 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:40:07.862594 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:40:07.862594 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:40:07.862594 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:40:07.862594 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:40:07.862594 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:40:07.862594 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:40:07.862594 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:40:07.862594 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:40:07.862594 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:40:07.862594 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 10:40:07.862594 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 10:40:07.862594 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 10:40:07.863493 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 10:40:07.863493 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:40:07.863493 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:40:07.863493 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:40:07.863493 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:40:07.863493 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:40:07.863493 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:40:07.863493 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:40:07.863493 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application with Lock( Jul 14 10:40:07.863493 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:40:07.863493 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:40:07.863493 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:40:07.863493 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:40:07.863493 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:40:07.863493 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:40:07.863493 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:40:07.863493 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:40:07.864607 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 10:40:07.864607 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 10:40:07.864607 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 10:40:07.864607 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 10:40:07.864607 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 10:40:07.864607 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 10:40:07.864607 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 10:40:07.864607 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application Jul 14 10:40:07.864607 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 331/663] 10.222.0.16 () {56 vars in 1111 bytes} [Thu Jul 14 10:40:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:40:07.865614 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f818818-7efe-4eb8-8646-2e04f9011a40 None None] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:07.865963 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f818818-7efe-4eb8-8646-2e04f9011a40 None None] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:07.866307 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f818818-7efe-4eb8-8646-2e04f9011a40 None None] PATH_INFO: `/` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:07.871690 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 332/664] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jul 14 10:40:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:40:07.871690 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f818818-7efe-4eb8-8646-2e04f9011a40 None None] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:07.950497 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccfd843-ffdb-46b7-ac6b-d5a700fdeafb None admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:07.981428 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f818818-7efe-4eb8-8646-2e04f9011a40 None None] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:07.989177 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=100 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:07.993995 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e785d3-f3df-4560-a5eb-0ff999b76880 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:07.994758 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e785d3-f3df-4560-a5eb-0ff999b76880 None admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:07.995405 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e785d3-f3df-4560-a5eb-0ff999b76880 None admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:07.995945 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e785d3-f3df-4560-a5eb-0ff999b76880 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:08.020714 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0ebd27-e467-4e6a-9e95-4d4afa3d1b60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:08.022060 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0ebd27-e467-4e6a-9e95-4d4afa3d1b60 None admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:08.022597 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0ebd27-e467-4e6a-9e95-4d4afa3d1b60 None admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:08.023035 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0ebd27-e467-4e6a-9e95-4d4afa3d1b60 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:08.034631 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0ebd27-e467-4e6a-9e95-4d4afa3d1b60 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:08.036245 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0ebd27-e467-4e6a-9e95-4d4afa3d1b60 None admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:08.055145 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application [None req-1b0ebd27-e467-4e6a-9e95-4d4afa3d1b60 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 10:40:08.055145 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:40:08.055145 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:40:08.055145 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:40:08.055145 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:40:08.055145 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:40:08.055145 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:40:08.055145 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:40:08.055145 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:40:08.055145 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:40:08.055145 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:40:08.055145 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:40:08.055145 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 10:40:08.055145 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 10:40:08.055145 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 10:40:08.056169 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 10:40:08.056169 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:40:08.056169 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:40:08.056169 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:40:08.056169 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:40:08.056169 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:40:08.056169 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:40:08.056169 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:40:08.056169 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application with Lock( Jul 14 10:40:08.056169 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:40:08.056169 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:40:08.056169 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:40:08.056169 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:40:08.056169 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:40:08.056169 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:40:08.056169 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:40:08.056169 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:40:08.057241 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 10:40:08.057241 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 10:40:08.057241 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 10:40:08.057241 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application Jul 14 10:40:08.058929 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 333/665] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Jul 14 10:40:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:40:08.059704 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0ebd27-e467-4e6a-9e95-4d4afa3d1b60 None admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:08.070092 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e785d3-f3df-4560-a5eb-0ff999b76880 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:08.071537 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e785d3-f3df-4560-a5eb-0ff999b76880 None admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:08.111200 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=100 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:08.178606 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0ebd27-e467-4e6a-9e95-4d4afa3d1b60 None admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:08.183627 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 333/666] 10.222.0.16 () {58 vars in 1282 bytes} [Thu Jul 14 10:40:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 10:40:08.183627 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c56058-2c8a-4bf8-bcc4-989b1ec5a6b6 None None] REQUEST_METHOD: `POST` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:08.183627 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c56058-2c8a-4bf8-bcc4-989b1ec5a6b6 None None] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:08.183627 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c56058-2c8a-4bf8-bcc4-989b1ec5a6b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:08.197332 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.auth.core [None req-e6c56058-2c8a-4bf8-bcc4-989b1ec5a6b6 None None] MFA Rules not processed for user `ae4bcdd8106d4bebbdcae96be33505bc`. Rule list: `[]` (Enabled: `True`). {{(pid=86656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:40:08.198519 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-e6c56058-2c8a-4bf8-bcc4-989b1ec5a6b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:40:08.219354 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e468855b-1322-465e-8875-588f36257146 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:08.220014 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e468855b-1322-465e-8875-588f36257146 None admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:08.220293 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e468855b-1322-465e-8875-588f36257146 None admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:08.220801 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e468855b-1322-465e-8875-588f36257146 None admin] PATH_INFO: `/v3/projects` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:08.221396 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e468855b-1322-465e-8875-588f36257146 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:40:08.221706 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e468855b-1322-465e-8875-588f36257146 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:08.223136 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e468855b-1322-465e-8875-588f36257146 None admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:08.226630 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=100 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:08.241834 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 334/667] 10.222.0.16 () {56 vars in 1148 bytes} [Thu Jul 14 10:40:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:40:08.241834 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e468855b-1322-465e-8875-588f36257146 None admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:08.277066 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 334/668] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jul 14 10:40:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 10:40:08.277996 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c56058-2c8a-4bf8-bcc4-989b1ec5a6b6 None None] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:08.357578 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e468855b-1322-465e-8875-588f36257146 None admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:08.360087 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=100 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:08.392024 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c56058-2c8a-4bf8-bcc4-989b1ec5a6b6 None None] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:08.393823 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9f918c-275f-48ff-9cdf-ff7ba5ed11d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:08.394880 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9f918c-275f-48ff-9cdf-ff7ba5ed11d2 None admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:08.394880 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9f918c-275f-48ff-9cdf-ff7ba5ed11d2 None admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:08.395052 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9f918c-275f-48ff-9cdf-ff7ba5ed11d2 None admin] PATH_INFO: `/v3/domains` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:08.395749 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9f918c-275f-48ff-9cdf-ff7ba5ed11d2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:40:08.396064 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9f918c-275f-48ff-9cdf-ff7ba5ed11d2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:08.397470 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9f918c-275f-48ff-9cdf-ff7ba5ed11d2 None admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:08.416216 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 335/669] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Jul 14 10:40:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:40:08.416216 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9f918c-275f-48ff-9cdf-ff7ba5ed11d2 None admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:08.426536 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a3a20a-eb62-4b50-84d1-6f5f9c7e7faf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:08.427331 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a3a20a-eb62-4b50-84d1-6f5f9c7e7faf None admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:08.427615 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a3a20a-eb62-4b50-84d1-6f5f9c7e7faf None admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:08.427886 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a3a20a-eb62-4b50-84d1-6f5f9c7e7faf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:08.439457 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a3a20a-eb62-4b50-84d1-6f5f9c7e7faf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:08.440940 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a3a20a-eb62-4b50-84d1-6f5f9c7e7faf None admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:08.458196 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application [None req-71a3a20a-eb62-4b50-84d1-6f5f9c7e7faf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 10:40:08.458196 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:40:08.458196 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:40:08.458196 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:40:08.458196 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:40:08.458196 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:40:08.458196 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:40:08.458196 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:40:08.458196 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:40:08.458196 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:40:08.458196 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:40:08.458196 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:40:08.458196 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 10:40:08.458196 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 10:40:08.458196 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 10:40:08.459106 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 10:40:08.459106 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:40:08.459106 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:40:08.459106 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:40:08.459106 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:40:08.459106 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:40:08.459106 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:40:08.459106 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:40:08.459106 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application with Lock( Jul 14 10:40:08.459106 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:40:08.459106 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:40:08.459106 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:40:08.459106 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:40:08.459106 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:40:08.459106 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:40:08.459106 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:40:08.459106 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:40:08.460002 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 10:40:08.460002 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 10:40:08.460002 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 10:40:08.460002 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application Jul 14 10:40:08.460002 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 335/670] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Jul 14 10:40:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:40:08.460816 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a3a20a-eb62-4b50-84d1-6f5f9c7e7faf None admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:08.482138 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=100 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:08.534557 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9f918c-275f-48ff-9cdf-ff7ba5ed11d2 None admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:08.571475 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5606b29c-6788-4208-be33-67e43840555b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:08.572143 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5606b29c-6788-4208-be33-67e43840555b None admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:08.572432 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5606b29c-6788-4208-be33-67e43840555b None admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:08.572714 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5606b29c-6788-4208-be33-67e43840555b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:08.572924 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a3a20a-eb62-4b50-84d1-6f5f9c7e7faf None admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:08.573612 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5606b29c-6788-4208-be33-67e43840555b None admin] RBAC: Adding query filter params (role.id=d58911e96aad48cf9ca61ac5df79e21d, scope.project.id=59391272ecbe48b0aa736cb43807be1d, user.id=4dddf93691844886982c91fea974385d) {{(pid=86655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:40:08.573930 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5606b29c-6788-4208-be33-67e43840555b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:08.575823 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5606b29c-6788-4208-be33-67e43840555b None admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:08.592814 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 336/671] 10.222.0.16 () {56 vars in 1374 bytes} [Thu Jul 14 10:40:08 2022] GET /identity/v3/role_assignments?user.id=4dddf93691844886982c91fea974385d&scope.project.id=59391272ecbe48b0aa736cb43807be1d&role.id=d58911e96aad48cf9ca61ac5df79e21d => generated 608 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:40:08.592814 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5606b29c-6788-4208-be33-67e43840555b None admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:08.625478 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=100 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:08.630839 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c52e308-8725-4078-9eb7-d0bf70105bbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:08.631928 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c52e308-8725-4078-9eb7-d0bf70105bbc None admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:08.632219 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c52e308-8725-4078-9eb7-d0bf70105bbc None admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:08.632500 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c52e308-8725-4078-9eb7-d0bf70105bbc None admin] PATH_INFO: `/v3/roles/service` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:08.646424 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c52e308-8725-4078-9eb7-d0bf70105bbc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 10:40:08.654627 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application [None req-2c52e308-8725-4078-9eb7-d0bf70105bbc None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 14 10:40:08.654627 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:40:08.654627 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:40:08.654627 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:40:08.654627 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:40:08.654627 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:40:08.654627 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:40:08.654627 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:40:08.654627 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:40:08.654627 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:40:08.654627 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:40:08.654627 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:40:08.654627 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 10:40:08.654627 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 10:40:08.654627 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 10:40:08.654627 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 10:40:08.655789 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 10:40:08.655789 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 10:40:08.655789 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 10:40:08.655789 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 10:40:08.655789 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:40:08.655789 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:40:08.655789 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:40:08.655789 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:40:08.655789 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:40:08.655789 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:40:08.655789 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:40:08.655789 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application with Lock( Jul 14 10:40:08.655789 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:40:08.655789 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:40:08.655789 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:40:08.655789 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:40:08.656619 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:40:08.656619 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:40:08.656619 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:40:08.656619 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:40:08.656619 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 10:40:08.656619 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 10:40:08.656619 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 10:40:08.656619 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 10:40:08.656619 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 10:40:08.656619 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 10:40:08.656619 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 14 10:40:08.656619 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application Jul 14 10:40:08.657775 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 336/672] 10.222.0.16 () {56 vars in 1102 bytes} [Thu Jul 14 10:40:08 2022] GET /identity/v3/roles/service => generated 85 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:40:08.658244 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c52e308-8725-4078-9eb7-d0bf70105bbc None admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:08.722925 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5606b29c-6788-4208-be33-67e43840555b None admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:08.747123 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=100 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:08.763791 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe6564b-fe52-4893-aad9-b45ec302f23f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:08.764597 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe6564b-fe52-4893-aad9-b45ec302f23f None admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:08.764957 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe6564b-fe52-4893-aad9-b45ec302f23f None admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:08.765237 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe6564b-fe52-4893-aad9-b45ec302f23f None admin] PATH_INFO: `/v3/projects/service` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:08.773787 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe6564b-fe52-4893-aad9-b45ec302f23f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:08.775236 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe6564b-fe52-4893-aad9-b45ec302f23f None admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:08.775360 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c52e308-8725-4078-9eb7-d0bf70105bbc None admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:08.795957 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application [None req-7fe6564b-fe52-4893-aad9-b45ec302f23f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 10:40:08.795957 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:40:08.795957 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:40:08.795957 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:40:08.795957 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:40:08.795957 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:40:08.795957 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:40:08.795957 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:40:08.795957 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:40:08.795957 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:40:08.795957 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:40:08.795957 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:40:08.795957 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 10:40:08.795957 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 10:40:08.795957 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 10:40:08.797676 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 10:40:08.797676 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:40:08.797676 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:40:08.797676 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:40:08.797676 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:40:08.797676 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:40:08.797676 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:40:08.797676 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:40:08.797676 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application with Lock( Jul 14 10:40:08.797676 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:40:08.797676 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:40:08.797676 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:40:08.797676 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:40:08.797676 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:40:08.797676 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:40:08.797676 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:40:08.797676 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:40:08.798817 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 10:40:08.798817 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 10:40:08.798817 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 10:40:08.798817 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 10:40:08.798817 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 10:40:08.798817 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 10:40:08.798817 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 10:40:08.798817 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application Jul 14 10:40:08.798817 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 337/673] 10.222.0.16 () {56 vars in 1111 bytes} [Thu Jul 14 10:40:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:40:08.799605 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe6564b-fe52-4893-aad9-b45ec302f23f None admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:08.826541 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2809b75b-e5c7-4bdc-a0d8-7155a328a588 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:08.827223 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2809b75b-e5c7-4bdc-a0d8-7155a328a588 None admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:08.828042 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2809b75b-e5c7-4bdc-a0d8-7155a328a588 None admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:08.829053 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2809b75b-e5c7-4bdc-a0d8-7155a328a588 None admin] PATH_INFO: `/v3/domains` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:08.829160 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2809b75b-e5c7-4bdc-a0d8-7155a328a588 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:40:08.829390 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2809b75b-e5c7-4bdc-a0d8-7155a328a588 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:08.830776 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2809b75b-e5c7-4bdc-a0d8-7155a328a588 None admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:08.843609 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 337/674] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Jul 14 10:40:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:40:08.844443 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2809b75b-e5c7-4bdc-a0d8-7155a328a588 None admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:08.898503 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=100 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:08.915257 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe6564b-fe52-4893-aad9-b45ec302f23f None admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:08.949265 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2809b75b-e5c7-4bdc-a0d8-7155a328a588 None admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:08.951557 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc41d73f-af33-4e77-85de-2cbb347b6a60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:08.952234 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc41d73f-af33-4e77-85de-2cbb347b6a60 None admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:08.953095 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc41d73f-af33-4e77-85de-2cbb347b6a60 None admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:08.953417 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc41d73f-af33-4e77-85de-2cbb347b6a60 None admin] PATH_INFO: `/v3/roles` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:08.954181 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc41d73f-af33-4e77-85de-2cbb347b6a60 None admin] RBAC: Adding query filter params (name=service) {{(pid=86655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:40:08.954489 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc41d73f-af33-4e77-85de-2cbb347b6a60 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:08.955863 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc41d73f-af33-4e77-85de-2cbb347b6a60 None admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:08.964514 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 338/675] 10.222.0.16 () {56 vars in 1103 bytes} [Thu Jul 14 10:40:08 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:40:08.965630 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3f4593-fd0e-425c-96a9-03429e494041 None None] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:08.965918 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3f4593-fd0e-425c-96a9-03429e494041 None None] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:08.966196 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3f4593-fd0e-425c-96a9-03429e494041 None None] PATH_INFO: `/` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:08.971862 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 339/676] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jul 14 10:40:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:40:08.971862 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3f4593-fd0e-425c-96a9-03429e494041 None None] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:08.993620 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2723338c-f303-42e0-9b42-fc59b69d09be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:08.994588 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2723338c-f303-42e0-9b42-fc59b69d09be None admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:08.995080 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2723338c-f303-42e0-9b42-fc59b69d09be None admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:08.995537 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2723338c-f303-42e0-9b42-fc59b69d09be None admin] PATH_INFO: `/v3/projects` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:08.996479 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2723338c-f303-42e0-9b42-fc59b69d09be None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:40:08.996967 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2723338c-f303-42e0-9b42-fc59b69d09be None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:08.998553 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2723338c-f303-42e0-9b42-fc59b69d09be None admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:09.000550 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=100 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:09.012054 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 338/677] 10.222.0.16 () {56 vars in 1148 bytes} [Thu Jul 14 10:40:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:40:09.012980 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2723338c-f303-42e0-9b42-fc59b69d09be None admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:09.081525 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3f4593-fd0e-425c-96a9-03429e494041 None None] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:09.117137 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9521d92d-9eca-499a-a4a1-5670e9aee3e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:09.117939 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9521d92d-9eca-499a-a4a1-5670e9aee3e7 None admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:09.118236 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9521d92d-9eca-499a-a4a1-5670e9aee3e7 None admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:09.118520 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9521d92d-9eca-499a-a4a1-5670e9aee3e7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:09.124815 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2723338c-f303-42e0-9b42-fc59b69d09be None admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:09.126192 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9521d92d-9eca-499a-a4a1-5670e9aee3e7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:09.127729 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9521d92d-9eca-499a-a4a1-5670e9aee3e7 None admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:09.143413 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application [None req-9521d92d-9eca-499a-a4a1-5670e9aee3e7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 10:40:09.143413 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:40:09.143413 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:40:09.143413 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:40:09.143413 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:40:09.143413 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:40:09.143413 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:40:09.143413 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:40:09.143413 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:40:09.143413 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:40:09.143413 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:40:09.143413 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:40:09.143413 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 10:40:09.143413 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 10:40:09.143413 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 10:40:09.144465 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 10:40:09.144465 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:40:09.144465 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:40:09.144465 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:40:09.144465 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:40:09.144465 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:40:09.144465 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:40:09.144465 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:40:09.144465 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application with Lock( Jul 14 10:40:09.144465 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:40:09.144465 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:40:09.144465 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:40:09.144465 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:40:09.144465 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:40:09.144465 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:40:09.144465 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:40:09.144465 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:40:09.145417 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 10:40:09.145417 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 10:40:09.145417 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 10:40:09.145417 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 10:40:09.145417 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 10:40:09.145417 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 10:40:09.145417 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 10:40:09.145417 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application Jul 14 10:40:09.145417 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 340/678] 10.222.0.16 () {56 vars in 1111 bytes} [Thu Jul 14 10:40:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:40:09.146126 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38219d94-ea58-4ac0-a6e1-9a0c61bbbbe2 None None] REQUEST_METHOD: `POST` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:09.146417 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38219d94-ea58-4ac0-a6e1-9a0c61bbbbe2 None None] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:09.146693 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38219d94-ea58-4ac0-a6e1-9a0c61bbbbe2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:09.164436 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.auth.core [None req-38219d94-ea58-4ac0-a6e1-9a0c61bbbbe2 None None] MFA Rules not processed for user `ae4bcdd8106d4bebbdcae96be33505bc`. Rule list: `[]` (Enabled: `True`). {{(pid=86655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:40:09.165760 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-38219d94-ea58-4ac0-a6e1-9a0c61bbbbe2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:40:09.167937 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=100 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:09.168565 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477b2aef-c900-4dd0-9aa3-5c7328199152 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:09.169404 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477b2aef-c900-4dd0-9aa3-5c7328199152 None admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:09.169743 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477b2aef-c900-4dd0-9aa3-5c7328199152 None admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:09.169969 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477b2aef-c900-4dd0-9aa3-5c7328199152 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:09.181369 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477b2aef-c900-4dd0-9aa3-5c7328199152 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:09.182816 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477b2aef-c900-4dd0-9aa3-5c7328199152 None admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:09.201370 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application [None req-477b2aef-c900-4dd0-9aa3-5c7328199152 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 10:40:09.201370 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:40:09.201370 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:40:09.201370 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:40:09.201370 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:40:09.201370 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:40:09.201370 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:40:09.201370 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:40:09.201370 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:40:09.201370 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:40:09.201370 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:40:09.201370 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:40:09.201370 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 10:40:09.201370 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 10:40:09.201370 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 10:40:09.202279 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 10:40:09.202279 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:40:09.202279 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:40:09.202279 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:40:09.202279 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:40:09.202279 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:40:09.202279 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:40:09.202279 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:40:09.202279 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application with Lock( Jul 14 10:40:09.202279 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:40:09.202279 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:40:09.202279 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:40:09.202279 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:40:09.202279 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:40:09.202279 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:40:09.202279 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:40:09.202279 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:40:09.203713 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 10:40:09.203713 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 10:40:09.203713 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 10:40:09.203713 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application Jul 14 10:40:09.203713 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 339/679] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Jul 14 10:40:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:40:09.203993 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477b2aef-c900-4dd0-9aa3-5c7328199152 None admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:09.248034 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 341/680] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jul 14 10:40:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 10:40:09.249963 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38219d94-ea58-4ac0-a6e1-9a0c61bbbbe2 None None] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:09.255048 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=100 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:09.318168 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477b2aef-c900-4dd0-9aa3-5c7328199152 None admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:09.355661 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28579938-6190-4f90-a96a-961c96b60396 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:09.356324 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28579938-6190-4f90-a96a-961c96b60396 None admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:09.356606 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28579938-6190-4f90-a96a-961c96b60396 None admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:09.356911 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28579938-6190-4f90-a96a-961c96b60396 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:09.357499 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38219d94-ea58-4ac0-a6e1-9a0c61bbbbe2 None None] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:09.357741 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28579938-6190-4f90-a96a-961c96b60396 None admin] RBAC: Adding query filter params (role.id=d58911e96aad48cf9ca61ac5df79e21d, scope.project.id=59391272ecbe48b0aa736cb43807be1d, user.id=68382432147a48c3b62271fd2a2eab04) {{(pid=86656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:40:09.358051 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28579938-6190-4f90-a96a-961c96b60396 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:09.359581 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28579938-6190-4f90-a96a-961c96b60396 None admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:09.372820 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 340/681] 10.222.0.16 () {56 vars in 1374 bytes} [Thu Jul 14 10:40:09 2022] GET /identity/v3/role_assignments?user.id=68382432147a48c3b62271fd2a2eab04&scope.project.id=59391272ecbe48b0aa736cb43807be1d&role.id=d58911e96aad48cf9ca61ac5df79e21d => generated 608 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:40:09.372820 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28579938-6190-4f90-a96a-961c96b60396 None admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:09.417320 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da457592-f179-4496-a56a-332c76d1525f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:09.418065 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da457592-f179-4496-a56a-332c76d1525f None admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:09.418420 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da457592-f179-4496-a56a-332c76d1525f None admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:09.418858 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da457592-f179-4496-a56a-332c76d1525f None admin] PATH_INFO: `/v3/projects` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:09.419670 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da457592-f179-4496-a56a-332c76d1525f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:40:09.420609 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da457592-f179-4496-a56a-332c76d1525f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:09.423286 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da457592-f179-4496-a56a-332c76d1525f None admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:09.433977 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=100 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:09.444990 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 342/682] 10.222.0.16 () {56 vars in 1148 bytes} [Thu Jul 14 10:40:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:40:09.445911 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da457592-f179-4496-a56a-332c76d1525f None admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:09.517091 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28579938-6190-4f90-a96a-961c96b60396 None admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:09.530636 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=100 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:09.563427 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da457592-f179-4496-a56a-332c76d1525f None admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:09.564480 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44af84e-13e9-4dfd-8782-8c93cfa7817f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:09.565519 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44af84e-13e9-4dfd-8782-8c93cfa7817f None admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:09.565976 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44af84e-13e9-4dfd-8782-8c93cfa7817f None admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:09.567256 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44af84e-13e9-4dfd-8782-8c93cfa7817f None admin] PATH_INFO: `/v3/domains` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:09.568153 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44af84e-13e9-4dfd-8782-8c93cfa7817f None admin] RBAC: Adding query filter params (name=Default) {{(pid=86656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:40:09.568626 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44af84e-13e9-4dfd-8782-8c93cfa7817f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:09.570169 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44af84e-13e9-4dfd-8782-8c93cfa7817f None admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:09.587619 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 341/683] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Jul 14 10:40:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:40:09.587950 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44af84e-13e9-4dfd-8782-8c93cfa7817f None admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:09.607614 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4584cee4-822f-468f-8440-b012b6cc2214 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:09.608420 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4584cee4-822f-468f-8440-b012b6cc2214 None admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:09.609274 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4584cee4-822f-468f-8440-b012b6cc2214 None admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:09.609554 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4584cee4-822f-468f-8440-b012b6cc2214 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:09.620925 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4584cee4-822f-468f-8440-b012b6cc2214 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 10:40:09.629066 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application [None req-4584cee4-822f-468f-8440-b012b6cc2214 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 10:40:09.629066 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:40:09.629066 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:40:09.629066 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:40:09.629066 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:40:09.629066 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:40:09.629066 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:40:09.629066 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:40:09.629066 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:40:09.629066 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:40:09.629066 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:40:09.629066 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:40:09.629066 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 10:40:09.629066 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 10:40:09.629066 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 10:40:09.629066 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 10:40:09.630019 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 10:40:09.630019 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 10:40:09.630019 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 10:40:09.630019 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 10:40:09.630019 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:40:09.630019 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:40:09.630019 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:40:09.630019 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:40:09.630019 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:40:09.630019 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:40:09.630019 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:40:09.630019 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application with Lock( Jul 14 10:40:09.630019 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:40:09.630019 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:40:09.630019 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:40:09.630019 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:40:09.631212 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:40:09.631212 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:40:09.631212 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:40:09.631212 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:40:09.631212 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 10:40:09.631212 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 10:40:09.631212 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 10:40:09.631212 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 10:40:09.631212 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 10:40:09.631212 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 10:40:09.631212 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 10:40:09.631212 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application Jul 14 10:40:09.631212 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 343/684] 10.222.0.16 () {56 vars in 1096 bytes} [Thu Jul 14 10:40:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:40:09.631212 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4584cee4-822f-468f-8440-b012b6cc2214 None admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:09.695910 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=100 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:09.716853 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44af84e-13e9-4dfd-8782-8c93cfa7817f None admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:09.745715 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4584cee4-822f-468f-8440-b012b6cc2214 None admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:09.762707 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d513ec82-7a50-4bd8-b577-de59502f60e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:09.763713 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d513ec82-7a50-4bd8-b577-de59502f60e1 None admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:09.764061 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d513ec82-7a50-4bd8-b577-de59502f60e1 None admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:09.764627 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d513ec82-7a50-4bd8-b577-de59502f60e1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:09.766456 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d513ec82-7a50-4bd8-b577-de59502f60e1 None admin] RBAC: Adding query filter params (role.id=d58911e96aad48cf9ca61ac5df79e21d, scope.project.id=59391272ecbe48b0aa736cb43807be1d, user.id=4cb877bf3f8241dcb2ecbb612c7f4f69) {{(pid=86656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:40:09.766850 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d513ec82-7a50-4bd8-b577-de59502f60e1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:09.768355 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d513ec82-7a50-4bd8-b577-de59502f60e1 None admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:09.777465 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 342/685] 10.222.0.16 () {56 vars in 1374 bytes} [Thu Jul 14 10:40:09 2022] GET /identity/v3/role_assignments?user.id=4cb877bf3f8241dcb2ecbb612c7f4f69&scope.project.id=59391272ecbe48b0aa736cb43807be1d&role.id=d58911e96aad48cf9ca61ac5df79e21d => generated 608 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:40:09.781568 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d513ec82-7a50-4bd8-b577-de59502f60e1 None admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:09.789521 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56375f27-4a9a-4d0a-8087-d689a56e8536 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:09.790783 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56375f27-4a9a-4d0a-8087-d689a56e8536 None admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:09.791323 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56375f27-4a9a-4d0a-8087-d689a56e8536 None admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:09.791811 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56375f27-4a9a-4d0a-8087-d689a56e8536 None admin] PATH_INFO: `/v3/users/swift` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:09.807978 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56375f27-4a9a-4d0a-8087-d689a56e8536 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:09.809860 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56375f27-4a9a-4d0a-8087-d689a56e8536 None admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:09.825643 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=100 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:09.826447 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application [None req-56375f27-4a9a-4d0a-8087-d689a56e8536 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 14 10:40:09.826447 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:40:09.826447 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:40:09.826447 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:40:09.826447 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:40:09.826447 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:40:09.826447 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:40:09.826447 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:40:09.826447 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:40:09.826447 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:40:09.826447 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:40:09.826447 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:40:09.826447 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 10:40:09.826447 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 10:40:09.826447 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 10:40:09.826447 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 10:40:09.827362 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:40:09.827362 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:40:09.827362 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 10:40:09.827362 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 10:40:09.827362 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 10:40:09.827362 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 10:40:09.827362 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:40:09.827362 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:40:09.827362 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:40:09.827362 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:40:09.827362 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:40:09.827362 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application with Lock( Jul 14 10:40:09.827362 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:40:09.827362 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:40:09.827362 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:40:09.827362 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:40:09.827362 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:40:09.827362 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:40:09.828283 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:40:09.828283 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:40:09.828283 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 10:40:09.828283 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 10:40:09.828283 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 10:40:09.828283 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 10:40:09.828283 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 10:40:09.828283 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 10:40:09.828283 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 14 10:40:09.828283 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application Jul 14 10:40:09.831032 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 344/686] 10.222.0.16 () {56 vars in 1096 bytes} [Thu Jul 14 10:40:09 2022] GET /identity/v3/users/swift => generated 83 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:40:09.839715 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56375f27-4a9a-4d0a-8087-d689a56e8536 None admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:09.901782 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d513ec82-7a50-4bd8-b577-de59502f60e1 None admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:09.940633 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493cbe0e-6353-4bb1-a7e2-d0fbb288b969 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:09.941403 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493cbe0e-6353-4bb1-a7e2-d0fbb288b969 None admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:09.941699 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493cbe0e-6353-4bb1-a7e2-d0fbb288b969 None admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:09.941977 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493cbe0e-6353-4bb1-a7e2-d0fbb288b969 None admin] PATH_INFO: `/v3/roles` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:09.942741 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493cbe0e-6353-4bb1-a7e2-d0fbb288b969 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:40:09.943049 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493cbe0e-6353-4bb1-a7e2-d0fbb288b969 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:09.944453 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493cbe0e-6353-4bb1-a7e2-d0fbb288b969 None admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:09.954239 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 343/687] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Jul 14 10:40:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:40:09.962316 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493cbe0e-6353-4bb1-a7e2-d0fbb288b969 None admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:10.066896 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56375f27-4a9a-4d0a-8087-d689a56e8536 None admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:10.090265 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=100 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:10.099219 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=100 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:10.106377 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493cbe0e-6353-4bb1-a7e2-d0fbb288b969 None admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:10.114592 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3784076b-8f49-4a2e-a1cc-f620447ddf78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:10.115561 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3784076b-8f49-4a2e-a1cc-f620447ddf78 None admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:10.116389 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3784076b-8f49-4a2e-a1cc-f620447ddf78 None admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:10.116924 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3784076b-8f49-4a2e-a1cc-f620447ddf78 None admin] PATH_INFO: `/v3/users` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:10.118309 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3784076b-8f49-4a2e-a1cc-f620447ddf78 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=86655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:40:10.119077 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3784076b-8f49-4a2e-a1cc-f620447ddf78 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:10.120914 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3784076b-8f49-4a2e-a1cc-f620447ddf78 None admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:10.143905 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b0cdc7-b9a9-4bd3-bcf2-860d6bc4ea1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:10.144704 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b0cdc7-b9a9-4bd3-bcf2-860d6bc4ea1b None admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:10.145057 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b0cdc7-b9a9-4bd3-bcf2-860d6bc4ea1b None admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:10.145337 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b0cdc7-b9a9-4bd3-bcf2-860d6bc4ea1b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:10.146238 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 345/688] 10.222.0.16 () {56 vars in 1135 bytes} [Thu Jul 14 10:40:09 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:40:10.151328 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3784076b-8f49-4a2e-a1cc-f620447ddf78 None admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:10.158999 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b0cdc7-b9a9-4bd3-bcf2-860d6bc4ea1b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:10.160314 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b0cdc7-b9a9-4bd3-bcf2-860d6bc4ea1b None admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:10.185996 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application [None req-a8b0cdc7-b9a9-4bd3-bcf2-860d6bc4ea1b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 10:40:10.185996 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:40:10.185996 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:40:10.185996 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:40:10.185996 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:40:10.185996 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:40:10.185996 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:40:10.185996 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:40:10.185996 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:40:10.185996 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:40:10.185996 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:40:10.185996 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:40:10.185996 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 10:40:10.185996 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 10:40:10.185996 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 10:40:10.187287 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 10:40:10.187287 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:40:10.187287 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:40:10.187287 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:40:10.187287 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:40:10.187287 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:40:10.187287 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:40:10.187287 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:40:10.187287 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application with Lock( Jul 14 10:40:10.187287 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:40:10.187287 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:40:10.187287 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:40:10.187287 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:40:10.187287 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:40:10.187287 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:40:10.187287 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:40:10.187287 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:40:10.188216 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 10:40:10.188216 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 10:40:10.188216 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 10:40:10.188216 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application Jul 14 10:40:10.188216 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 344/689] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Jul 14 10:40:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:40:10.193397 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b0cdc7-b9a9-4bd3-bcf2-860d6bc4ea1b None admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:10.282865 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3784076b-8f49-4a2e-a1cc-f620447ddf78 None admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:10.310658 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b0cdc7-b9a9-4bd3-bcf2-860d6bc4ea1b None admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:10.321370 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e2238f-61ce-4825-84ad-7fa7d10763ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:10.322373 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e2238f-61ce-4825-84ad-7fa7d10763ec None admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:10.323054 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e2238f-61ce-4825-84ad-7fa7d10763ec None admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:10.323534 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e2238f-61ce-4825-84ad-7fa7d10763ec None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:10.349519 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9152f8ca-94e8-4f55-861b-ad37ae127cd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:10.350235 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9152f8ca-94e8-4f55-861b-ad37ae127cd8 None admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:10.350466 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9152f8ca-94e8-4f55-861b-ad37ae127cd8 None admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:10.350739 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9152f8ca-94e8-4f55-861b-ad37ae127cd8 None admin] PATH_INFO: `/v3/domains` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:10.351465 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9152f8ca-94e8-4f55-861b-ad37ae127cd8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:40:10.351768 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9152f8ca-94e8-4f55-861b-ad37ae127cd8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:10.353403 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9152f8ca-94e8-4f55-861b-ad37ae127cd8 None admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:10.369305 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 345/690] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Jul 14 10:40:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:40:10.375148 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9152f8ca-94e8-4f55-861b-ad37ae127cd8 None admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:10.376171 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=100 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:10.389107 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=100 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:10.403007 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e2238f-61ce-4825-84ad-7fa7d10763ec None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:10.404938 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e2238f-61ce-4825-84ad-7fa7d10763ec None admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:10.490445 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9152f8ca-94e8-4f55-861b-ad37ae127cd8 None admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:10.517548 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 346/691] 10.222.0.16 () {58 vars in 1282 bytes} [Thu Jul 14 10:40:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 14 10:40:10.524076 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e2238f-61ce-4825-84ad-7fa7d10763ec None admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:10.567615 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f23d9bf-5791-4a5e-b58b-7294ca878907 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:10.568792 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f23d9bf-5791-4a5e-b58b-7294ca878907 None admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:10.569328 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f23d9bf-5791-4a5e-b58b-7294ca878907 None admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:10.569804 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f23d9bf-5791-4a5e-b58b-7294ca878907 None admin] PATH_INFO: `/v3/users/nova` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:10.584987 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f23d9bf-5791-4a5e-b58b-7294ca878907 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:10.587842 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f23d9bf-5791-4a5e-b58b-7294ca878907 None admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:10.629340 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application [None req-1f23d9bf-5791-4a5e-b58b-7294ca878907 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 14 10:40:10.629340 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:40:10.629340 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:40:10.629340 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:40:10.629340 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:40:10.629340 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:40:10.629340 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:40:10.629340 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:40:10.629340 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:40:10.629340 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:40:10.629340 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:40:10.629340 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:40:10.629340 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 10:40:10.629340 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 10:40:10.629340 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 10:40:10.629340 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 10:40:10.630449 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:40:10.630449 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:40:10.630449 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 10:40:10.630449 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 10:40:10.630449 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 10:40:10.630449 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 10:40:10.630449 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:40:10.630449 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:40:10.630449 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:40:10.630449 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:40:10.630449 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:40:10.630449 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application with Lock( Jul 14 10:40:10.630449 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:40:10.630449 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:40:10.630449 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:40:10.630449 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:40:10.630449 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:40:10.630449 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:40:10.631381 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:40:10.631381 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:40:10.631381 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 10:40:10.631381 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 10:40:10.631381 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 10:40:10.631381 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 10:40:10.631381 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 10:40:10.631381 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 10:40:10.631381 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 14 10:40:10.631381 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application Jul 14 10:40:10.631381 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 346/692] 10.222.0.16 () {56 vars in 1093 bytes} [Thu Jul 14 10:40:10 2022] GET /identity/v3/users/nova => generated 82 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:40:10.637695 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f23d9bf-5791-4a5e-b58b-7294ca878907 None admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:10.650915 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=100 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:10.697004 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e2238f-61ce-4825-84ad-7fa7d10763ec None admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:10.768072 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2207ecac-6980-4538-89b4-e12b003bc258 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:10.770305 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2207ecac-6980-4538-89b4-e12b003bc258 None admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:10.771558 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2207ecac-6980-4538-89b4-e12b003bc258 None admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:10.772249 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2207ecac-6980-4538-89b4-e12b003bc258 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:10.783844 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=100 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:10.796430 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2207ecac-6980-4538-89b4-e12b003bc258 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:10.797966 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2207ecac-6980-4538-89b4-e12b003bc258 None admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:10.820260 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application [None req-2207ecac-6980-4538-89b4-e12b003bc258 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 10:40:10.820260 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:40:10.820260 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:40:10.820260 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:40:10.820260 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:40:10.820260 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:40:10.820260 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:40:10.820260 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:40:10.820260 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:40:10.820260 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:40:10.820260 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:40:10.820260 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:40:10.820260 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 10:40:10.820260 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 10:40:10.820260 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 10:40:10.821204 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 10:40:10.821204 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:40:10.821204 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:40:10.821204 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:40:10.821204 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:40:10.821204 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:40:10.821204 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:40:10.821204 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:40:10.821204 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application with Lock( Jul 14 10:40:10.821204 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:40:10.821204 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:40:10.821204 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:40:10.821204 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:40:10.821204 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:40:10.821204 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:40:10.821204 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:40:10.821204 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:40:10.822103 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 10:40:10.822103 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 10:40:10.822103 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 10:40:10.822103 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application Jul 14 10:40:10.822103 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 347/693] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Jul 14 10:40:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 298 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:40:10.823092 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c0c6cf-e562-4d2e-a35c-71afada59a10 None None] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:10.823409 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c0c6cf-e562-4d2e-a35c-71afada59a10 None None] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:10.824235 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c0c6cf-e562-4d2e-a35c-71afada59a10 None None] PATH_INFO: `/` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:10.826222 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 348/694] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jul 14 10:40:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:40:10.826940 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c0c6cf-e562-4d2e-a35c-71afada59a10 None None] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:10.849129 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f23d9bf-5791-4a5e-b58b-7294ca878907 None admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:10.884992 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ddf49d-a4c5-40fe-af33-94ddb636ddb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:10.886029 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ddf49d-a4c5-40fe-af33-94ddb636ddb3 None admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:10.886510 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ddf49d-a4c5-40fe-af33-94ddb636ddb3 None admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:10.887007 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ddf49d-a4c5-40fe-af33-94ddb636ddb3 None admin] PATH_INFO: `/v3/users` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:10.888043 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ddf49d-a4c5-40fe-af33-94ddb636ddb3 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:40:10.888545 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ddf49d-a4c5-40fe-af33-94ddb636ddb3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:10.890421 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ddf49d-a4c5-40fe-af33-94ddb636ddb3 None admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:10.915413 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 347/695] 10.222.0.16 () {56 vars in 1133 bytes} [Thu Jul 14 10:40:10 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:40:10.915413 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26256292-57fd-4057-ae12-da11198935c1 None None] REQUEST_METHOD: `POST` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:10.915413 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26256292-57fd-4057-ae12-da11198935c1 None None] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:10.915413 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26256292-57fd-4057-ae12-da11198935c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:10.937276 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.auth.core [None req-26256292-57fd-4057-ae12-da11198935c1 None None] MFA Rules not processed for user `ae4bcdd8106d4bebbdcae96be33505bc`. Rule list: `[]` (Enabled: `True`). {{(pid=86656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:40:10.939205 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-26256292-57fd-4057-ae12-da11198935c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:40:10.961577 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c0c6cf-e562-4d2e-a35c-71afada59a10 None None] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:10.989977 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=100 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:10.998868 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9aec89-dbe5-4002-befe-99c6e5b8f197 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:11.000346 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9aec89-dbe5-4002-befe-99c6e5b8f197 None admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:11.000861 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9aec89-dbe5-4002-befe-99c6e5b8f197 None admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:11.001373 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9aec89-dbe5-4002-befe-99c6e5b8f197 None admin] PATH_INFO: `/v3/domains` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:11.002318 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9aec89-dbe5-4002-befe-99c6e5b8f197 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:40:11.002816 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9aec89-dbe5-4002-befe-99c6e5b8f197 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:11.004372 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9aec89-dbe5-4002-befe-99c6e5b8f197 None admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:11.017038 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 349/696] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Jul 14 10:40:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:40:11.018239 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9aec89-dbe5-4002-befe-99c6e5b8f197 None admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:11.036794 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 348/697] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jul 14 10:40:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 10:40:11.036794 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26256292-57fd-4057-ae12-da11198935c1 None None] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:11.106129 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=100 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:11.146639 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9aec89-dbe5-4002-befe-99c6e5b8f197 None admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:11.163052 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26256292-57fd-4057-ae12-da11198935c1 None None] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:11.190877 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e071455-1a5b-48f0-826f-6d482f0f274f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:11.192172 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e071455-1a5b-48f0-826f-6d482f0f274f None admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:11.192461 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e071455-1a5b-48f0-826f-6d482f0f274f None admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:11.192738 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e071455-1a5b-48f0-826f-6d482f0f274f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:11.200981 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91538475-25bb-4037-9002-3a55362fad3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:11.202047 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91538475-25bb-4037-9002-3a55362fad3b None admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:11.203165 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91538475-25bb-4037-9002-3a55362fad3b None admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:11.203641 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91538475-25bb-4037-9002-3a55362fad3b None admin] PATH_INFO: `/v3/projects/service` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:11.212502 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91538475-25bb-4037-9002-3a55362fad3b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:11.214226 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91538475-25bb-4037-9002-3a55362fad3b None admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:11.228680 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application [None req-91538475-25bb-4037-9002-3a55362fad3b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 10:40:11.228680 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:40:11.228680 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:40:11.228680 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:40:11.228680 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:40:11.228680 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:40:11.228680 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:40:11.228680 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:40:11.228680 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:40:11.228680 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:40:11.228680 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:40:11.228680 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:40:11.228680 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 10:40:11.228680 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 10:40:11.228680 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 10:40:11.229602 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 10:40:11.229602 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:40:11.229602 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:40:11.229602 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:40:11.229602 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:40:11.229602 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:40:11.229602 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:40:11.229602 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:40:11.229602 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application with Lock( Jul 14 10:40:11.229602 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:40:11.229602 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:40:11.229602 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:40:11.229602 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:40:11.229602 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:40:11.229602 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:40:11.229602 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:40:11.229602 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:40:11.230463 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 10:40:11.230463 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 10:40:11.230463 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 10:40:11.230463 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 10:40:11.230463 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 10:40:11.230463 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 10:40:11.230463 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 10:40:11.230463 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application Jul 14 10:40:11.232909 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 349/698] 10.222.0.16 () {56 vars in 1111 bytes} [Thu Jul 14 10:40:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:40:11.234524 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91538475-25bb-4037-9002-3a55362fad3b None admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:11.263891 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=100 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:11.288095 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e071455-1a5b-48f0-826f-6d482f0f274f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:11.289599 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e071455-1a5b-48f0-826f-6d482f0f274f None admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:11.340935 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91538475-25bb-4037-9002-3a55362fad3b None admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:11.359515 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=100 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:11.381561 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230e00da-60fc-48bd-bc53-4b09e02d9ba0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:11.382709 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230e00da-60fc-48bd-bc53-4b09e02d9ba0 None admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:11.383189 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230e00da-60fc-48bd-bc53-4b09e02d9ba0 None admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:11.383656 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230e00da-60fc-48bd-bc53-4b09e02d9ba0 None admin] PATH_INFO: `/v3/services/network` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:11.384530 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230e00da-60fc-48bd-bc53-4b09e02d9ba0 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:11.386156 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230e00da-60fc-48bd-bc53-4b09e02d9ba0 None admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:11.400335 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application [None req-230e00da-60fc-48bd-bc53-4b09e02d9ba0 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 14 10:40:11.400335 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:40:11.400335 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 14 10:40:11.400335 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 14 10:40:11.400335 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 14 10:40:11.400335 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 14 10:40:11.400335 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 14 10:40:11.400335 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 10:40:11.400335 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 14 10:40:11.400335 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application Jul 14 10:40:11.400335 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 10:40:11.400335 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application Jul 14 10:40:11.400335 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:40:11.400335 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:40:11.400335 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:40:11.400335 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:40:11.400335 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:40:11.401396 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:40:11.401396 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:40:11.401396 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:40:11.401396 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:40:11.401396 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:40:11.401396 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:40:11.401396 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 14 10:40:11.401396 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 14 10:40:11.401396 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 14 10:40:11.401396 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 14 10:40:11.401396 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:40:11.401396 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:40:11.401396 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:40:11.401396 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:40:11.401396 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:40:11.401396 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:40:11.402218 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:40:11.402218 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application with Lock( Jul 14 10:40:11.402218 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:40:11.402218 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:40:11.402218 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:40:11.402218 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:40:11.402218 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:40:11.402218 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:40:11.402218 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:40:11.402218 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:40:11.402218 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 14 10:40:11.402218 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 10:40:11.402218 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 14 10:40:11.402218 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application Jul 14 10:40:11.410188 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 350/699] 10.222.0.16 () {56 vars in 1111 bytes} [Thu Jul 14 10:40:11 2022] GET /identity/v3/services/network => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:40:11.411324 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230e00da-60fc-48bd-bc53-4b09e02d9ba0 None admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:11.417980 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 350/700] 10.222.0.16 () {58 vars in 1282 bytes} [Thu Jul 14 10:40:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 10:40:11.423158 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e071455-1a5b-48f0-826f-6d482f0f274f None admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:11.521852 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=100 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:11.532404 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230e00da-60fc-48bd-bc53-4b09e02d9ba0 None admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:11.536101 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e071455-1a5b-48f0-826f-6d482f0f274f None admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:11.569698 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe3a2c7-1c79-43a5-978d-baa2c26ebd67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:11.570556 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe3a2c7-1c79-43a5-978d-baa2c26ebd67 None admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:11.570913 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe3a2c7-1c79-43a5-978d-baa2c26ebd67 None admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:11.571261 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe3a2c7-1c79-43a5-978d-baa2c26ebd67 None admin] PATH_INFO: `/v3/projects` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:11.572122 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe3a2c7-1c79-43a5-978d-baa2c26ebd67 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:40:11.572619 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe3a2c7-1c79-43a5-978d-baa2c26ebd67 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:11.573337 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b42c0c9-b123-4568-bbda-a493e3d7f805 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:11.574203 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b42c0c9-b123-4568-bbda-a493e3d7f805 None admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:11.574309 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe3a2c7-1c79-43a5-978d-baa2c26ebd67 None admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:11.574775 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b42c0c9-b123-4568-bbda-a493e3d7f805 None admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:11.575251 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b42c0c9-b123-4568-bbda-a493e3d7f805 None admin] PATH_INFO: `/v3/services` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:11.576137 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b42c0c9-b123-4568-bbda-a493e3d7f805 None admin] RBAC: Adding query filter params (name=network) {{(pid=86655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:40:11.576653 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b42c0c9-b123-4568-bbda-a493e3d7f805 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:11.578359 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b42c0c9-b123-4568-bbda-a493e3d7f805 None admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:11.583649 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 351/701] 10.222.0.16 () {56 vars in 1112 bytes} [Thu Jul 14 10:40:11 2022] GET /identity/v3/services?name=network => generated 124 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:40:11.584945 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b42c0c9-b123-4568-bbda-a493e3d7f805 None admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:11.592095 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 351/702] 10.222.0.16 () {56 vars in 1148 bytes} [Thu Jul 14 10:40:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:40:11.592095 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe3a2c7-1c79-43a5-978d-baa2c26ebd67 None admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:11.634849 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=100 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:11.695050 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b42c0c9-b123-4568-bbda-a493e3d7f805 None admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:11.698829 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe3a2c7-1c79-43a5-978d-baa2c26ebd67 None admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:11.730629 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fc8bbc-b633-43f5-bb7b-2575654b2062 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:11.731786 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fc8bbc-b633-43f5-bb7b-2575654b2062 None admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:11.732276 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fc8bbc-b633-43f5-bb7b-2575654b2062 None admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:11.732704 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fc8bbc-b633-43f5-bb7b-2575654b2062 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:11.736551 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f1218d-01b0-4272-b800-f9fb612cec9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:11.737352 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f1218d-01b0-4272-b800-f9fb612cec9d None admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:11.737732 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f1218d-01b0-4272-b800-f9fb612cec9d None admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:11.738102 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f1218d-01b0-4272-b800-f9fb612cec9d None admin] PATH_INFO: `/v3/services` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:11.738915 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f1218d-01b0-4272-b800-f9fb612cec9d None admin] RBAC: Adding query filter params (type=network) {{(pid=86656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:40:11.739320 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f1218d-01b0-4272-b800-f9fb612cec9d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:11.740804 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f1218d-01b0-4272-b800-f9fb612cec9d None admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:11.745908 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98fc8bbc-b633-43f5-bb7b-2575654b2062 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:11.746776 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 352/703] 10.222.0.16 () {56 vars in 1112 bytes} [Thu Jul 14 10:40:11 2022] GET /identity/v3/services?type=network => generated 124 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:40:11.747558 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f1218d-01b0-4272-b800-f9fb612cec9d None admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:11.747920 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98fc8bbc-b633-43f5-bb7b-2575654b2062 None admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:11.770081 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application [None req-98fc8bbc-b633-43f5-bb7b-2575654b2062 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 10:40:11.770081 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:40:11.770081 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:40:11.770081 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:40:11.770081 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:40:11.770081 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:40:11.770081 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:40:11.770081 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:40:11.770081 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:40:11.770081 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:40:11.770081 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:40:11.770081 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:40:11.770081 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 10:40:11.770081 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 10:40:11.770081 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 10:40:11.771172 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 10:40:11.771172 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:40:11.771172 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:40:11.771172 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:40:11.771172 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:40:11.771172 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:40:11.771172 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:40:11.771172 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:40:11.771172 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application with Lock( Jul 14 10:40:11.771172 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:40:11.771172 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:40:11.771172 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:40:11.771172 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:40:11.771172 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:40:11.771172 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:40:11.771172 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:40:11.771172 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:40:11.772047 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 10:40:11.772047 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 10:40:11.772047 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 10:40:11.772047 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application Jul 14 10:40:11.773912 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 352/704] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Jul 14 10:40:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:40:11.775593 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c56134c-623d-49ec-a963-87e3753102bf None None] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:11.776062 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c56134c-623d-49ec-a963-87e3753102bf None None] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:11.776473 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c56134c-623d-49ec-a963-87e3753102bf None None] PATH_INFO: `/` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:11.778410 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 353/705] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jul 14 10:40:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:40:11.784180 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d5e941-a049-4a7c-8ee9-1f5c182639de None None] REQUEST_METHOD: `POST` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:11.784762 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d5e941-a049-4a7c-8ee9-1f5c182639de None None] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:11.785255 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d5e941-a049-4a7c-8ee9-1f5c182639de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:11.799674 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=100 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:11.820725 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.auth.core [None req-83d5e941-a049-4a7c-8ee9-1f5c182639de None None] MFA Rules not processed for user `ae4bcdd8106d4bebbdcae96be33505bc`. Rule list: `[]` (Enabled: `True`). {{(pid=86655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:40:11.823110 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-83d5e941-a049-4a7c-8ee9-1f5c182639de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:40:11.871501 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f1218d-01b0-4272-b800-f9fb612cec9d None admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:11.875279 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=100 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:11.913081 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af0d8de-e10c-4a65-b503-dec2e4d99efb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:11.913791 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af0d8de-e10c-4a65-b503-dec2e4d99efb None admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:11.914133 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af0d8de-e10c-4a65-b503-dec2e4d99efb None admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:11.914477 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af0d8de-e10c-4a65-b503-dec2e4d99efb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:11.915409 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af0d8de-e10c-4a65-b503-dec2e4d99efb None admin] RBAC: Adding query filter params (role.id=d58911e96aad48cf9ca61ac5df79e21d, scope.project.id=59391272ecbe48b0aa736cb43807be1d, user.id=8a23de49b80643eaab7a212f2884d62e) {{(pid=86656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:40:11.915795 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af0d8de-e10c-4a65-b503-dec2e4d99efb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:11.917365 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af0d8de-e10c-4a65-b503-dec2e4d99efb None admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:11.932592 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 353/706] 10.222.0.16 () {56 vars in 1374 bytes} [Thu Jul 14 10:40:11 2022] GET /identity/v3/role_assignments?user.id=8a23de49b80643eaab7a212f2884d62e&scope.project.id=59391272ecbe48b0aa736cb43807be1d&role.id=d58911e96aad48cf9ca61ac5df79e21d => generated 608 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:40:11.932592 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af0d8de-e10c-4a65-b503-dec2e4d99efb None admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:11.936993 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 354/707] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jul 14 10:40:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 10:40:11.955193 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d5e941-a049-4a7c-8ee9-1f5c182639de None None] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:12.075467 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d5e941-a049-4a7c-8ee9-1f5c182639de None None] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:12.095480 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af0d8de-e10c-4a65-b503-dec2e4d99efb None admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:12.141571 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7962cad7-6348-4404-86d2-401d98a44cd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:12.142724 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7962cad7-6348-4404-86d2-401d98a44cd1 None admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:12.143281 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7962cad7-6348-4404-86d2-401d98a44cd1 None admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:12.143848 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7962cad7-6348-4404-86d2-401d98a44cd1 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:12.144907 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7962cad7-6348-4404-86d2-401d98a44cd1 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:12.146598 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c993778-99d6-450b-958d-5e1d8d89a8c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:12.147006 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7962cad7-6348-4404-86d2-401d98a44cd1 None admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:12.147394 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c993778-99d6-450b-958d-5e1d8d89a8c6 None admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:12.147764 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c993778-99d6-450b-958d-5e1d8d89a8c6 None admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:12.148110 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c993778-99d6-450b-958d-5e1d8d89a8c6 None admin] PATH_INFO: `/v3/domains` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:12.148929 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c993778-99d6-450b-958d-5e1d8d89a8c6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:40:12.149307 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c993778-99d6-450b-958d-5e1d8d89a8c6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:12.150223 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=100 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:12.151525 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c993778-99d6-450b-958d-5e1d8d89a8c6 None admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:12.165260 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application [None req-7962cad7-6348-4404-86d2-401d98a44cd1 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 14 10:40:12.165260 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:40:12.165260 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 14 10:40:12.165260 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 14 10:40:12.165260 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 14 10:40:12.165260 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 14 10:40:12.165260 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 14 10:40:12.165260 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 10:40:12.165260 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 14 10:40:12.165260 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application Jul 14 10:40:12.165260 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 10:40:12.165260 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application Jul 14 10:40:12.165260 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:40:12.165260 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:40:12.165260 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:40:12.165260 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:40:12.166539 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:40:12.166539 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:40:12.166539 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:40:12.166539 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:40:12.166539 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:40:12.166539 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:40:12.166539 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:40:12.166539 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 14 10:40:12.166539 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 14 10:40:12.166539 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 14 10:40:12.166539 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 14 10:40:12.166539 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:40:12.166539 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:40:12.166539 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:40:12.166539 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:40:12.166539 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:40:12.167359 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:40:12.167359 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:40:12.167359 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application with Lock( Jul 14 10:40:12.167359 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:40:12.167359 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:40:12.167359 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:40:12.167359 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:40:12.167359 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:40:12.167359 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:40:12.167359 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:40:12.167359 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:40:12.167359 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 14 10:40:12.167359 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 10:40:12.167359 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 14 10:40:12.167359 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application Jul 14 10:40:12.168117 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 354/708] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Jul 14 10:40:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:40:12.170372 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 355/709] 10.222.0.16 () {56 vars in 1129 bytes} [Thu Jul 14 10:40:11 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 10:40:12.170484 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c993778-99d6-450b-958d-5e1d8d89a8c6 None admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:12.177780 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7962cad7-6348-4404-86d2-401d98a44cd1 None admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:12.202701 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=100 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:12.284860 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c993778-99d6-450b-958d-5e1d8d89a8c6 None admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:12.313670 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7962cad7-6348-4404-86d2-401d98a44cd1 None admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:12.324374 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f16a67-adc0-4411-99dd-c445742c5c81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:12.325457 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f16a67-adc0-4411-99dd-c445742c5c81 None admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:12.325898 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f16a67-adc0-4411-99dd-c445742c5c81 None admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:12.326268 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f16a67-adc0-4411-99dd-c445742c5c81 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:12.334678 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f16a67-adc0-4411-99dd-c445742c5c81 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:12.336271 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f16a67-adc0-4411-99dd-c445742c5c81 None admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:12.351978 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application [None req-55f16a67-adc0-4411-99dd-c445742c5c81 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 10:40:12.351978 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:40:12.351978 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:40:12.351978 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:40:12.351978 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:40:12.351978 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:40:12.351978 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:40:12.351978 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:40:12.351978 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:40:12.351978 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:40:12.351978 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:40:12.351978 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:40:12.351978 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 10:40:12.351978 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 10:40:12.351978 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 10:40:12.353117 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 10:40:12.353117 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:40:12.353117 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:40:12.353117 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:40:12.353117 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:40:12.353117 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:40:12.353117 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:40:12.353117 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:40:12.353117 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application with Lock( Jul 14 10:40:12.353117 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:40:12.353117 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:40:12.353117 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:40:12.353117 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:40:12.353117 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:40:12.353117 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:40:12.353117 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:40:12.353117 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:40:12.354212 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 10:40:12.354212 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 10:40:12.354212 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 10:40:12.354212 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 10:40:12.354212 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 10:40:12.354212 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 10:40:12.354212 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 10:40:12.354212 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application Jul 14 10:40:12.355890 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 355/710] 10.222.0.16 () {56 vars in 1111 bytes} [Thu Jul 14 10:40:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:40:12.362970 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3398b3-bde2-4da1-91eb-08e1b5b96ff9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:12.362970 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3398b3-bde2-4da1-91eb-08e1b5b96ff9 None admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:12.362970 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3398b3-bde2-4da1-91eb-08e1b5b96ff9 None admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:12.362970 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3398b3-bde2-4da1-91eb-08e1b5b96ff9 None admin] PATH_INFO: `/v3/services` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:12.363493 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3398b3-bde2-4da1-91eb-08e1b5b96ff9 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=86655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:40:12.363802 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3398b3-bde2-4da1-91eb-08e1b5b96ff9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:12.368307 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f16a67-adc0-4411-99dd-c445742c5c81 None admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:12.368449 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3398b3-bde2-4da1-91eb-08e1b5b96ff9 None admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:12.373154 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 356/711] 10.222.0.16 () {56 vars in 1124 bytes} [Thu Jul 14 10:40:12 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:40:12.381225 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3398b3-bde2-4da1-91eb-08e1b5b96ff9 None admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:12.463339 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=100 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:12.499967 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=100 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:12.508264 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3398b3-bde2-4da1-91eb-08e1b5b96ff9 None admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:12.522003 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f16a67-adc0-4411-99dd-c445742c5c81 None admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:12.543399 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98119f8-6b98-4f63-a03a-b5e10f19c97e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:12.544076 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98119f8-6b98-4f63-a03a-b5e10f19c97e None admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:12.544369 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98119f8-6b98-4f63-a03a-b5e10f19c97e None admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:12.544653 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98119f8-6b98-4f63-a03a-b5e10f19c97e None admin] PATH_INFO: `/v3/services` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:12.545421 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98119f8-6b98-4f63-a03a-b5e10f19c97e None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=86655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:40:12.545706 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98119f8-6b98-4f63-a03a-b5e10f19c97e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:12.547810 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98119f8-6b98-4f63-a03a-b5e10f19c97e None admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:12.554104 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 357/712] 10.222.0.16 () {56 vars in 1124 bytes} [Thu Jul 14 10:40:12 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:40:12.555369 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b786920-43e8-4aaf-8ce2-f70d040d2d7c None None] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:12.555656 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b786920-43e8-4aaf-8ce2-f70d040d2d7c None None] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:12.555937 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b786920-43e8-4aaf-8ce2-f70d040d2d7c None None] PATH_INFO: `/` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:12.561388 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 358/713] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jul 14 10:40:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:40:12.563745 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7441c62-da73-4b3a-910f-d4130e8bc4b7 None None] REQUEST_METHOD: `POST` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:12.564033 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7441c62-da73-4b3a-910f-d4130e8bc4b7 None None] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:12.564311 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7441c62-da73-4b3a-910f-d4130e8bc4b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:12.567105 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011781b9-35aa-47a2-a9d3-2f714104dff9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:12.567803 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011781b9-35aa-47a2-a9d3-2f714104dff9 None admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:12.568088 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011781b9-35aa-47a2-a9d3-2f714104dff9 None admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:12.568365 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011781b9-35aa-47a2-a9d3-2f714104dff9 None admin] PATH_INFO: `/v3/projects` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:12.569282 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011781b9-35aa-47a2-a9d3-2f714104dff9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:40:12.569602 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011781b9-35aa-47a2-a9d3-2f714104dff9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:12.571115 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011781b9-35aa-47a2-a9d3-2f714104dff9 None admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:12.585701 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.auth.core [None req-d7441c62-da73-4b3a-910f-d4130e8bc4b7 None None] MFA Rules not processed for user `ae4bcdd8106d4bebbdcae96be33505bc`. Rule list: `[]` (Enabled: `True`). {{(pid=86655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:40:12.587313 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 356/714] 10.222.0.16 () {56 vars in 1148 bytes} [Thu Jul 14 10:40:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:40:12.587536 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-d7441c62-da73-4b3a-910f-d4130e8bc4b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:40:12.597894 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011781b9-35aa-47a2-a9d3-2f714104dff9 None admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:12.676939 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 359/715] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jul 14 10:40:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 10:40:12.700507 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7441c62-da73-4b3a-910f-d4130e8bc4b7 None None] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:12.767902 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=100 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:12.788091 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011781b9-35aa-47a2-a9d3-2f714104dff9 None admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:12.817123 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7441c62-da73-4b3a-910f-d4130e8bc4b7 None None] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:12.834352 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e1fd22-8068-4ee1-920b-87ca23c10803 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:12.835131 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e1fd22-8068-4ee1-920b-87ca23c10803 None admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:12.835481 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e1fd22-8068-4ee1-920b-87ca23c10803 None admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:12.835821 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e1fd22-8068-4ee1-920b-87ca23c10803 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:12.836949 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e1fd22-8068-4ee1-920b-87ca23c10803 None admin] RBAC: Adding query filter params (role.id=153539819e5542df99269d2913bbecfb, scope.project.id=59391272ecbe48b0aa736cb43807be1d, user.id=26aa294c913c408499a913ec25bb677d) {{(pid=86656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:40:12.837423 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e1fd22-8068-4ee1-920b-87ca23c10803 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:12.839011 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e1fd22-8068-4ee1-920b-87ca23c10803 None admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:12.847926 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 357/716] 10.222.0.16 () {56 vars in 1374 bytes} [Thu Jul 14 10:40:12 2022] GET /identity/v3/role_assignments?user.id=26aa294c913c408499a913ec25bb677d&scope.project.id=59391272ecbe48b0aa736cb43807be1d&role.id=153539819e5542df99269d2913bbecfb => generated 259 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:40:12.858325 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6665c64-51fc-4d5b-aadf-40d1747b54b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:12.859340 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6665c64-51fc-4d5b-aadf-40d1747b54b9 None admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:12.859704 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6665c64-51fc-4d5b-aadf-40d1747b54b9 None admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:12.860056 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6665c64-51fc-4d5b-aadf-40d1747b54b9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:12.889352 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6665c64-51fc-4d5b-aadf-40d1747b54b9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:12.891612 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6665c64-51fc-4d5b-aadf-40d1747b54b9 None admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:12.927287 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application [None req-c6665c64-51fc-4d5b-aadf-40d1747b54b9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 10:40:12.927287 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:40:12.927287 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:40:12.927287 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:40:12.927287 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:40:12.927287 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:40:12.927287 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:40:12.927287 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:40:12.927287 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:40:12.927287 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:40:12.927287 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:40:12.927287 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:40:12.927287 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 10:40:12.927287 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 10:40:12.927287 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 10:40:12.928281 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 10:40:12.928281 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:40:12.928281 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:40:12.928281 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:40:12.928281 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:40:12.928281 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:40:12.928281 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:40:12.928281 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:40:12.928281 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application with Lock( Jul 14 10:40:12.928281 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:40:12.928281 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:40:12.928281 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:40:12.928281 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:40:12.928281 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:40:12.928281 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:40:12.928281 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:40:12.928281 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:40:12.929217 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 10:40:12.929217 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 10:40:12.929217 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 10:40:12.929217 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application Jul 14 10:40:12.929217 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 360/717] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Jul 14 10:40:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 10:40:12.934754 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e1fd22-8068-4ee1-920b-87ca23c10803 None admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:12.970264 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=100 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:13.094287 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e1fd22-8068-4ee1-920b-87ca23c10803 None admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:13.133921 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb5aaff-09d0-4849-bce2-89180c6e8f59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:13.135122 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb5aaff-09d0-4849-bce2-89180c6e8f59 None admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:13.135475 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb5aaff-09d0-4849-bce2-89180c6e8f59 None admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:13.135768 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb5aaff-09d0-4849-bce2-89180c6e8f59 None admin] PATH_INFO: `/v3/domains` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:13.137088 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb5aaff-09d0-4849-bce2-89180c6e8f59 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:40:13.137600 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb5aaff-09d0-4849-bce2-89180c6e8f59 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:13.139029 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb5aaff-09d0-4849-bce2-89180c6e8f59 None admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:13.280489 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 358/718] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Jul 14 10:40:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 346 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:40:13.285927 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6665c64-51fc-4d5b-aadf-40d1747b54b9 None admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:13.429088 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6665c64-51fc-4d5b-aadf-40d1747b54b9 None admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:13.443201 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=100 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:13.487942 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbd1772-0b80-4ebb-a750-adca516d3e3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:13.489060 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbd1772-0b80-4ebb-a750-adca516d3e3a None admin] REQUEST_METHOD: `POST` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:13.489345 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbd1772-0b80-4ebb-a750-adca516d3e3a None admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:13.489625 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbd1772-0b80-4ebb-a750-adca516d3e3a None admin] PATH_INFO: `/v3/users` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:13.490437 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbbd1772-0b80-4ebb-a750-adca516d3e3a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:13.491970 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbbd1772-0b80-4ebb-a750-adca516d3e3a None admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:13.514302 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 361/719] 10.222.0.16 () {60 vars in 1132 bytes} [Thu Jul 14 10:40:13 2022] POST /identity/v3/users => generated 254 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 10:40:14.457257 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c9c22d-a4fc-4fe2-8759-9a1934e5dedb None None] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:14.458292 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c9c22d-a4fc-4fe2-8759-9a1934e5dedb None None] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:14.458794 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c9c22d-a4fc-4fe2-8759-9a1934e5dedb None None] PATH_INFO: `/` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:14.460604 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 359/720] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jul 14 10:40:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:40:14.466098 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb187cb-aac5-4987-83d8-f3dcecfeaf01 None None] REQUEST_METHOD: `POST` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:14.466906 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb187cb-aac5-4987-83d8-f3dcecfeaf01 None None] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:14.467380 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb187cb-aac5-4987-83d8-f3dcecfeaf01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:14.486392 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.auth.core [None req-9bb187cb-aac5-4987-83d8-f3dcecfeaf01 None None] MFA Rules not processed for user `ae4bcdd8106d4bebbdcae96be33505bc`. Rule list: `[]` (Enabled: `True`). {{(pid=86655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:40:14.487896 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-9bb187cb-aac5-4987-83d8-f3dcecfeaf01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:40:14.570533 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 362/721] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jul 14 10:40:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 14 10:40:14.603644 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c9c22d-a4fc-4fe2-8759-9a1934e5dedb None None] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:14.709779 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=100 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:14.752673 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c9c22d-a4fc-4fe2-8759-9a1934e5dedb None None] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:14.787103 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e551608-08f1-4619-83d5-762646d29dca None None] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:14.787399 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e551608-08f1-4619-83d5-762646d29dca None None] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:14.787937 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e551608-08f1-4619-83d5-762646d29dca None None] PATH_INFO: `/` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:14.789836 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 363/722] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jul 14 10:40:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:40:14.796481 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac8e186-97c8-427d-a5db-c5db117e881b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:14.796481 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac8e186-97c8-427d-a5db-c5db117e881b None admin] REQUEST_METHOD: `POST` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:14.796481 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac8e186-97c8-427d-a5db-c5db117e881b None admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:14.796481 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac8e186-97c8-427d-a5db-c5db117e881b None admin] PATH_INFO: `/v3/services` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:14.797259 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac8e186-97c8-427d-a5db-c5db117e881b None admin] RBAC: Authorizing `identity:create_service()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:14.798663 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac8e186-97c8-427d-a5db-c5db117e881b None admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:14.801732 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16dd330b-af4d-404b-acc8-00704e64b33d None None] REQUEST_METHOD: `POST` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:14.802244 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16dd330b-af4d-404b-acc8-00704e64b33d None None] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:14.802741 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16dd330b-af4d-404b-acc8-00704e64b33d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:14.816356 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 360/723] 10.222.0.16 () {60 vars in 1141 bytes} [Thu Jul 14 10:40:14 2022] POST /identity/v3/services => generated 240 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:40:14.824269 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.auth.core [None req-16dd330b-af4d-404b-acc8-00704e64b33d None None] MFA Rules not processed for user `ae4bcdd8106d4bebbdcae96be33505bc`. Rule list: `[]` (Enabled: `True`). {{(pid=86655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:40:14.825934 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-16dd330b-af4d-404b-acc8-00704e64b33d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:40:14.909585 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 364/724] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jul 14 10:40:14 2022] POST /identity/v3/auth/tokens => generated 898 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 14 10:40:14.934400 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac8e186-97c8-427d-a5db-c5db117e881b None admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:15.047086 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac8e186-97c8-427d-a5db-c5db117e881b None admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:15.079762 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:15.090707 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afff2f1-a0f4-494e-806e-e5e960ee9237 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:15.091846 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afff2f1-a0f4-494e-806e-e5e960ee9237 None admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:15.092352 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afff2f1-a0f4-494e-806e-e5e960ee9237 None admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:15.093386 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afff2f1-a0f4-494e-806e-e5e960ee9237 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:15.109864 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6afff2f1-a0f4-494e-806e-e5e960ee9237 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 10:40:15.118244 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application [None req-6afff2f1-a0f4-494e-806e-e5e960ee9237 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 10:40:15.118244 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:40:15.118244 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:40:15.118244 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:40:15.118244 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:40:15.118244 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:40:15.118244 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:40:15.118244 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:40:15.118244 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:40:15.118244 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:40:15.118244 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:40:15.118244 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:40:15.118244 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 10:40:15.118244 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 10:40:15.118244 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 10:40:15.118244 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 10:40:15.119194 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 10:40:15.119194 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 10:40:15.119194 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 10:40:15.119194 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 10:40:15.119194 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:40:15.119194 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:40:15.119194 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:40:15.119194 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:40:15.119194 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:40:15.119194 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:40:15.119194 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:40:15.119194 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application with Lock( Jul 14 10:40:15.119194 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:40:15.119194 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:40:15.119194 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:40:15.119194 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:40:15.120056 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:40:15.120056 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:40:15.120056 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:40:15.120056 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:40:15.120056 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 10:40:15.120056 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 10:40:15.120056 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 10:40:15.120056 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 10:40:15.120056 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 10:40:15.120056 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 10:40:15.120056 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 10:40:15.120056 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application Jul 14 10:40:15.122445 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 361/725] 10.222.0.16 () {56 vars in 1096 bytes} [Thu Jul 14 10:40:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:40:15.128917 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16dd330b-af4d-404b-acc8-00704e64b33d None None] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:15.152798 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:15.171581 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd177b7-5e29-4844-b2da-7b78504e84d2 None None] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:15.171965 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd177b7-5e29-4844-b2da-7b78504e84d2 None None] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:15.172137 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd177b7-5e29-4844-b2da-7b78504e84d2 None None] PATH_INFO: `/` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:15.174777 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 362/726] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jul 14 10:40:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:40:15.179625 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8f2a5f-0146-4ab3-af6a-e9d820a9a100 None None] REQUEST_METHOD: `POST` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:15.179918 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8f2a5f-0146-4ab3-af6a-e9d820a9a100 None None] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:15.180200 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8f2a5f-0146-4ab3-af6a-e9d820a9a100 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:15.201559 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.auth.core [None req-4d8f2a5f-0146-4ab3-af6a-e9d820a9a100 None None] MFA Rules not processed for user `ae4bcdd8106d4bebbdcae96be33505bc`. Rule list: `[]` (Enabled: `True`). {{(pid=86656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:40:15.203139 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-4d8f2a5f-0146-4ab3-af6a-e9d820a9a100 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:40:15.255882 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16dd330b-af4d-404b-acc8-00704e64b33d None None] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:15.296949 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 363/727] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jul 14 10:40:15 2022] POST /identity/v3/auth/tokens => generated 898 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 14 10:40:15.298427 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36beff5a-8dbc-4719-b3e2-ce25b1ce2b1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:15.299320 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36beff5a-8dbc-4719-b3e2-ce25b1ce2b1c None admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:15.299807 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36beff5a-8dbc-4719-b3e2-ce25b1ce2b1c None admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:15.300269 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36beff5a-8dbc-4719-b3e2-ce25b1ce2b1c None admin] PATH_INFO: `/v3/roles` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:15.301248 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36beff5a-8dbc-4719-b3e2-ce25b1ce2b1c None admin] RBAC: Adding query filter params (name=admin) {{(pid=86655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:40:15.301780 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36beff5a-8dbc-4719-b3e2-ce25b1ce2b1c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:15.303373 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36beff5a-8dbc-4719-b3e2-ce25b1ce2b1c None admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:15.313625 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 365/728] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Jul 14 10:40:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:40:15.313873 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8f2a5f-0146-4ab3-af6a-e9d820a9a100 None None] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:15.319574 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36beff5a-8dbc-4719-b3e2-ce25b1ce2b1c None admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:15.411358 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=100 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:15.417521 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8f2a5f-0146-4ab3-af6a-e9d820a9a100 None None] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:15.444020 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36beff5a-8dbc-4719-b3e2-ce25b1ce2b1c None admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:15.446045 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=100 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:15.462447 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246ebbb3-6030-4621-b4a8-32a6d86e0504 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:15.464431 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246ebbb3-6030-4621-b4a8-32a6d86e0504 None admin] REQUEST_METHOD: `POST` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:15.464998 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246ebbb3-6030-4621-b4a8-32a6d86e0504 None admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:15.465478 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246ebbb3-6030-4621-b4a8-32a6d86e0504 None admin] PATH_INFO: `/v3/services` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:15.466426 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246ebbb3-6030-4621-b4a8-32a6d86e0504 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:15.468863 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246ebbb3-6030-4621-b4a8-32a6d86e0504 None admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:15.482758 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f49b09f-f50a-4f58-88f8-33ddd7d8ed1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:15.484512 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f49b09f-f50a-4f58-88f8-33ddd7d8ed1e None admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:15.485026 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f49b09f-f50a-4f58-88f8-33ddd7d8ed1e None admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:15.485317 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f49b09f-f50a-4f58-88f8-33ddd7d8ed1e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:15.500873 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 364/729] 10.222.0.16 () {60 vars in 1141 bytes} [Thu Jul 14 10:40:15 2022] POST /identity/v3/services => generated 251 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:40:15.502180 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f49b09f-f50a-4f58-88f8-33ddd7d8ed1e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:15.502464 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf210ca-c6a6-42a9-849f-5ec43baf7a7b None None] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:15.502754 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf210ca-c6a6-42a9-849f-5ec43baf7a7b None None] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:15.503036 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf210ca-c6a6-42a9-849f-5ec43baf7a7b None None] PATH_INFO: `/` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:15.503797 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f49b09f-f50a-4f58-88f8-33ddd7d8ed1e None admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:15.504728 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 365/730] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jul 14 10:40:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:40:15.514329 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53e5212-333f-47b3-a550-70262e6f261e None None] REQUEST_METHOD: `POST` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:15.515151 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53e5212-333f-47b3-a550-70262e6f261e None None] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:15.515429 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53e5212-333f-47b3-a550-70262e6f261e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:15.525906 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application [None req-8f49b09f-f50a-4f58-88f8-33ddd7d8ed1e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 10:40:15.525906 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:40:15.525906 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:40:15.525906 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:40:15.525906 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:40:15.525906 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:40:15.525906 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:40:15.525906 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:40:15.525906 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:40:15.525906 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:40:15.525906 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:40:15.525906 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:40:15.525906 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 10:40:15.525906 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 10:40:15.525906 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 10:40:15.527010 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 10:40:15.527010 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:40:15.527010 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:40:15.527010 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:40:15.527010 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:40:15.527010 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:40:15.527010 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:40:15.527010 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:40:15.527010 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application with Lock( Jul 14 10:40:15.527010 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:40:15.527010 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:40:15.527010 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:40:15.527010 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:40:15.527010 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:40:15.527010 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:40:15.527010 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:40:15.527010 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:40:15.528143 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 10:40:15.528143 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 10:40:15.528143 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 10:40:15.528143 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application Jul 14 10:40:15.530264 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 366/731] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Jul 14 10:40:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 10:40:15.536139 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f49b09f-f50a-4f58-88f8-33ddd7d8ed1e None admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:15.562132 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.auth.core [None req-f53e5212-333f-47b3-a550-70262e6f261e None None] MFA Rules not processed for user `ae4bcdd8106d4bebbdcae96be33505bc`. Rule list: `[]` (Enabled: `True`). {{(pid=86656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:40:15.563520 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-f53e5212-333f-47b3-a550-70262e6f261e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:40:15.675357 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 366/732] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jul 14 10:40:15 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 10:40:15.715390 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f49b09f-f50a-4f58-88f8-33ddd7d8ed1e None admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:15.719789 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53e5212-333f-47b3-a550-70262e6f261e None None] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:15.753731 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5fe9eb-e3aa-4504-bde6-377364712fba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:15.754632 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5fe9eb-e3aa-4504-bde6-377364712fba None admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:15.754632 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5fe9eb-e3aa-4504-bde6-377364712fba None admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:15.754632 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5fe9eb-e3aa-4504-bde6-377364712fba None admin] PATH_INFO: `/v3/domains` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:15.755284 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5fe9eb-e3aa-4504-bde6-377364712fba None admin] RBAC: Adding query filter params (name=Default) {{(pid=86655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:40:15.755592 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5fe9eb-e3aa-4504-bde6-377364712fba None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:15.757534 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5fe9eb-e3aa-4504-bde6-377364712fba None admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:15.759558 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=100 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:15.772558 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 367/733] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Jul 14 10:40:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:40:15.784207 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5fe9eb-e3aa-4504-bde6-377364712fba None admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:15.863419 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53e5212-333f-47b3-a550-70262e6f261e None None] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:15.875432 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:15.912571 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf582f2-b6ed-4a08-9f34-98ddb26b9c14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:15.913414 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf582f2-b6ed-4a08-9f34-98ddb26b9c14 None admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:15.913707 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf582f2-b6ed-4a08-9f34-98ddb26b9c14 None admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:15.914145 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf582f2-b6ed-4a08-9f34-98ddb26b9c14 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:15.926149 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf582f2-b6ed-4a08-9f34-98ddb26b9c14 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 10:40:15.927247 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5fe9eb-e3aa-4504-bde6-377364712fba None admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:15.935138 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application [None req-acf582f2-b6ed-4a08-9f34-98ddb26b9c14 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 10:40:15.935138 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:40:15.935138 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:40:15.935138 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:40:15.935138 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:40:15.935138 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:40:15.935138 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:40:15.935138 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:40:15.935138 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:40:15.935138 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:40:15.935138 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:40:15.935138 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:40:15.935138 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 10:40:15.935138 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 10:40:15.935138 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 10:40:15.935138 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 10:40:15.936861 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 10:40:15.936861 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 10:40:15.936861 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 10:40:15.936861 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 10:40:15.936861 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:40:15.936861 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:40:15.936861 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:40:15.936861 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:40:15.936861 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:40:15.936861 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:40:15.936861 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:40:15.936861 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application with Lock( Jul 14 10:40:15.936861 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:40:15.936861 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:40:15.936861 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:40:15.936861 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:40:15.937851 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:40:15.937851 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:40:15.937851 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:40:15.937851 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:40:15.937851 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 10:40:15.937851 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 10:40:15.937851 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 10:40:15.937851 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 10:40:15.937851 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 10:40:15.937851 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 10:40:15.937851 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 10:40:15.937851 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application Jul 14 10:40:15.937851 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 367/734] 10.222.0.16 () {56 vars in 1096 bytes} [Thu Jul 14 10:40:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 10:40:15.948353 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf582f2-b6ed-4a08-9f34-98ddb26b9c14 None admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:16.021511 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c44c1c5-0b08-439d-b9fd-b67932811b47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:16.022327 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c44c1c5-0b08-439d-b9fd-b67932811b47 None admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:16.022612 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c44c1c5-0b08-439d-b9fd-b67932811b47 None admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:16.022888 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c44c1c5-0b08-439d-b9fd-b67932811b47 None admin] PATH_INFO: `/v3/users/swift` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:16.042066 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c44c1c5-0b08-439d-b9fd-b67932811b47 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:16.043536 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c44c1c5-0b08-439d-b9fd-b67932811b47 None admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:16.065558 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf582f2-b6ed-4a08-9f34-98ddb26b9c14 None admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:16.073191 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application [None req-7c44c1c5-0b08-439d-b9fd-b67932811b47 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 14 10:40:16.073191 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:40:16.073191 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:40:16.073191 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:40:16.073191 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:40:16.073191 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:40:16.073191 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:40:16.073191 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:40:16.073191 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:40:16.073191 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:40:16.073191 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:40:16.073191 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:40:16.073191 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 10:40:16.073191 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 10:40:16.073191 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 10:40:16.073191 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 10:40:16.074099 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:40:16.074099 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:40:16.074099 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 10:40:16.074099 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 10:40:16.074099 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 10:40:16.074099 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 10:40:16.074099 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:40:16.074099 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:40:16.074099 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:40:16.074099 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:40:16.074099 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:40:16.074099 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application with Lock( Jul 14 10:40:16.074099 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:40:16.074099 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:40:16.074099 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:40:16.074099 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:40:16.074099 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:40:16.074099 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:40:16.075059 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:40:16.075059 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:40:16.075059 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 10:40:16.075059 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 10:40:16.075059 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 10:40:16.075059 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 10:40:16.075059 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 10:40:16.075059 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 10:40:16.075059 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 14 10:40:16.075059 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application Jul 14 10:40:16.075059 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 368/735] 10.222.0.16 () {56 vars in 1096 bytes} [Thu Jul 14 10:40:15 2022] GET /identity/v3/users/swift => generated 83 bytes in 291 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:40:16.095689 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c44c1c5-0b08-439d-b9fd-b67932811b47 None admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:16.111674 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394df92d-bac4-493d-ab66-ed3501f61b2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:16.112360 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394df92d-bac4-493d-ab66-ed3501f61b2c None admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:16.112649 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394df92d-bac4-493d-ab66-ed3501f61b2c None admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:16.112956 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394df92d-bac4-493d-ab66-ed3501f61b2c None admin] PATH_INFO: `/v3/roles` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:16.113783 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394df92d-bac4-493d-ab66-ed3501f61b2c None admin] RBAC: Adding query filter params (name=admin) {{(pid=86656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:40:16.114045 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394df92d-bac4-493d-ab66-ed3501f61b2c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:16.115926 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394df92d-bac4-493d-ab66-ed3501f61b2c None admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:16.126148 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 368/736] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Jul 14 10:40:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 10:40:16.131821 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394df92d-bac4-493d-ab66-ed3501f61b2c None admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:16.167367 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=100 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:16.207987 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=100 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:16.267079 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c44c1c5-0b08-439d-b9fd-b67932811b47 None admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:16.290704 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394df92d-bac4-493d-ab66-ed3501f61b2c None admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:16.305966 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9cd563b-b233-47fd-8206-d66ecba85175 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:16.306680 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cd563b-b233-47fd-8206-d66ecba85175 None admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:16.307424 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cd563b-b233-47fd-8206-d66ecba85175 None admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:16.307717 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cd563b-b233-47fd-8206-d66ecba85175 None admin] PATH_INFO: `/v3/users` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:16.308578 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9cd563b-b233-47fd-8206-d66ecba85175 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=86655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:40:16.308919 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9cd563b-b233-47fd-8206-d66ecba85175 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:16.311057 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9cd563b-b233-47fd-8206-d66ecba85175 None admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:16.332059 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 369/737] 10.222.0.16 () {56 vars in 1135 bytes} [Thu Jul 14 10:40:16 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 10:40:16.338057 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9cd563b-b233-47fd-8206-d66ecba85175 None admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:16.381566 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed0104d-6a10-4820-afdc-433a45825f84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:16.382664 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed0104d-6a10-4820-afdc-433a45825f84 None admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:16.383127 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed0104d-6a10-4820-afdc-433a45825f84 None admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:16.383577 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed0104d-6a10-4820-afdc-433a45825f84 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:16.409923 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed0104d-6a10-4820-afdc-433a45825f84 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:16.411833 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed0104d-6a10-4820-afdc-433a45825f84 None admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:16.452854 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9cd563b-b233-47fd-8206-d66ecba85175 None admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:16.456986 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application [None req-3ed0104d-6a10-4820-afdc-433a45825f84 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 10:40:16.456986 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:40:16.456986 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:40:16.456986 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:40:16.456986 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:40:16.456986 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:40:16.456986 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:40:16.456986 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:40:16.456986 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:40:16.456986 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:40:16.456986 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:40:16.456986 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:40:16.456986 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 10:40:16.456986 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 10:40:16.456986 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 10:40:16.457853 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 10:40:16.457853 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:40:16.457853 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:40:16.457853 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:40:16.457853 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:40:16.457853 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:40:16.457853 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:40:16.457853 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:40:16.457853 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application with Lock( Jul 14 10:40:16.457853 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:40:16.457853 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:40:16.457853 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:40:16.457853 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:40:16.457853 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:40:16.457853 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:40:16.457853 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:40:16.457853 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:40:16.458742 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 10:40:16.458742 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 10:40:16.458742 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 10:40:16.458742 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application Jul 14 10:40:16.458742 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 369/738] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Jul 14 10:40:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 327 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:40:16.469848 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed0104d-6a10-4820-afdc-433a45825f84 None admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:16.472699 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=100 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:16.499888 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38c441a-f1f3-4962-981e-98610595bd0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:16.500599 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38c441a-f1f3-4962-981e-98610595bd0c None admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:16.500869 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38c441a-f1f3-4962-981e-98610595bd0c None admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:16.501164 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38c441a-f1f3-4962-981e-98610595bd0c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:16.575559 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38c441a-f1f3-4962-981e-98610595bd0c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:16.577224 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38c441a-f1f3-4962-981e-98610595bd0c None admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:16.681264 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=100 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:16.695852 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 370/739] 10.222.0.16 () {58 vars in 1282 bytes} [Thu Jul 14 10:40:16 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 14 10:40:16.701923 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38c441a-f1f3-4962-981e-98610595bd0c None admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:16.722325 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed0104d-6a10-4820-afdc-433a45825f84 None admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:16.729104 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=100 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:16.766639 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2dbe13-9a27-4e2e-92a5-4edc40b3a52f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:16.767339 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2dbe13-9a27-4e2e-92a5-4edc40b3a52f None admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:16.767629 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2dbe13-9a27-4e2e-92a5-4edc40b3a52f None admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:16.768006 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2dbe13-9a27-4e2e-92a5-4edc40b3a52f None admin] PATH_INFO: `/v3/domains` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:16.768808 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2dbe13-9a27-4e2e-92a5-4edc40b3a52f None admin] RBAC: Adding query filter params (name=Default) {{(pid=86656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:40:16.769130 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2dbe13-9a27-4e2e-92a5-4edc40b3a52f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:16.770653 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2dbe13-9a27-4e2e-92a5-4edc40b3a52f None admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:16.789225 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 370/740] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Jul 14 10:40:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 315 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:40:16.789225 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1780a442-f69e-4438-bf6e-71d85abd5c2d None None] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:16.789225 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1780a442-f69e-4438-bf6e-71d85abd5c2d None None] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:16.789225 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1780a442-f69e-4438-bf6e-71d85abd5c2d None None] PATH_INFO: `/` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:16.789225 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 371/741] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jul 14 10:40:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:40:16.789225 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1780a442-f69e-4438-bf6e-71d85abd5c2d None None] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:16.841374 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38c441a-f1f3-4962-981e-98610595bd0c None admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:16.880658 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f39dfc5-b2c5-4e65-8853-50d62a4a57ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:16.881587 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f39dfc5-b2c5-4e65-8853-50d62a4a57ff None admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:16.881981 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f39dfc5-b2c5-4e65-8853-50d62a4a57ff None admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:16.882266 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f39dfc5-b2c5-4e65-8853-50d62a4a57ff None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:16.893538 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f39dfc5-b2c5-4e65-8853-50d62a4a57ff None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:16.895236 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f39dfc5-b2c5-4e65-8853-50d62a4a57ff None admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:16.898744 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1780a442-f69e-4438-bf6e-71d85abd5c2d None None] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:16.914673 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application [None req-6f39dfc5-b2c5-4e65-8853-50d62a4a57ff None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 10:40:16.914673 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:40:16.914673 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:40:16.914673 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:40:16.914673 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:40:16.914673 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:40:16.914673 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:40:16.914673 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:40:16.914673 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:40:16.914673 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:40:16.914673 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:40:16.914673 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:40:16.914673 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 10:40:16.914673 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 10:40:16.914673 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 10:40:16.915594 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 10:40:16.915594 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:40:16.915594 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:40:16.915594 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:40:16.915594 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:40:16.915594 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:40:16.915594 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:40:16.915594 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:40:16.915594 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application with Lock( Jul 14 10:40:16.915594 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:40:16.915594 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:40:16.915594 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:40:16.915594 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:40:16.915594 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:40:16.915594 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:40:16.915594 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:40:16.915594 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:40:16.916979 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 10:40:16.916979 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 10:40:16.916979 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 10:40:16.916979 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application Jul 14 10:40:16.920508 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 371/742] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Jul 14 10:40:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:40:16.922051 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a78315-eb9c-4c50-a525-a5c6687af9f1 None None] REQUEST_METHOD: `POST` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:16.922350 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a78315-eb9c-4c50-a525-a5c6687af9f1 None None] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:16.922636 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a78315-eb9c-4c50-a525-a5c6687af9f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:16.937589 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d11d62a-36b2-4b4d-9afa-229f3fa2b5f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:16.938370 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d11d62a-36b2-4b4d-9afa-229f3fa2b5f7 None admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:16.938655 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d11d62a-36b2-4b4d-9afa-229f3fa2b5f7 None admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:16.938990 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d11d62a-36b2-4b4d-9afa-229f3fa2b5f7 None admin] PATH_INFO: `/v3/users/nova` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:16.941512 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.auth.core [None req-f9a78315-eb9c-4c50-a525-a5c6687af9f1 None None] MFA Rules not processed for user `ae4bcdd8106d4bebbdcae96be33505bc`. Rule list: `[]` (Enabled: `True`). {{(pid=86655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:40:16.942833 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-f9a78315-eb9c-4c50-a525-a5c6687af9f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:40:16.947098 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d11d62a-36b2-4b4d-9afa-229f3fa2b5f7 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:16.948593 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d11d62a-36b2-4b4d-9afa-229f3fa2b5f7 None admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:16.964738 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application [None req-0d11d62a-36b2-4b4d-9afa-229f3fa2b5f7 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 14 10:40:16.964738 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:40:16.964738 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:40:16.964738 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:40:16.964738 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:40:16.964738 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:40:16.964738 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:40:16.964738 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:40:16.964738 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:40:16.964738 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:40:16.964738 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:40:16.964738 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:40:16.964738 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 10:40:16.964738 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 10:40:16.964738 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 10:40:16.964738 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 10:40:16.966892 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:40:16.966892 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:40:16.966892 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 10:40:16.966892 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 10:40:16.966892 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 10:40:16.966892 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 10:40:16.966892 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:40:16.966892 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:40:16.966892 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:40:16.966892 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:40:16.966892 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:40:16.966892 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application with Lock( Jul 14 10:40:16.966892 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:40:16.966892 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:40:16.966892 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:40:16.966892 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:40:16.966892 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:40:16.966892 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:40:16.968698 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:40:16.968698 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:40:16.968698 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 10:40:16.968698 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 10:40:16.968698 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 10:40:16.968698 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 10:40:16.968698 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 10:40:16.968698 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 10:40:16.968698 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 14 10:40:16.968698 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application Jul 14 10:40:16.968698 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 372/743] 10.222.0.16 () {56 vars in 1093 bytes} [Thu Jul 14 10:40:16 2022] GET /identity/v3/users/nova => generated 82 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:40:16.968698 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d11d62a-36b2-4b4d-9afa-229f3fa2b5f7 None admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:16.974018 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=100 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:17.013258 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=100 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:17.029033 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 372/744] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jul 14 10:40:16 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 10:40:17.030252 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a78315-eb9c-4c50-a525-a5c6687af9f1 None None] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:17.090088 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d11d62a-36b2-4b4d-9afa-229f3fa2b5f7 None admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:17.134827 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769dce9b-f217-4234-aaa1-8cc2a59cd916 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:17.135718 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769dce9b-f217-4234-aaa1-8cc2a59cd916 None admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:17.136102 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769dce9b-f217-4234-aaa1-8cc2a59cd916 None admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:17.136483 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769dce9b-f217-4234-aaa1-8cc2a59cd916 None admin] PATH_INFO: `/v3/domains` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:17.137353 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769dce9b-f217-4234-aaa1-8cc2a59cd916 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:40:17.137761 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769dce9b-f217-4234-aaa1-8cc2a59cd916 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:17.139336 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769dce9b-f217-4234-aaa1-8cc2a59cd916 None admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:17.157773 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 373/745] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Jul 14 10:40:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:40:17.157773 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769dce9b-f217-4234-aaa1-8cc2a59cd916 None admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:17.170290 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a78315-eb9c-4c50-a525-a5c6687af9f1 None None] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:17.208724 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe58c0f-eb00-46a6-a052-4eb95efd2b05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:17.209747 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe58c0f-eb00-46a6-a052-4eb95efd2b05 None admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:17.210240 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe58c0f-eb00-46a6-a052-4eb95efd2b05 None admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:17.210760 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe58c0f-eb00-46a6-a052-4eb95efd2b05 None admin] PATH_INFO: `/v3/users` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:17.211960 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe58c0f-eb00-46a6-a052-4eb95efd2b05 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:40:17.212477 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe58c0f-eb00-46a6-a052-4eb95efd2b05 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:17.214153 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe58c0f-eb00-46a6-a052-4eb95efd2b05 None admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:17.224872 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=100 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:17.240240 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 373/746] 10.222.0.16 () {56 vars in 1133 bytes} [Thu Jul 14 10:40:17 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:40:17.241524 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe58c0f-eb00-46a6-a052-4eb95efd2b05 None admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:17.269696 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769dce9b-f217-4234-aaa1-8cc2a59cd916 None admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:17.302999 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=100 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:17.308598 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb187e3-939a-4522-bc52-e46a33a3c501 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:17.309460 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb187e3-939a-4522-bc52-e46a33a3c501 None admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:17.309770 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb187e3-939a-4522-bc52-e46a33a3c501 None admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:17.310004 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb187e3-939a-4522-bc52-e46a33a3c501 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:17.321916 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb187e3-939a-4522-bc52-e46a33a3c501 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 10:40:17.330103 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application [None req-1eb187e3-939a-4522-bc52-e46a33a3c501 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 14 10:40:17.330103 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:40:17.330103 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:40:17.330103 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:40:17.330103 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:40:17.330103 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:40:17.330103 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:40:17.330103 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:40:17.330103 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:40:17.330103 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:40:17.330103 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:40:17.330103 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:40:17.330103 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 10:40:17.330103 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 10:40:17.330103 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 10:40:17.330103 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 10:40:17.331052 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 10:40:17.331052 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 10:40:17.331052 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 10:40:17.331052 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 10:40:17.331052 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:40:17.331052 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:40:17.331052 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:40:17.331052 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:40:17.331052 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:40:17.331052 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:40:17.331052 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:40:17.331052 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application with Lock( Jul 14 10:40:17.331052 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:40:17.331052 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:40:17.331052 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:40:17.331052 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:40:17.331926 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:40:17.331926 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:40:17.331926 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:40:17.331926 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:40:17.331926 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 10:40:17.331926 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 10:40:17.331926 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 10:40:17.331926 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 10:40:17.331926 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 10:40:17.331926 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 10:40:17.331926 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 14 10:40:17.331926 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application Jul 14 10:40:17.336266 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 374/747] 10.222.0.16 () {56 vars in 1102 bytes} [Thu Jul 14 10:40:17 2022] GET /identity/v3/roles/service => generated 85 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:40:17.337262 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb187e3-939a-4522-bc52-e46a33a3c501 None admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:17.363308 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe58c0f-eb00-46a6-a052-4eb95efd2b05 None admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:17.401732 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536e86a4-c7eb-4c42-a835-807bfbffa42a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:17.402878 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536e86a4-c7eb-4c42-a835-807bfbffa42a None admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:17.403445 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536e86a4-c7eb-4c42-a835-807bfbffa42a None admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:17.404032 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536e86a4-c7eb-4c42-a835-807bfbffa42a None admin] PATH_INFO: `/v3/projects/service` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:17.412762 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536e86a4-c7eb-4c42-a835-807bfbffa42a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:17.414567 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536e86a4-c7eb-4c42-a835-807bfbffa42a None admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:17.430017 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application [None req-536e86a4-c7eb-4c42-a835-807bfbffa42a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 10:40:17.430017 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:40:17.430017 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:40:17.430017 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:40:17.430017 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:40:17.430017 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:40:17.430017 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:40:17.430017 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:40:17.430017 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:40:17.430017 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:40:17.430017 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:40:17.430017 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:40:17.430017 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 10:40:17.430017 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 10:40:17.430017 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 10:40:17.430946 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 10:40:17.430946 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:40:17.430946 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:40:17.430946 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:40:17.430946 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:40:17.430946 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:40:17.430946 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:40:17.430946 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:40:17.430946 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application with Lock( Jul 14 10:40:17.430946 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:40:17.430946 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:40:17.430946 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:40:17.430946 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:40:17.430946 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:40:17.430946 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:40:17.430946 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:40:17.430946 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:40:17.431853 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 10:40:17.431853 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 10:40:17.431853 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 10:40:17.431853 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 10:40:17.431853 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 10:40:17.431853 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 10:40:17.431853 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 10:40:17.431853 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application Jul 14 10:40:17.436157 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 374/748] 10.222.0.16 () {56 vars in 1111 bytes} [Thu Jul 14 10:40:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:40:17.438278 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536e86a4-c7eb-4c42-a835-807bfbffa42a None admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:17.445630 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb187e3-939a-4522-bc52-e46a33a3c501 None admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:17.469250 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=100 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:17.483953 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdbdbbe-1c92-4472-a860-03e037c6d7f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:17.484698 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdbdbbe-1c92-4472-a860-03e037c6d7f6 None admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:17.485344 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdbdbbe-1c92-4472-a860-03e037c6d7f6 None admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:17.485344 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdbdbbe-1c92-4472-a860-03e037c6d7f6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:17.496955 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bdbdbbe-1c92-4472-a860-03e037c6d7f6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:17.498114 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bdbdbbe-1c92-4472-a860-03e037c6d7f6 None admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:17.516163 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application [None req-8bdbdbbe-1c92-4472-a860-03e037c6d7f6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 10:40:17.516163 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:40:17.516163 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:40:17.516163 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:40:17.516163 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:40:17.516163 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:40:17.516163 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:40:17.516163 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:40:17.516163 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:40:17.516163 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:40:17.516163 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:40:17.516163 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:40:17.516163 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 10:40:17.516163 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 10:40:17.516163 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 10:40:17.517391 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 10:40:17.517391 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:40:17.517391 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:40:17.517391 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:40:17.517391 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:40:17.517391 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:40:17.517391 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:40:17.517391 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:40:17.517391 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application with Lock( Jul 14 10:40:17.517391 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:40:17.517391 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:40:17.517391 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:40:17.517391 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:40:17.517391 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:40:17.517391 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:40:17.517391 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:40:17.517391 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:40:17.518610 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 10:40:17.518610 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 10:40:17.518610 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 10:40:17.518610 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application Jul 14 10:40:17.518610 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 375/749] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Jul 14 10:40:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:40:17.518910 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2ca1ea-267e-47dc-bf10-44c371c36ed8 None None] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:17.519326 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2ca1ea-267e-47dc-bf10-44c371c36ed8 None None] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:17.519488 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2ca1ea-267e-47dc-bf10-44c371c36ed8 None None] PATH_INFO: `/` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:17.524782 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 376/750] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jul 14 10:40:17 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:40:17.525570 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2ca1ea-267e-47dc-bf10-44c371c36ed8 None None] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:17.554527 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536e86a4-c7eb-4c42-a835-807bfbffa42a None admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:17.571437 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=100 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:17.595602 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6204fb-8086-4f03-bc43-e33b5cd0cd31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:17.596281 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6204fb-8086-4f03-bc43-e33b5cd0cd31 None admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:17.596569 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6204fb-8086-4f03-bc43-e33b5cd0cd31 None admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:17.596877 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6204fb-8086-4f03-bc43-e33b5cd0cd31 None admin] PATH_INFO: `/v3/roles` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:17.597637 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6204fb-8086-4f03-bc43-e33b5cd0cd31 None admin] RBAC: Adding query filter params (name=service) {{(pid=86655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:40:17.597951 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6204fb-8086-4f03-bc43-e33b5cd0cd31 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:17.599322 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6204fb-8086-4f03-bc43-e33b5cd0cd31 None admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:17.607469 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 375/751] 10.222.0.16 () {56 vars in 1103 bytes} [Thu Jul 14 10:40:17 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:40:17.608837 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6204fb-8086-4f03-bc43-e33b5cd0cd31 None admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:17.639476 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2ca1ea-267e-47dc-bf10-44c371c36ed8 None None] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:17.675517 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98846ce8-43f5-4aa3-b7f6-e761a952abaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:17.676187 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98846ce8-43f5-4aa3-b7f6-e761a952abaf None admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:17.676470 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98846ce8-43f5-4aa3-b7f6-e761a952abaf None admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:17.676745 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98846ce8-43f5-4aa3-b7f6-e761a952abaf None admin] PATH_INFO: `/v3/projects` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:17.677567 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98846ce8-43f5-4aa3-b7f6-e761a952abaf None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:40:17.677877 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98846ce8-43f5-4aa3-b7f6-e761a952abaf None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:17.679310 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98846ce8-43f5-4aa3-b7f6-e761a952abaf None admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:17.691296 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 377/752] 10.222.0.16 () {56 vars in 1148 bytes} [Thu Jul 14 10:40:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:40:17.692534 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf251ef-ef97-4d5b-a8b8-b33992891585 None None] REQUEST_METHOD: `POST` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:17.692851 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf251ef-ef97-4d5b-a8b8-b33992891585 None None] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:17.693136 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf251ef-ef97-4d5b-a8b8-b33992891585 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:17.710431 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.auth.core [None req-2cf251ef-ef97-4d5b-a8b8-b33992891585 None None] MFA Rules not processed for user `ae4bcdd8106d4bebbdcae96be33505bc`. Rule list: `[]` (Enabled: `True`). {{(pid=86656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:40:17.711636 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-2cf251ef-ef97-4d5b-a8b8-b33992891585 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:40:17.726945 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6204fb-8086-4f03-bc43-e33b5cd0cd31 None admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:17.740754 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=100 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:17.762747 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee85f885-586a-4580-aa17-1efb790582f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:17.763422 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee85f885-586a-4580-aa17-1efb790582f1 None admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:17.763704 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee85f885-586a-4580-aa17-1efb790582f1 None admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:17.763982 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee85f885-586a-4580-aa17-1efb790582f1 None admin] PATH_INFO: `/v3/domains` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:17.765259 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee85f885-586a-4580-aa17-1efb790582f1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:40:17.765569 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee85f885-586a-4580-aa17-1efb790582f1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:17.766984 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee85f885-586a-4580-aa17-1efb790582f1 None admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:17.782955 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 376/753] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Jul 14 10:40:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:40:17.782955 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee85f885-586a-4580-aa17-1efb790582f1 None admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:17.785403 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 378/754] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jul 14 10:40:17 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 10:40:17.786376 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf251ef-ef97-4d5b-a8b8-b33992891585 None None] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:17.843576 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=100 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:17.906793 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf251ef-ef97-4d5b-a8b8-b33992891585 None None] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:17.915411 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee85f885-586a-4580-aa17-1efb790582f1 None admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:17.942674 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed4eee9-ff82-46d4-8db3-32e3ef63c707 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:17.943334 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed4eee9-ff82-46d4-8db3-32e3ef63c707 None admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:17.943619 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed4eee9-ff82-46d4-8db3-32e3ef63c707 None admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:17.943903 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed4eee9-ff82-46d4-8db3-32e3ef63c707 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:17.944761 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed4eee9-ff82-46d4-8db3-32e3ef63c707 None admin] RBAC: Adding query filter params (role.id=153539819e5542df99269d2913bbecfb, scope.project.id=59391272ecbe48b0aa736cb43807be1d, user.id=8a23de49b80643eaab7a212f2884d62e) {{(pid=86656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:40:17.945103 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed4eee9-ff82-46d4-8db3-32e3ef63c707 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:17.946535 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed4eee9-ff82-46d4-8db3-32e3ef63c707 None admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:17.960802 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 379/755] 10.222.0.16 () {56 vars in 1374 bytes} [Thu Jul 14 10:40:17 2022] GET /identity/v3/role_assignments?user.id=8a23de49b80643eaab7a212f2884d62e&scope.project.id=59391272ecbe48b0aa736cb43807be1d&role.id=153539819e5542df99269d2913bbecfb => generated 259 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:40:17.960802 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed4eee9-ff82-46d4-8db3-32e3ef63c707 None admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:17.962078 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa852d0-ac60-42c3-b39c-7f02388ac6f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:17.962920 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa852d0-ac60-42c3-b39c-7f02388ac6f4 None admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:17.963209 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa852d0-ac60-42c3-b39c-7f02388ac6f4 None admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:17.963494 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa852d0-ac60-42c3-b39c-7f02388ac6f4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:17.975809 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa852d0-ac60-42c3-b39c-7f02388ac6f4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:17.977435 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa852d0-ac60-42c3-b39c-7f02388ac6f4 None admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:17.994206 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=100 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:18.004982 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application [None req-4fa852d0-ac60-42c3-b39c-7f02388ac6f4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 10:40:18.004982 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:40:18.004982 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:40:18.004982 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:40:18.004982 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:40:18.004982 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:40:18.004982 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:40:18.004982 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:40:18.004982 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:40:18.004982 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:40:18.004982 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:40:18.004982 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:40:18.004982 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 10:40:18.004982 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 10:40:18.004982 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 10:40:18.005948 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 10:40:18.005948 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:40:18.005948 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:40:18.005948 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:40:18.005948 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:40:18.005948 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:40:18.005948 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:40:18.005948 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:40:18.005948 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application with Lock( Jul 14 10:40:18.005948 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:40:18.005948 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:40:18.005948 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:40:18.005948 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:40:18.005948 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:40:18.005948 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:40:18.005948 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:40:18.005948 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:40:18.006843 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 10:40:18.006843 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 10:40:18.006843 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 10:40:18.006843 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application Jul 14 10:40:18.008938 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 377/756] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Jul 14 10:40:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:40:18.009812 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa852d0-ac60-42c3-b39c-7f02388ac6f4 None admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:18.081169 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed4eee9-ff82-46d4-8db3-32e3ef63c707 None admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:18.117327 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=100 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:18.119509 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1b666f-0e73-4e6a-8adb-6ae0d06f6ce1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:18.120357 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1b666f-0e73-4e6a-8adb-6ae0d06f6ce1 None admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:18.120680 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1b666f-0e73-4e6a-8adb-6ae0d06f6ce1 None admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:18.120996 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1b666f-0e73-4e6a-8adb-6ae0d06f6ce1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:18.130590 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1b666f-0e73-4e6a-8adb-6ae0d06f6ce1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:18.132061 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1b666f-0e73-4e6a-8adb-6ae0d06f6ce1 None admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:18.137729 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa852d0-ac60-42c3-b39c-7f02388ac6f4 None admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:18.146901 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application [None req-aa1b666f-0e73-4e6a-8adb-6ae0d06f6ce1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 10:40:18.146901 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:40:18.146901 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:40:18.146901 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:40:18.146901 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:40:18.146901 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:40:18.146901 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:40:18.146901 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:40:18.146901 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:40:18.146901 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:40:18.146901 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:40:18.146901 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:40:18.146901 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 10:40:18.146901 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 10:40:18.146901 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 10:40:18.147889 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 10:40:18.147889 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:40:18.147889 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:40:18.147889 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:40:18.147889 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:40:18.147889 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:40:18.147889 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:40:18.147889 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:40:18.147889 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application with Lock( Jul 14 10:40:18.147889 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:40:18.147889 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:40:18.147889 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:40:18.147889 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:40:18.147889 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:40:18.147889 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:40:18.147889 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:40:18.147889 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:40:18.148746 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 10:40:18.148746 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 10:40:18.148746 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 10:40:18.148746 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 10:40:18.148746 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 10:40:18.148746 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 10:40:18.148746 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 10:40:18.148746 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application Jul 14 10:40:18.152742 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 380/757] 10.222.0.16 () {56 vars in 1111 bytes} [Thu Jul 14 10:40:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:40:18.153615 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1b666f-0e73-4e6a-8adb-6ae0d06f6ce1 None admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:18.177817 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d362cca-bbda-4dd4-8bd2-773c689e4623 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:18.178645 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d362cca-bbda-4dd4-8bd2-773c689e4623 None admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:18.178931 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d362cca-bbda-4dd4-8bd2-773c689e4623 None admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:18.179206 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d362cca-bbda-4dd4-8bd2-773c689e4623 None admin] PATH_INFO: `/v3/services/network` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:18.179859 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d362cca-bbda-4dd4-8bd2-773c689e4623 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:18.181405 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d362cca-bbda-4dd4-8bd2-773c689e4623 None admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:18.193942 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application [None req-6d362cca-bbda-4dd4-8bd2-773c689e4623 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 14 10:40:18.193942 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:40:18.193942 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 14 10:40:18.193942 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 14 10:40:18.193942 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 14 10:40:18.193942 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 14 10:40:18.193942 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 14 10:40:18.193942 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 10:40:18.193942 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 14 10:40:18.193942 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application Jul 14 10:40:18.193942 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 10:40:18.193942 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application Jul 14 10:40:18.193942 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:40:18.193942 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:40:18.193942 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:40:18.193942 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:40:18.193942 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:40:18.194920 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:40:18.194920 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:40:18.194920 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:40:18.194920 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:40:18.194920 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:40:18.194920 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:40:18.194920 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 14 10:40:18.194920 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 14 10:40:18.194920 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 14 10:40:18.194920 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 14 10:40:18.194920 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:40:18.194920 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:40:18.194920 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:40:18.194920 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:40:18.194920 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:40:18.194920 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:40:18.202337 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:40:18.202337 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application with Lock( Jul 14 10:40:18.202337 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:40:18.202337 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:40:18.202337 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:40:18.202337 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:40:18.202337 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:40:18.202337 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:40:18.202337 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:40:18.202337 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:40:18.202337 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 14 10:40:18.202337 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 10:40:18.202337 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 14 10:40:18.202337 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application Jul 14 10:40:18.202337 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 378/758] 10.222.0.16 () {56 vars in 1111 bytes} [Thu Jul 14 10:40:18 2022] GET /identity/v3/services/network => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:40:18.203138 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120c429f-2626-40d6-a245-be93d8160705 None None] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:18.203138 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120c429f-2626-40d6-a245-be93d8160705 None None] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:18.203138 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120c429f-2626-40d6-a245-be93d8160705 None None] PATH_INFO: `/` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:18.203138 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 379/759] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jul 14 10:40:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:40:18.203138 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120c429f-2626-40d6-a245-be93d8160705 None None] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:18.253425 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=100 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:18.267716 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1b666f-0e73-4e6a-8adb-6ae0d06f6ce1 None admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:18.303409 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9820dc-17a6-41bc-9bf6-92c92bdcf1dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:18.304187 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9820dc-17a6-41bc-9bf6-92c92bdcf1dc None admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:18.304495 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9820dc-17a6-41bc-9bf6-92c92bdcf1dc None admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:18.304904 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9820dc-17a6-41bc-9bf6-92c92bdcf1dc None admin] PATH_INFO: `/v3/domains` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:18.305630 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9820dc-17a6-41bc-9bf6-92c92bdcf1dc None admin] RBAC: Adding query filter params (name=Default) {{(pid=86656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:40:18.305939 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9820dc-17a6-41bc-9bf6-92c92bdcf1dc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:18.307306 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9820dc-17a6-41bc-9bf6-92c92bdcf1dc None admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:18.308798 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120c429f-2626-40d6-a245-be93d8160705 None None] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:18.324705 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 381/760] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Jul 14 10:40:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:40:18.325594 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9820dc-17a6-41bc-9bf6-92c92bdcf1dc None admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:18.343765 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eaac5ef-b3a1-44ae-88c1-2445f17687f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:18.344431 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eaac5ef-b3a1-44ae-88c1-2445f17687f2 None admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:18.344721 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eaac5ef-b3a1-44ae-88c1-2445f17687f2 None admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:18.345029 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eaac5ef-b3a1-44ae-88c1-2445f17687f2 None admin] PATH_INFO: `/v3/projects` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:18.345829 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eaac5ef-b3a1-44ae-88c1-2445f17687f2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:40:18.346140 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eaac5ef-b3a1-44ae-88c1-2445f17687f2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:18.347582 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eaac5ef-b3a1-44ae-88c1-2445f17687f2 None admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:18.359754 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 380/761] 10.222.0.16 () {56 vars in 1148 bytes} [Thu Jul 14 10:40:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:40:18.361098 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145c3a4d-2894-45cd-ae2f-78c77a808cea None None] REQUEST_METHOD: `POST` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:18.361388 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145c3a4d-2894-45cd-ae2f-78c77a808cea None None] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:18.361667 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145c3a4d-2894-45cd-ae2f-78c77a808cea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:18.378372 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.auth.core [None req-145c3a4d-2894-45cd-ae2f-78c77a808cea None None] MFA Rules not processed for user `ae4bcdd8106d4bebbdcae96be33505bc`. Rule list: `[]` (Enabled: `True`). {{(pid=86655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:40:18.379593 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-145c3a4d-2894-45cd-ae2f-78c77a808cea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:40:18.382407 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=100 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:18.434807 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9820dc-17a6-41bc-9bf6-92c92bdcf1dc None admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:18.450944 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 381/762] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jul 14 10:40:18 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 10:40:18.451844 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145c3a4d-2894-45cd-ae2f-78c77a808cea None None] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:18.488754 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ecc426f-0fbf-42e6-823e-70b7cdb582dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:18.490169 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecc426f-0fbf-42e6-823e-70b7cdb582dd None admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:18.490614 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecc426f-0fbf-42e6-823e-70b7cdb582dd None admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:18.491126 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecc426f-0fbf-42e6-823e-70b7cdb582dd None admin] PATH_INFO: `/v3/services` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:18.492043 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ecc426f-0fbf-42e6-823e-70b7cdb582dd None admin] RBAC: Adding query filter params (name=network) {{(pid=86656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:40:18.492494 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ecc426f-0fbf-42e6-823e-70b7cdb582dd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:18.494585 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ecc426f-0fbf-42e6-823e-70b7cdb582dd None admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:18.504887 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 382/763] 10.222.0.16 () {56 vars in 1112 bytes} [Thu Jul 14 10:40:18 2022] GET /identity/v3/services?name=network => generated 124 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:40:18.504887 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ecc426f-0fbf-42e6-823e-70b7cdb582dd None admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:18.519408 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=100 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:18.561777 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145c3a4d-2894-45cd-ae2f-78c77a808cea None None] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:18.598668 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d51b9a-7248-4baf-b719-804bce9f1dd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:18.599484 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d51b9a-7248-4baf-b719-804bce9f1dd6 None admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:18.599766 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d51b9a-7248-4baf-b719-804bce9f1dd6 None admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:18.600039 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d51b9a-7248-4baf-b719-804bce9f1dd6 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:18.607315 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d51b9a-7248-4baf-b719-804bce9f1dd6 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:18.607840 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ecc426f-0fbf-42e6-823e-70b7cdb582dd None admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:18.609327 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d51b9a-7248-4baf-b719-804bce9f1dd6 None admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:18.612807 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=100 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:18.625832 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application [None req-d7d51b9a-7248-4baf-b719-804bce9f1dd6 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 14 10:40:18.625832 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:40:18.625832 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:40:18.625832 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:40:18.625832 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:40:18.625832 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:40:18.625832 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:40:18.625832 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:40:18.625832 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:40:18.625832 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:40:18.625832 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:40:18.625832 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:40:18.625832 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 10:40:18.625832 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 10:40:18.625832 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 10:40:18.625832 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 10:40:18.626817 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:40:18.626817 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:40:18.626817 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 10:40:18.626817 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 10:40:18.626817 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 10:40:18.626817 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 10:40:18.626817 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:40:18.626817 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:40:18.626817 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:40:18.626817 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:40:18.626817 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:40:18.626817 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application with Lock( Jul 14 10:40:18.626817 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:40:18.626817 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:40:18.626817 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:40:18.626817 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:40:18.626817 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:40:18.626817 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:40:18.627743 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:40:18.627743 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:40:18.627743 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 10:40:18.627743 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 10:40:18.627743 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 10:40:18.627743 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 10:40:18.627743 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 10:40:18.627743 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 10:40:18.627743 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 14 10:40:18.627743 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application Jul 14 10:40:18.627743 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 382/764] 10.222.0.16 () {56 vars in 1117 bytes} [Thu Jul 14 10:40:18 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:40:18.628333 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d51b9a-7248-4baf-b719-804bce9f1dd6 None admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:18.652493 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5ae868-4cb7-4214-a04f-cde4a01c245f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:18.653607 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5ae868-4cb7-4214-a04f-cde4a01c245f None admin] REQUEST_METHOD: `PUT` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:18.653898 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5ae868-4cb7-4214-a04f-cde4a01c245f None admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:18.654184 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5ae868-4cb7-4214-a04f-cde4a01c245f None admin] PATH_INFO: `/v3/projects/59391272ecbe48b0aa736cb43807be1d/users/26aa294c913c408499a913ec25bb677d/roles/153539819e5542df99269d2913bbecfb` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:18.657337 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5ae868-4cb7-4214-a04f-cde4a01c245f None admin] RBAC: Authorizing `identity:create_grant(project_id=59391272ecbe48b0aa736cb43807be1d, user_id=26aa294c913c408499a913ec25bb677d, role_id=153539819e5542df99269d2913bbecfb)` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:18.658786 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5ae868-4cb7-4214-a04f-cde4a01c245f None admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:18.673848 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 383/765] 10.222.0.16 () {58 vars in 1439 bytes} [Thu Jul 14 10:40:18 2022] PUT /identity/v3/projects/59391272ecbe48b0aa736cb43807be1d/users/26aa294c913c408499a913ec25bb677d/roles/153539819e5542df99269d2913bbecfb => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:40:18.674695 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5ae868-4cb7-4214-a04f-cde4a01c245f None admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:18.744222 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d51b9a-7248-4baf-b719-804bce9f1dd6 None admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:18.786997 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:18.790660 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3416dad-cb90-4170-85be-6344e754b59b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:18.791901 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3416dad-cb90-4170-85be-6344e754b59b None admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:18.792379 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3416dad-cb90-4170-85be-6344e754b59b None admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:18.792816 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3416dad-cb90-4170-85be-6344e754b59b None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:18.793649 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3416dad-cb90-4170-85be-6344e754b59b None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:18.795205 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3416dad-cb90-4170-85be-6344e754b59b None admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:18.813006 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application [None req-b3416dad-cb90-4170-85be-6344e754b59b None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 14 10:40:18.813006 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:40:18.813006 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 14 10:40:18.813006 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 14 10:40:18.813006 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 14 10:40:18.813006 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 14 10:40:18.813006 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 14 10:40:18.813006 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 10:40:18.813006 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 14 10:40:18.813006 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application Jul 14 10:40:18.813006 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 10:40:18.813006 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application Jul 14 10:40:18.813006 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:40:18.813006 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:40:18.813006 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:40:18.813006 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:40:18.814200 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:40:18.814200 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:40:18.814200 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:40:18.814200 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:40:18.814200 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:40:18.814200 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:40:18.814200 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:40:18.814200 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 14 10:40:18.814200 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 14 10:40:18.814200 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 14 10:40:18.814200 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 14 10:40:18.814200 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:40:18.814200 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:40:18.814200 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:40:18.814200 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:40:18.814200 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:40:18.815198 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:40:18.815198 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:40:18.815198 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application with Lock( Jul 14 10:40:18.815198 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:40:18.815198 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:40:18.815198 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:40:18.815198 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:40:18.815198 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:40:18.815198 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:40:18.815198 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:40:18.815198 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:40:18.815198 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 14 10:40:18.815198 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 10:40:18.815198 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 14 10:40:18.815198 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application Jul 14 10:40:18.818115 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 383/766] 10.222.0.16 () {56 vars in 1129 bytes} [Thu Jul 14 10:40:18 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:40:18.819191 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3416dad-cb90-4170-85be-6344e754b59b None admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:18.835030 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5ae868-4cb7-4214-a04f-cde4a01c245f None admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:18.886313 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16c2395-ef47-4d67-afb6-6f1162c76e91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:18.887179 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16c2395-ef47-4d67-afb6-6f1162c76e91 None admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:18.887547 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16c2395-ef47-4d67-afb6-6f1162c76e91 None admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:18.888180 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16c2395-ef47-4d67-afb6-6f1162c76e91 None admin] PATH_INFO: `/v3/services` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:18.889561 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16c2395-ef47-4d67-afb6-6f1162c76e91 None admin] RBAC: Adding query filter params (type=network) {{(pid=86656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:40:18.889878 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16c2395-ef47-4d67-afb6-6f1162c76e91 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:18.891777 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16c2395-ef47-4d67-afb6-6f1162c76e91 None admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:18.903827 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 384/767] 10.222.0.16 () {56 vars in 1112 bytes} [Thu Jul 14 10:40:18 2022] GET /identity/v3/services?type=network => generated 350 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:40:18.904023 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=100 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:18.904118 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16c2395-ef47-4d67-afb6-6f1162c76e91 None admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:18.945106 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3416dad-cb90-4170-85be-6344e754b59b None admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:18.980556 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101bc92a-a9bc-4f2b-b421-f19f50742af8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:18.981553 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101bc92a-a9bc-4f2b-b421-f19f50742af8 None admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:18.982003 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101bc92a-a9bc-4f2b-b421-f19f50742af8 None admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:18.982439 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101bc92a-a9bc-4f2b-b421-f19f50742af8 None admin] PATH_INFO: `/v3/users` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:18.984140 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101bc92a-a9bc-4f2b-b421-f19f50742af8 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=86655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:40:18.984630 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101bc92a-a9bc-4f2b-b421-f19f50742af8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:18.986247 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101bc92a-a9bc-4f2b-b421-f19f50742af8 None admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:19.008886 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 384/768] 10.222.0.16 () {56 vars in 1149 bytes} [Thu Jul 14 10:40:18 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:40:19.010019 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101bc92a-a9bc-4f2b-b421-f19f50742af8 None admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:19.025412 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16c2395-ef47-4d67-afb6-6f1162c76e91 None admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:19.071692 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1162818b-1b5f-484a-856d-33c0bb7f3871 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:19.072412 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1162818b-1b5f-484a-856d-33c0bb7f3871 None admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:19.072693 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1162818b-1b5f-484a-856d-33c0bb7f3871 None admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:19.073335 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1162818b-1b5f-484a-856d-33c0bb7f3871 None admin] PATH_INFO: `/v3/services` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:19.073733 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1162818b-1b5f-484a-856d-33c0bb7f3871 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=86656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:40:19.074035 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1162818b-1b5f-484a-856d-33c0bb7f3871 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:19.075425 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1162818b-1b5f-484a-856d-33c0bb7f3871 None admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:19.077673 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=100 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:19.082840 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 385/769] 10.222.0.16 () {56 vars in 1124 bytes} [Thu Jul 14 10:40:18 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:40:19.083973 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1162818b-1b5f-484a-856d-33c0bb7f3871 None admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:19.131417 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101bc92a-a9bc-4f2b-b421-f19f50742af8 None admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:19.156162 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=100 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:19.169444 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa3fec5-d6dc-4ddc-9a4c-fd854093b9d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:19.170192 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa3fec5-d6dc-4ddc-9a4c-fd854093b9d7 None admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:19.170391 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa3fec5-d6dc-4ddc-9a4c-fd854093b9d7 None admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:19.170718 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa3fec5-d6dc-4ddc-9a4c-fd854093b9d7 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:19.171522 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa3fec5-d6dc-4ddc-9a4c-fd854093b9d7 None admin] RBAC: Adding query filter params (interface=public, service_id=2d138c0036dd474a987bd7d70fb1c88a, region_id=RegionOne) {{(pid=86655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:40:19.171834 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa3fec5-d6dc-4ddc-9a4c-fd854093b9d7 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:19.173266 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa3fec5-d6dc-4ddc-9a4c-fd854093b9d7 None admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:19.186658 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 385/770] 10.222.0.16 () {56 vars in 1251 bytes} [Thu Jul 14 10:40:19 2022] GET /identity/v3/endpoints?service_id=2d138c0036dd474a987bd7d70fb1c88a&interface=public®ion_id=RegionOne => generated 194 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:40:19.186658 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa3fec5-d6dc-4ddc-9a4c-fd854093b9d7 None admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:19.201640 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1162818b-1b5f-484a-856d-33c0bb7f3871 None admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:19.239792 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1671616e-cc4d-4827-aaad-27dd273a4a83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:19.240699 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1671616e-cc4d-4827-aaad-27dd273a4a83 None admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:19.241152 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1671616e-cc4d-4827-aaad-27dd273a4a83 None admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:19.241578 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1671616e-cc4d-4827-aaad-27dd273a4a83 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:19.293058 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa3fec5-d6dc-4ddc-9a4c-fd854093b9d7 None admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:19.312993 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=100 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:19.317134 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1671616e-cc4d-4827-aaad-27dd273a4a83 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:19.318742 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1671616e-cc4d-4827-aaad-27dd273a4a83 None admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:19.330104 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89333b81-3144-4543-877f-1daac4543fea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:19.330703 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89333b81-3144-4543-877f-1daac4543fea None admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:19.330986 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89333b81-3144-4543-877f-1daac4543fea None admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:19.331260 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89333b81-3144-4543-877f-1daac4543fea None admin] PATH_INFO: `/v3/services` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:19.331967 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89333b81-3144-4543-877f-1daac4543fea None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=86655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:40:19.332270 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89333b81-3144-4543-877f-1daac4543fea None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:19.333658 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89333b81-3144-4543-877f-1daac4543fea None admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:19.339317 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 386/771] 10.222.0.16 () {56 vars in 1124 bytes} [Thu Jul 14 10:40:19 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:40:19.339968 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89333b81-3144-4543-877f-1daac4543fea None admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:19.393562 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=100 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:19.426086 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 386/772] 10.222.0.16 () {58 vars in 1282 bytes} [Thu Jul 14 10:40:19 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 14 10:40:19.431314 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1671616e-cc4d-4827-aaad-27dd273a4a83 None admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:19.448658 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89333b81-3144-4543-877f-1daac4543fea None admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:19.485937 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71335880-6472-47f4-b962-857ee182a2f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:19.487056 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71335880-6472-47f4-b962-857ee182a2f4 None admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:19.487504 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71335880-6472-47f4-b962-857ee182a2f4 None admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:19.488038 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71335880-6472-47f4-b962-857ee182a2f4 None admin] PATH_INFO: `/v3/services` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:19.489011 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71335880-6472-47f4-b962-857ee182a2f4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:19.490590 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71335880-6472-47f4-b962-857ee182a2f4 None admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:19.496730 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 387/773] 10.222.0.16 () {56 vars in 1087 bytes} [Thu Jul 14 10:40:19 2022] GET /identity/v3/services => generated 772 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:40:19.497803 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71335880-6472-47f4-b962-857ee182a2f4 None admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:19.570195 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=100 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:19.575403 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1671616e-cc4d-4827-aaad-27dd273a4a83 None admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:19.637426 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c75f67-10e2-42a6-b381-ec781651003a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:19.638624 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c75f67-10e2-42a6-b381-ec781651003a None admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:19.638905 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c75f67-10e2-42a6-b381-ec781651003a None admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:19.640267 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c75f67-10e2-42a6-b381-ec781651003a None admin] PATH_INFO: `/v3/endpoints` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:19.641270 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c75f67-10e2-42a6-b381-ec781651003a None admin] RBAC: Adding query filter params (interface=public, service_id=ce2120ea8bf24983af6ef8e159aa6b7f, region_id=RegionOne) {{(pid=86656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:40:19.641586 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c75f67-10e2-42a6-b381-ec781651003a None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:19.642986 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c75f67-10e2-42a6-b381-ec781651003a None admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:19.652469 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 387/774] 10.222.0.16 () {56 vars in 1251 bytes} [Thu Jul 14 10:40:19 2022] GET /identity/v3/endpoints?service_id=ce2120ea8bf24983af6ef8e159aa6b7f&interface=public®ion_id=RegionOne => generated 194 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:40:19.659206 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c75f67-10e2-42a6-b381-ec781651003a None admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:19.691504 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71335880-6472-47f4-b962-857ee182a2f4 None admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:19.722444 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=100 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:19.756357 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc20ee33-1ec7-479b-b411-6805a15a709c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:19.758090 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc20ee33-1ec7-479b-b411-6805a15a709c None admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:19.758563 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc20ee33-1ec7-479b-b411-6805a15a709c None admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:19.759152 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc20ee33-1ec7-479b-b411-6805a15a709c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:19.774279 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc20ee33-1ec7-479b-b411-6805a15a709c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:19.776756 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc20ee33-1ec7-479b-b411-6805a15a709c None admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:19.800750 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application [None req-bc20ee33-1ec7-479b-b411-6805a15a709c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 10:40:19.800750 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:40:19.800750 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:40:19.800750 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:40:19.800750 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:40:19.800750 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:40:19.800750 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:40:19.800750 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:40:19.800750 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:40:19.800750 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:40:19.800750 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:40:19.800750 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:40:19.800750 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 10:40:19.800750 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 10:40:19.800750 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 10:40:19.801725 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 10:40:19.801725 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:40:19.801725 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:40:19.801725 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:40:19.801725 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:40:19.801725 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:40:19.801725 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:40:19.801725 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:40:19.801725 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application with Lock( Jul 14 10:40:19.801725 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:40:19.801725 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:40:19.801725 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:40:19.801725 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:40:19.801725 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:40:19.801725 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:40:19.801725 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:40:19.801725 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:40:19.802581 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 10:40:19.802581 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 10:40:19.802581 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 10:40:19.802581 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application Jul 14 10:40:19.805377 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 388/775] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Jul 14 10:40:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 308 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:40:19.811778 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c75f67-10e2-42a6-b381-ec781651003a None admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:19.813709 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc20ee33-1ec7-479b-b411-6805a15a709c None admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:19.855572 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454c6615-edf5-4d71-a092-76543c3a11a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:19.856252 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454c6615-edf5-4d71-a092-76543c3a11a0 None admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:19.856541 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454c6615-edf5-4d71-a092-76543c3a11a0 None admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:19.856868 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454c6615-edf5-4d71-a092-76543c3a11a0 None admin] PATH_INFO: `/v3/services` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:19.857571 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454c6615-edf5-4d71-a092-76543c3a11a0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:19.859432 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454c6615-edf5-4d71-a092-76543c3a11a0 None admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:19.866204 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 388/776] 10.222.0.16 () {56 vars in 1087 bytes} [Thu Jul 14 10:40:19 2022] GET /identity/v3/services => generated 772 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:40:19.935859 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc20ee33-1ec7-479b-b411-6805a15a709c None admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:19.973624 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8db1b0-f94a-4ac7-9956-aa1d65e79c8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:19.974315 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8db1b0-f94a-4ac7-9956-aa1d65e79c8e None admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:19.974604 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8db1b0-f94a-4ac7-9956-aa1d65e79c8e None admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:19.974881 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8db1b0-f94a-4ac7-9956-aa1d65e79c8e None admin] PATH_INFO: `/v3/domains` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:19.975628 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8db1b0-f94a-4ac7-9956-aa1d65e79c8e None admin] RBAC: Adding query filter params (name=Default) {{(pid=86655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:40:19.975939 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8db1b0-f94a-4ac7-9956-aa1d65e79c8e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:19.977371 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8db1b0-f94a-4ac7-9956-aa1d65e79c8e None admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:19.992706 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 389/777] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Jul 14 10:40:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:40:19.999329 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454c6615-edf5-4d71-a092-76543c3a11a0 None admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:20.019818 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84ea536-bdb5-423f-8cba-84848b615ac8 None None] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:20.020139 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84ea536-bdb5-423f-8cba-84848b615ac8 None None] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:20.020386 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84ea536-bdb5-423f-8cba-84848b615ac8 None None] PATH_INFO: `/` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:20.022131 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 390/778] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jul 14 10:40:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:40:20.029394 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af17e03d-e499-4577-b264-f8ed26c95dc9 None None] REQUEST_METHOD: `POST` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:20.029723 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af17e03d-e499-4577-b264-f8ed26c95dc9 None None] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:20.030112 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af17e03d-e499-4577-b264-f8ed26c95dc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:20.069055 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=100 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:20.073747 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.auth.core [None req-af17e03d-e499-4577-b264-f8ed26c95dc9 None None] MFA Rules not processed for user `ae4bcdd8106d4bebbdcae96be33505bc`. Rule list: `[]` (Enabled: `True`). {{(pid=86655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:40:20.075005 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-af17e03d-e499-4577-b264-f8ed26c95dc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:40:20.111829 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=100 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:20.170365 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454c6615-edf5-4d71-a092-76543c3a11a0 None admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:20.180874 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 391/779] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jul 14 10:40:20 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 10:40:20.208159 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af17e03d-e499-4577-b264-f8ed26c95dc9 None None] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:20.212746 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ebf7a3-cc06-41bd-bfd5-3ecb2d080124 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:20.213835 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ebf7a3-cc06-41bd-bfd5-3ecb2d080124 None admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:20.214325 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ebf7a3-cc06-41bd-bfd5-3ecb2d080124 None admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:20.214805 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ebf7a3-cc06-41bd-bfd5-3ecb2d080124 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:20.226333 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ebf7a3-cc06-41bd-bfd5-3ecb2d080124 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:20.228081 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ebf7a3-cc06-41bd-bfd5-3ecb2d080124 None admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:20.248468 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application [None req-08ebf7a3-cc06-41bd-bfd5-3ecb2d080124 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 10:40:20.248468 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:40:20.248468 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:40:20.248468 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:40:20.248468 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:40:20.248468 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:40:20.248468 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:40:20.248468 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:40:20.248468 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:40:20.248468 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:40:20.248468 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:40:20.248468 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:40:20.248468 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 10:40:20.248468 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 10:40:20.248468 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 10:40:20.250688 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 10:40:20.250688 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:40:20.250688 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:40:20.250688 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:40:20.250688 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:40:20.250688 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:40:20.250688 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:40:20.250688 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:40:20.250688 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application with Lock( Jul 14 10:40:20.250688 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:40:20.250688 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:40:20.250688 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:40:20.250688 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:40:20.250688 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:40:20.250688 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:40:20.250688 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:40:20.250688 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:40:20.252056 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 10:40:20.252056 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 10:40:20.252056 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 10:40:20.252056 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 10:40:20.252056 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 10:40:20.252056 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 10:40:20.252056 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 10:40:20.252056 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application Jul 14 10:40:20.252056 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 389/780] 10.222.0.16 () {56 vars in 1111 bytes} [Thu Jul 14 10:40:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:40:20.260167 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ebf7a3-cc06-41bd-bfd5-3ecb2d080124 None admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:20.327636 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af17e03d-e499-4577-b264-f8ed26c95dc9 None None] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:20.362920 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9274f787-4018-4b8f-aa2f-aed67f58ec1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:20.364071 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9274f787-4018-4b8f-aa2f-aed67f58ec1e None admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:20.364582 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9274f787-4018-4b8f-aa2f-aed67f58ec1e None admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:20.365096 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9274f787-4018-4b8f-aa2f-aed67f58ec1e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:20.376736 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9274f787-4018-4b8f-aa2f-aed67f58ec1e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 10:40:20.384730 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application [None req-9274f787-4018-4b8f-aa2f-aed67f58ec1e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 10:40:20.384730 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:40:20.384730 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:40:20.384730 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:40:20.384730 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:40:20.384730 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:40:20.384730 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:40:20.384730 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:40:20.384730 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:40:20.384730 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:40:20.384730 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:40:20.384730 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:40:20.384730 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 10:40:20.384730 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 10:40:20.384730 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 10:40:20.384730 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 10:40:20.385678 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 10:40:20.385678 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 10:40:20.385678 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 10:40:20.385678 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 10:40:20.385678 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:40:20.385678 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:40:20.385678 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:40:20.385678 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:40:20.385678 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:40:20.385678 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:40:20.385678 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:40:20.385678 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application with Lock( Jul 14 10:40:20.385678 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:40:20.385678 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:40:20.385678 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:40:20.385678 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:40:20.386480 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:40:20.386480 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:40:20.386480 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:40:20.386480 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:40:20.386480 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 10:40:20.386480 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 10:40:20.386480 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 10:40:20.386480 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 10:40:20.386480 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 10:40:20.386480 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 10:40:20.386480 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 10:40:20.386480 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application Jul 14 10:40:20.394330 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 392/781] 10.222.0.16 () {56 vars in 1096 bytes} [Thu Jul 14 10:40:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 10:40:20.395852 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9274f787-4018-4b8f-aa2f-aed67f58ec1e None admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:20.416801 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=100 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:20.453195 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=100 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:20.481768 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ebf7a3-cc06-41bd-bfd5-3ecb2d080124 None admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:20.505095 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9274f787-4018-4b8f-aa2f-aed67f58ec1e None admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:20.541883 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c0f010-862a-4fc0-a994-eae7d9109db8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:20.542942 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c0f010-862a-4fc0-a994-eae7d9109db8 None admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:20.543431 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c0f010-862a-4fc0-a994-eae7d9109db8 None admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:20.543902 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c0f010-862a-4fc0-a994-eae7d9109db8 None admin] PATH_INFO: `/v3/roles` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:20.544904 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c0f010-862a-4fc0-a994-eae7d9109db8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:40:20.545478 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c0f010-862a-4fc0-a994-eae7d9109db8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:20.548186 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c0f010-862a-4fc0-a994-eae7d9109db8 None admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:20.562648 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960493cd-4161-4c57-99a9-ed9ede471ffa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:20.563010 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 393/782] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Jul 14 10:40:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 10:40:20.563328 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960493cd-4161-4c57-99a9-ed9ede471ffa None admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:20.563616 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960493cd-4161-4c57-99a9-ed9ede471ffa None admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:20.563899 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960493cd-4161-4c57-99a9-ed9ede471ffa None admin] PATH_INFO: `/v3/projects` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:20.564703 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960493cd-4161-4c57-99a9-ed9ede471ffa None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:40:20.565061 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960493cd-4161-4c57-99a9-ed9ede471ffa None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:20.566026 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c0f010-862a-4fc0-a994-eae7d9109db8 None admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:20.566513 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960493cd-4161-4c57-99a9-ed9ede471ffa None admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:20.595366 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 390/783] 10.222.0.16 () {56 vars in 1148 bytes} [Thu Jul 14 10:40:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 335 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:40:20.601742 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960493cd-4161-4c57-99a9-ed9ede471ffa None admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:20.672191 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=100 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:20.726732 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c0f010-862a-4fc0-a994-eae7d9109db8 None admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:20.769460 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960493cd-4161-4c57-99a9-ed9ede471ffa None admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:20.806289 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d29147-1ea3-43df-b512-c3fab3b2b52c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:20.806957 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d29147-1ea3-43df-b512-c3fab3b2b52c None admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:20.807255 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d29147-1ea3-43df-b512-c3fab3b2b52c None admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:20.807687 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d29147-1ea3-43df-b512-c3fab3b2b52c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:20.808535 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d29147-1ea3-43df-b512-c3fab3b2b52c None admin] RBAC: Adding query filter params (role.id=d58911e96aad48cf9ca61ac5df79e21d, scope.project.id=59391272ecbe48b0aa736cb43807be1d, user.id=0dfc7cd9c05e4f268d2ce316d531c4bd) {{(pid=86656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:40:20.808902 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d29147-1ea3-43df-b512-c3fab3b2b52c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:20.810352 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d29147-1ea3-43df-b512-c3fab3b2b52c None admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:20.816628 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 391/784] 10.222.0.16 () {56 vars in 1374 bytes} [Thu Jul 14 10:40:20 2022] GET /identity/v3/role_assignments?user.id=0dfc7cd9c05e4f268d2ce316d531c4bd&scope.project.id=59391272ecbe48b0aa736cb43807be1d&role.id=d58911e96aad48cf9ca61ac5df79e21d => generated 259 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:40:20.832759 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbe01e8-5718-4d8c-97b7-2c2eaae49a81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:20.833624 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbe01e8-5718-4d8c-97b7-2c2eaae49a81 None admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:20.833912 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbe01e8-5718-4d8c-97b7-2c2eaae49a81 None admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:20.834191 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbe01e8-5718-4d8c-97b7-2c2eaae49a81 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:20.855405 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bbe01e8-5718-4d8c-97b7-2c2eaae49a81 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:20.856957 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bbe01e8-5718-4d8c-97b7-2c2eaae49a81 None admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:20.883723 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application [None req-0bbe01e8-5718-4d8c-97b7-2c2eaae49a81 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 10:40:20.883723 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:40:20.883723 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:40:20.883723 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:40:20.883723 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:40:20.883723 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:40:20.883723 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:40:20.883723 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:40:20.883723 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:40:20.883723 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:40:20.883723 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:40:20.883723 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:40:20.883723 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 10:40:20.883723 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 10:40:20.883723 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 10:40:20.884662 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 10:40:20.884662 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:40:20.884662 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:40:20.884662 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:40:20.884662 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:40:20.884662 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:40:20.884662 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:40:20.884662 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:40:20.884662 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application with Lock( Jul 14 10:40:20.884662 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:40:20.884662 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:40:20.884662 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:40:20.884662 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:40:20.884662 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:40:20.884662 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:40:20.884662 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:40:20.884662 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:40:20.885588 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 10:40:20.885588 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 10:40:20.885588 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 10:40:20.885588 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application Jul 14 10:40:20.885588 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 394/785] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Jul 14 10:40:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 320 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:40:20.891821 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d29147-1ea3-43df-b512-c3fab3b2b52c None admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:20.909202 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=100 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:21.006873 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d29147-1ea3-43df-b512-c3fab3b2b52c None admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:21.048522 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0576c388-1916-48fb-925b-c1125124c00f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:21.049226 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0576c388-1916-48fb-925b-c1125124c00f None admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:21.049521 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0576c388-1916-48fb-925b-c1125124c00f None admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:21.049807 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0576c388-1916-48fb-925b-c1125124c00f None admin] PATH_INFO: `/v3/domains` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:21.050561 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0576c388-1916-48fb-925b-c1125124c00f None admin] RBAC: Adding query filter params (name=Default) {{(pid=86656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:40:21.050873 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0576c388-1916-48fb-925b-c1125124c00f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:21.052252 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0576c388-1916-48fb-925b-c1125124c00f None admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:21.068431 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 392/786] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Jul 14 10:40:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:40:21.071409 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbe01e8-5718-4d8c-97b7-2c2eaae49a81 None admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:21.110989 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a6d4b8-eb7e-4927-83d7-156053777ec7 None None] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:21.111288 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a6d4b8-eb7e-4927-83d7-156053777ec7 None None] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:21.111551 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a6d4b8-eb7e-4927-83d7-156053777ec7 None None] PATH_INFO: `/` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:21.113203 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 393/787] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jul 14 10:40:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:40:21.119426 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff019a4-8925-4f77-84c5-d7500ef5ffb8 None None] REQUEST_METHOD: `POST` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:21.119963 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff019a4-8925-4f77-84c5-d7500ef5ffb8 None None] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:21.120437 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff019a4-8925-4f77-84c5-d7500ef5ffb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:21.149817 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.auth.core [None req-eff019a4-8925-4f77-84c5-d7500ef5ffb8 None None] MFA Rules not processed for user `ae4bcdd8106d4bebbdcae96be33505bc`. Rule list: `[]` (Enabled: `True`). {{(pid=86656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:40:21.151040 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-eff019a4-8925-4f77-84c5-d7500ef5ffb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:40:21.199705 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbe01e8-5718-4d8c-97b7-2c2eaae49a81 None admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:21.233676 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=100 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:21.240638 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f34a81b-3bd9-481e-9318-07f4aca9ef4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:21.241993 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f34a81b-3bd9-481e-9318-07f4aca9ef4f None admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:21.242476 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f34a81b-3bd9-481e-9318-07f4aca9ef4f None admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:21.242970 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f34a81b-3bd9-481e-9318-07f4aca9ef4f None admin] PATH_INFO: `/v3/users/swift` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:21.253005 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f34a81b-3bd9-481e-9318-07f4aca9ef4f None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:21.254787 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f34a81b-3bd9-481e-9318-07f4aca9ef4f None admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:21.271815 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application [None req-9f34a81b-3bd9-481e-9318-07f4aca9ef4f None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 14 10:40:21.271815 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:40:21.271815 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:40:21.271815 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:40:21.271815 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:40:21.271815 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:40:21.271815 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:40:21.271815 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:40:21.271815 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:40:21.271815 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:40:21.271815 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:40:21.271815 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:40:21.271815 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 10:40:21.271815 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 10:40:21.271815 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 10:40:21.271815 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 10:40:21.272823 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:40:21.272823 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:40:21.272823 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 10:40:21.272823 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 10:40:21.272823 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 10:40:21.272823 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 10:40:21.272823 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:40:21.272823 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:40:21.272823 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:40:21.272823 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:40:21.272823 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:40:21.272823 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application with Lock( Jul 14 10:40:21.272823 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:40:21.272823 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:40:21.272823 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:40:21.272823 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:40:21.272823 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:40:21.272823 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:40:21.273753 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:40:21.273753 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:40:21.273753 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 10:40:21.273753 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 10:40:21.273753 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 10:40:21.273753 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 10:40:21.273753 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 10:40:21.273753 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 10:40:21.273753 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 14 10:40:21.273753 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application Jul 14 10:40:21.276725 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 395/788] 10.222.0.16 () {56 vars in 1096 bytes} [Thu Jul 14 10:40:21 2022] GET /identity/v3/users/swift => generated 83 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:40:21.283247 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f34a81b-3bd9-481e-9318-07f4aca9ef4f None admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:21.340204 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 394/789] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jul 14 10:40:21 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 14 10:40:21.396629 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff019a4-8925-4f77-84c5-d7500ef5ffb8 None None] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:21.406026 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=100 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:21.434788 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f34a81b-3bd9-481e-9318-07f4aca9ef4f None admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:21.488066 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5495247a-2c99-4294-96a4-3d47fcfa0369 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:21.488931 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5495247a-2c99-4294-96a4-3d47fcfa0369 None admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:21.489233 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5495247a-2c99-4294-96a4-3d47fcfa0369 None admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:21.489496 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5495247a-2c99-4294-96a4-3d47fcfa0369 None admin] PATH_INFO: `/v3/users` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:21.490367 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5495247a-2c99-4294-96a4-3d47fcfa0369 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=86655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:40:21.490684 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5495247a-2c99-4294-96a4-3d47fcfa0369 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:21.492171 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5495247a-2c99-4294-96a4-3d47fcfa0369 None admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:21.524944 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 396/790] 10.222.0.16 () {56 vars in 1135 bytes} [Thu Jul 14 10:40:21 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:40:21.531153 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5495247a-2c99-4294-96a4-3d47fcfa0369 None admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:21.549237 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff019a4-8925-4f77-84c5-d7500ef5ffb8 None None] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:21.609161 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e18c9eb-b036-46df-b3e3-26dd746d22ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:21.609918 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e18c9eb-b036-46df-b3e3-26dd746d22ea None admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:21.610206 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e18c9eb-b036-46df-b3e3-26dd746d22ea None admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:21.610476 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e18c9eb-b036-46df-b3e3-26dd746d22ea None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:21.621861 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e18c9eb-b036-46df-b3e3-26dd746d22ea None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 10:40:21.631317 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application [None req-5e18c9eb-b036-46df-b3e3-26dd746d22ea None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 10:40:21.631317 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:40:21.631317 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:40:21.631317 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:40:21.631317 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:40:21.631317 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:40:21.631317 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:40:21.631317 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:40:21.631317 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:40:21.631317 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:40:21.631317 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:40:21.631317 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:40:21.631317 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 10:40:21.631317 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 10:40:21.631317 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 10:40:21.631317 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 10:40:21.632266 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 10:40:21.632266 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 10:40:21.632266 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 10:40:21.632266 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 10:40:21.632266 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:40:21.632266 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:40:21.632266 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:40:21.632266 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:40:21.632266 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:40:21.632266 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:40:21.632266 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:40:21.632266 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application with Lock( Jul 14 10:40:21.632266 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:40:21.632266 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:40:21.632266 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:40:21.632266 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:40:21.633133 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:40:21.633133 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:40:21.633133 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:40:21.633133 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:40:21.633133 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 10:40:21.633133 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 10:40:21.633133 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 10:40:21.633133 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 10:40:21.633133 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 10:40:21.633133 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 10:40:21.633133 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 10:40:21.633133 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application Jul 14 10:40:21.633133 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 395/791] 10.222.0.16 () {56 vars in 1096 bytes} [Thu Jul 14 10:40:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:40:21.638640 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e18c9eb-b036-46df-b3e3-26dd746d22ea None admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:21.643748 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=100 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:21.741847 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5495247a-2c99-4294-96a4-3d47fcfa0369 None admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:21.780206 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff52d63c-2674-4c64-82dc-118658bdd0c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:21.780206 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff52d63c-2674-4c64-82dc-118658bdd0c7 None admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:21.780206 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff52d63c-2674-4c64-82dc-118658bdd0c7 None admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:21.780206 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff52d63c-2674-4c64-82dc-118658bdd0c7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:21.781117 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=100 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:21.790822 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff52d63c-2674-4c64-82dc-118658bdd0c7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:21.792292 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff52d63c-2674-4c64-82dc-118658bdd0c7 None admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:21.812294 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application [None req-ff52d63c-2674-4c64-82dc-118658bdd0c7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 10:40:21.812294 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:40:21.812294 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:40:21.812294 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:40:21.812294 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:40:21.812294 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:40:21.812294 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:40:21.812294 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:40:21.812294 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:40:21.812294 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:40:21.812294 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:40:21.812294 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:40:21.812294 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 10:40:21.812294 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 10:40:21.812294 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 10:40:21.813358 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 10:40:21.813358 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:40:21.813358 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:40:21.813358 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:40:21.813358 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:40:21.813358 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:40:21.813358 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:40:21.813358 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:40:21.813358 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application with Lock( Jul 14 10:40:21.813358 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:40:21.813358 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:40:21.813358 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:40:21.813358 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:40:21.813358 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:40:21.813358 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:40:21.813358 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:40:21.813358 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:40:21.814251 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 10:40:21.814251 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 10:40:21.814251 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 10:40:21.814251 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application Jul 14 10:40:21.817090 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 397/792] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Jul 14 10:40:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 283 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:40:21.819393 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff52d63c-2674-4c64-82dc-118658bdd0c7 None admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:21.856112 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e18c9eb-b036-46df-b3e3-26dd746d22ea None admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:21.894780 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba93fdc-b5e8-4c5f-8d02-7ea424e6c667 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:21.895594 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba93fdc-b5e8-4c5f-8d02-7ea424e6c667 None admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:21.895892 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba93fdc-b5e8-4c5f-8d02-7ea424e6c667 None admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:21.896172 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba93fdc-b5e8-4c5f-8d02-7ea424e6c667 None admin] PATH_INFO: `/v3/roles` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:21.897479 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba93fdc-b5e8-4c5f-8d02-7ea424e6c667 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:40:21.897805 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba93fdc-b5e8-4c5f-8d02-7ea424e6c667 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:21.899196 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba93fdc-b5e8-4c5f-8d02-7ea424e6c667 None admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:21.908728 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 396/793] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Jul 14 10:40:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:40:21.913678 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba93fdc-b5e8-4c5f-8d02-7ea424e6c667 None admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:22.018803 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=100 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:22.022559 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff52d63c-2674-4c64-82dc-118658bdd0c7 None admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:22.033472 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba93fdc-b5e8-4c5f-8d02-7ea424e6c667 None admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:22.066816 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=100 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:22.073440 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a515fecf-2741-4daa-a9da-bf922d5440ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:22.074872 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a515fecf-2741-4daa-a9da-bf922d5440ee None admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:22.075473 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a515fecf-2741-4daa-a9da-bf922d5440ee None admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:22.075979 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a515fecf-2741-4daa-a9da-bf922d5440ee None admin] PATH_INFO: `/v3/domains` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:22.077523 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a515fecf-2741-4daa-a9da-bf922d5440ee None admin] RBAC: Adding query filter params (name=Default) {{(pid=86655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:40:22.078062 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a515fecf-2741-4daa-a9da-bf922d5440ee None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:22.079447 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55675d33-296a-4c1e-b4df-c5e58792b92d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:22.079889 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a515fecf-2741-4daa-a9da-bf922d5440ee None admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:22.080247 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55675d33-296a-4c1e-b4df-c5e58792b92d None admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:22.080533 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55675d33-296a-4c1e-b4df-c5e58792b92d None admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:22.080833 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55675d33-296a-4c1e-b4df-c5e58792b92d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:22.092969 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55675d33-296a-4c1e-b4df-c5e58792b92d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:22.094430 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55675d33-296a-4c1e-b4df-c5e58792b92d None admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:22.096351 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 398/794] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Jul 14 10:40:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:40:22.098522 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f04343-7746-4833-a150-5e9f8dbd8e09 None None] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:22.099047 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f04343-7746-4833-a150-5e9f8dbd8e09 None None] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:22.099571 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f04343-7746-4833-a150-5e9f8dbd8e09 None None] PATH_INFO: `/` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:22.101387 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 399/795] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jul 14 10:40:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:40:22.102388 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f04343-7746-4833-a150-5e9f8dbd8e09 None None] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:22.116299 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application [None req-55675d33-296a-4c1e-b4df-c5e58792b92d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 10:40:22.116299 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:40:22.116299 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:40:22.116299 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:40:22.116299 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:40:22.116299 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:40:22.116299 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:40:22.116299 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:40:22.116299 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:40:22.116299 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:40:22.116299 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:40:22.116299 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:40:22.116299 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 10:40:22.116299 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 10:40:22.116299 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 10:40:22.117266 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 10:40:22.117266 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:40:22.117266 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:40:22.117266 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:40:22.117266 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:40:22.117266 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:40:22.117266 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:40:22.117266 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:40:22.117266 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application with Lock( Jul 14 10:40:22.117266 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:40:22.117266 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:40:22.117266 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:40:22.117266 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:40:22.117266 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:40:22.117266 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:40:22.117266 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:40:22.117266 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:40:22.118157 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 10:40:22.118157 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 10:40:22.118157 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 10:40:22.118157 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application Jul 14 10:40:22.122265 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 397/796] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Jul 14 10:40:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 10:40:22.124193 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95959209-1242-4e46-828a-6375a1e87639 None None] REQUEST_METHOD: `POST` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:22.124395 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95959209-1242-4e46-828a-6375a1e87639 None None] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:22.124671 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95959209-1242-4e46-828a-6375a1e87639 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:22.141465 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.auth.core [None req-95959209-1242-4e46-828a-6375a1e87639 None None] MFA Rules not processed for user `ae4bcdd8106d4bebbdcae96be33505bc`. Rule list: `[]` (Enabled: `True`). {{(pid=86656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:40:22.142669 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-95959209-1242-4e46-828a-6375a1e87639 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:40:22.235473 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 398/797] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jul 14 10:40:22 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 10:40:22.236575 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95959209-1242-4e46-828a-6375a1e87639 None None] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:22.239512 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f04343-7746-4833-a150-5e9f8dbd8e09 None None] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:22.300425 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22997e6c-8bae-4373-9a48-61d2c16f4464 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:22.302118 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22997e6c-8bae-4373-9a48-61d2c16f4464 None admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:22.303045 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22997e6c-8bae-4373-9a48-61d2c16f4464 None admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:22.303798 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22997e6c-8bae-4373-9a48-61d2c16f4464 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:22.314300 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22997e6c-8bae-4373-9a48-61d2c16f4464 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:22.316598 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22997e6c-8bae-4373-9a48-61d2c16f4464 None admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:22.337315 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application [None req-22997e6c-8bae-4373-9a48-61d2c16f4464 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 10:40:22.337315 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:40:22.337315 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:40:22.337315 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:40:22.337315 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:40:22.337315 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:40:22.337315 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:40:22.337315 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:40:22.337315 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:40:22.337315 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:40:22.337315 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:40:22.337315 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:40:22.337315 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 10:40:22.337315 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 10:40:22.337315 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 10:40:22.338240 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 10:40:22.338240 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:40:22.338240 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:40:22.338240 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:40:22.338240 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:40:22.338240 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:40:22.338240 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:40:22.338240 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:40:22.338240 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application with Lock( Jul 14 10:40:22.338240 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:40:22.338240 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:40:22.338240 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:40:22.338240 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:40:22.338240 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:40:22.338240 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:40:22.338240 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:40:22.338240 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:40:22.339104 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 10:40:22.339104 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 10:40:22.339104 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 10:40:22.339104 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 10:40:22.339104 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 10:40:22.339104 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 10:40:22.339104 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 10:40:22.339104 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application Jul 14 10:40:22.341709 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 400/798] 10.222.0.16 () {56 vars in 1111 bytes} [Thu Jul 14 10:40:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:40:22.343379 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22997e6c-8bae-4373-9a48-61d2c16f4464 None admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:22.368916 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95959209-1242-4e46-828a-6375a1e87639 None None] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:22.374698 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=100 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:22.378901 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=100 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:22.411187 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650b8ae2-29b5-452a-8c40-e77361fbff35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:22.411920 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650b8ae2-29b5-452a-8c40-e77361fbff35 None admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:22.412310 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650b8ae2-29b5-452a-8c40-e77361fbff35 None admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:22.412693 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650b8ae2-29b5-452a-8c40-e77361fbff35 None admin] PATH_INFO: `/v3/domains` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:22.413570 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650b8ae2-29b5-452a-8c40-e77361fbff35 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:40:22.413983 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650b8ae2-29b5-452a-8c40-e77361fbff35 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:22.415665 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650b8ae2-29b5-452a-8c40-e77361fbff35 None admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:22.429990 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 399/799] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Jul 14 10:40:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:40:22.431109 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650b8ae2-29b5-452a-8c40-e77361fbff35 None admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:22.485449 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22997e6c-8bae-4373-9a48-61d2c16f4464 None admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:22.534324 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57734fc3-f19e-4e30-9e5d-1e74d58608c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:22.535931 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57734fc3-f19e-4e30-9e5d-1e74d58608c5 None admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:22.536400 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57734fc3-f19e-4e30-9e5d-1e74d58608c5 None admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:22.536996 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57734fc3-f19e-4e30-9e5d-1e74d58608c5 None admin] PATH_INFO: `/v3/services/network` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:22.537914 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57734fc3-f19e-4e30-9e5d-1e74d58608c5 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:22.540272 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57734fc3-f19e-4e30-9e5d-1e74d58608c5 None admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:22.548900 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650b8ae2-29b5-452a-8c40-e77361fbff35 None admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:22.557506 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application [None req-57734fc3-f19e-4e30-9e5d-1e74d58608c5 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 14 10:40:22.557506 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:40:22.557506 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 14 10:40:22.557506 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 14 10:40:22.557506 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 14 10:40:22.557506 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 14 10:40:22.557506 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 14 10:40:22.557506 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 10:40:22.557506 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 14 10:40:22.557506 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application Jul 14 10:40:22.557506 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 10:40:22.557506 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application Jul 14 10:40:22.557506 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:40:22.557506 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:40:22.557506 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:40:22.557506 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:40:22.557506 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:40:22.558688 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:40:22.558688 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:40:22.558688 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:40:22.558688 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:40:22.558688 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:40:22.558688 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:40:22.558688 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 14 10:40:22.558688 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 14 10:40:22.558688 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 14 10:40:22.558688 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 14 10:40:22.558688 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:40:22.558688 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:40:22.558688 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:40:22.558688 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:40:22.558688 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:40:22.558688 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:40:22.559716 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:40:22.559716 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application with Lock( Jul 14 10:40:22.559716 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:40:22.559716 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:40:22.559716 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:40:22.559716 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:40:22.559716 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:40:22.559716 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:40:22.559716 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:40:22.559716 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:40:22.559716 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 14 10:40:22.559716 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 10:40:22.559716 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 14 10:40:22.559716 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application Jul 14 10:40:22.567738 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 401/800] 10.222.0.16 () {56 vars in 1111 bytes} [Thu Jul 14 10:40:22 2022] GET /identity/v3/services/network => generated 88 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:40:22.567738 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57734fc3-f19e-4e30-9e5d-1e74d58608c5 None admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:22.598575 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09aa4ec-61f1-4c9e-a64d-3b184f2f9576 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:22.600177 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09aa4ec-61f1-4c9e-a64d-3b184f2f9576 None admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:22.600960 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09aa4ec-61f1-4c9e-a64d-3b184f2f9576 None admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:22.601321 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09aa4ec-61f1-4c9e-a64d-3b184f2f9576 None admin] PATH_INFO: `/v3/projects` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:22.602129 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09aa4ec-61f1-4c9e-a64d-3b184f2f9576 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:40:22.602449 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09aa4ec-61f1-4c9e-a64d-3b184f2f9576 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:22.604843 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09aa4ec-61f1-4c9e-a64d-3b184f2f9576 None admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:22.620117 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 400/801] 10.222.0.16 () {56 vars in 1148 bytes} [Thu Jul 14 10:40:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:40:22.621293 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8401f166-2144-4402-83f4-d228a5212710 None None] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:22.621583 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8401f166-2144-4402-83f4-d228a5212710 None None] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:22.621862 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8401f166-2144-4402-83f4-d228a5212710 None None] PATH_INFO: `/` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:22.623207 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 401/802] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jul 14 10:40:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:40:22.623832 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8401f166-2144-4402-83f4-d228a5212710 None None] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:22.651329 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=100 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:22.664969 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=100 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:22.682364 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57734fc3-f19e-4e30-9e5d-1e74d58608c5 None admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:22.719107 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8905b8f-c23a-4bcc-9987-a4ac958f26dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:22.719912 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8905b8f-c23a-4bcc-9987-a4ac958f26dc None admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:22.720198 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8905b8f-c23a-4bcc-9987-a4ac958f26dc None admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:22.720910 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8905b8f-c23a-4bcc-9987-a4ac958f26dc None admin] PATH_INFO: `/v3/users/nova` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:22.729701 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8905b8f-c23a-4bcc-9987-a4ac958f26dc None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:22.731148 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8905b8f-c23a-4bcc-9987-a4ac958f26dc None admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:22.733507 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8401f166-2144-4402-83f4-d228a5212710 None None] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:22.745835 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application [None req-c8905b8f-c23a-4bcc-9987-a4ac958f26dc None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 14 10:40:22.745835 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:40:22.745835 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:40:22.745835 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:40:22.745835 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:40:22.745835 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:40:22.745835 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:40:22.745835 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:40:22.745835 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:40:22.745835 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:40:22.745835 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:40:22.745835 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:40:22.745835 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 10:40:22.745835 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 10:40:22.745835 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 10:40:22.745835 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 10:40:22.747147 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:40:22.747147 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:40:22.747147 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 10:40:22.747147 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 10:40:22.747147 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 10:40:22.747147 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 10:40:22.747147 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:40:22.747147 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:40:22.747147 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:40:22.747147 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:40:22.747147 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:40:22.747147 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application with Lock( Jul 14 10:40:22.747147 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:40:22.747147 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:40:22.747147 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:40:22.747147 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:40:22.747147 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:40:22.747147 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:40:22.748070 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:40:22.748070 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:40:22.748070 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 10:40:22.748070 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 10:40:22.748070 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 10:40:22.748070 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 10:40:22.748070 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 10:40:22.748070 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 10:40:22.748070 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 14 10:40:22.748070 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application Jul 14 10:40:22.748070 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 402/803] 10.222.0.16 () {56 vars in 1093 bytes} [Thu Jul 14 10:40:22 2022] GET /identity/v3/users/nova => generated 82 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:40:22.748070 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8905b8f-c23a-4bcc-9987-a4ac958f26dc None admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:22.774229 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f1928e-713c-4d5a-a7a9-d0aa6638b13c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:22.774998 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f1928e-713c-4d5a-a7a9-d0aa6638b13c None admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:22.775198 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f1928e-713c-4d5a-a7a9-d0aa6638b13c None admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:22.775449 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f1928e-713c-4d5a-a7a9-d0aa6638b13c None admin] PATH_INFO: `/v3/services` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:22.776336 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f1928e-713c-4d5a-a7a9-d0aa6638b13c None admin] RBAC: Adding query filter params (name=network) {{(pid=86656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:40:22.776512 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f1928e-713c-4d5a-a7a9-d0aa6638b13c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:22.780245 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f1928e-713c-4d5a-a7a9-d0aa6638b13c None admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:22.788965 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 402/804] 10.222.0.16 () {56 vars in 1112 bytes} [Thu Jul 14 10:40:22 2022] GET /identity/v3/services?name=network => generated 124 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:40:22.788965 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1cba1d-9e60-4128-9b15-1cc86ca5120f None None] REQUEST_METHOD: `POST` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:22.788965 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1cba1d-9e60-4128-9b15-1cc86ca5120f None None] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:22.788965 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1cba1d-9e60-4128-9b15-1cc86ca5120f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:22.805148 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.auth.core [None req-1f1cba1d-9e60-4128-9b15-1cc86ca5120f None None] MFA Rules not processed for user `ae4bcdd8106d4bebbdcae96be33505bc`. Rule list: `[]` (Enabled: `True`). {{(pid=86656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:40:22.806325 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-1f1cba1d-9e60-4128-9b15-1cc86ca5120f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:40:22.868532 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8905b8f-c23a-4bcc-9987-a4ac958f26dc None admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:22.877140 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 403/805] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jul 14 10:40:22 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 10:40:22.877933 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1cba1d-9e60-4128-9b15-1cc86ca5120f None None] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:22.900958 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=100 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:22.911403 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c760be7-72dc-423b-807e-bc13d1a011c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:22.912305 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c760be7-72dc-423b-807e-bc13d1a011c7 None admin] REQUEST_METHOD: `PUT` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:22.912618 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c760be7-72dc-423b-807e-bc13d1a011c7 None admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:22.912947 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c760be7-72dc-423b-807e-bc13d1a011c7 None admin] PATH_INFO: `/v3/projects/59391272ecbe48b0aa736cb43807be1d/users/8a23de49b80643eaab7a212f2884d62e/roles/153539819e5542df99269d2913bbecfb` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:22.914927 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c760be7-72dc-423b-807e-bc13d1a011c7 None admin] RBAC: Authorizing `identity:create_grant(project_id=59391272ecbe48b0aa736cb43807be1d, user_id=8a23de49b80643eaab7a212f2884d62e, role_id=153539819e5542df99269d2913bbecfb)` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:22.916369 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c760be7-72dc-423b-807e-bc13d1a011c7 None admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:22.940806 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 403/806] 10.222.0.16 () {58 vars in 1439 bytes} [Thu Jul 14 10:40:22 2022] PUT /identity/v3/projects/59391272ecbe48b0aa736cb43807be1d/users/8a23de49b80643eaab7a212f2884d62e/roles/153539819e5542df99269d2913bbecfb => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:40:22.940806 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c760be7-72dc-423b-807e-bc13d1a011c7 None admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:22.944904 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:23.015381 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1cba1d-9e60-4128-9b15-1cc86ca5120f None None] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:23.061822 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c760be7-72dc-423b-807e-bc13d1a011c7 None admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:23.064344 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b0cfc2-bf83-4d1b-bd4a-442b7c798a28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:23.065138 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b0cfc2-bf83-4d1b-bd4a-442b7c798a28 None admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:23.065453 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b0cfc2-bf83-4d1b-bd4a-442b7c798a28 None admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:23.066659 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b0cfc2-bf83-4d1b-bd4a-442b7c798a28 None admin] PATH_INFO: `/v3/users` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:23.067551 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b0cfc2-bf83-4d1b-bd4a-442b7c798a28 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:40:23.067877 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b0cfc2-bf83-4d1b-bd4a-442b7c798a28 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:23.069414 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b0cfc2-bf83-4d1b-bd4a-442b7c798a28 None admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:23.092458 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 404/807] 10.222.0.16 () {56 vars in 1133 bytes} [Thu Jul 14 10:40:22 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:40:23.093702 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b0cfc2-bf83-4d1b-bd4a-442b7c798a28 None admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:23.110412 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5872afdb-c8fe-4542-9622-5811d56212dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:23.111089 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5872afdb-c8fe-4542-9622-5811d56212dd None admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:23.111380 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5872afdb-c8fe-4542-9622-5811d56212dd None admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:23.111660 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5872afdb-c8fe-4542-9622-5811d56212dd None admin] PATH_INFO: `/v3/services` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:23.112385 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5872afdb-c8fe-4542-9622-5811d56212dd None admin] RBAC: Adding query filter params (type=network) {{(pid=86655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:40:23.112698 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5872afdb-c8fe-4542-9622-5811d56212dd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:23.114108 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5872afdb-c8fe-4542-9622-5811d56212dd None admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:23.125641 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 404/808] 10.222.0.16 () {56 vars in 1112 bytes} [Thu Jul 14 10:40:22 2022] GET /identity/v3/services?type=network => generated 350 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:40:23.126244 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5872afdb-c8fe-4542-9622-5811d56212dd None admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:23.202377 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=100 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:23.211500 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=100 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:23.220184 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b0cfc2-bf83-4d1b-bd4a-442b7c798a28 None admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:23.249669 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5872afdb-c8fe-4542-9622-5811d56212dd None admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:23.255989 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305f8f0a-26a2-4017-8a84-df1ab4ab8af4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:23.256831 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305f8f0a-26a2-4017-8a84-df1ab4ab8af4 None admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:23.257121 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305f8f0a-26a2-4017-8a84-df1ab4ab8af4 None admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:23.257629 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305f8f0a-26a2-4017-8a84-df1ab4ab8af4 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:23.258052 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305f8f0a-26a2-4017-8a84-df1ab4ab8af4 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:23.259424 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305f8f0a-26a2-4017-8a84-df1ab4ab8af4 None admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:23.273957 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application [None req-305f8f0a-26a2-4017-8a84-df1ab4ab8af4 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 14 10:40:23.273957 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:40:23.273957 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 14 10:40:23.273957 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 14 10:40:23.273957 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 14 10:40:23.273957 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 14 10:40:23.273957 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 14 10:40:23.273957 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 10:40:23.273957 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 14 10:40:23.273957 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application Jul 14 10:40:23.273957 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 10:40:23.273957 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application Jul 14 10:40:23.273957 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:40:23.273957 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:40:23.273957 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:40:23.273957 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:40:23.275870 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:40:23.275870 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:40:23.275870 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:40:23.275870 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:40:23.275870 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:40:23.275870 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:40:23.275870 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:40:23.275870 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 14 10:40:23.275870 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 14 10:40:23.275870 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 14 10:40:23.275870 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 14 10:40:23.275870 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:40:23.275870 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:40:23.275870 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:40:23.275870 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:40:23.275870 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:40:23.277949 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:40:23.277949 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:40:23.277949 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application with Lock( Jul 14 10:40:23.277949 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:40:23.277949 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:40:23.277949 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:40:23.277949 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:40:23.277949 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:40:23.277949 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:40:23.277949 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:40:23.277949 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:40:23.277949 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 14 10:40:23.277949 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 10:40:23.277949 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 14 10:40:23.277949 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application Jul 14 10:40:23.277949 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 405/809] 10.222.0.16 () {56 vars in 1129 bytes} [Thu Jul 14 10:40:23 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:40:23.278860 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305f8f0a-26a2-4017-8a84-df1ab4ab8af4 None admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:23.292330 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9918cfbd-5024-4b75-a11c-cf51b4a2acd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:23.293020 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9918cfbd-5024-4b75-a11c-cf51b4a2acd6 None admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:23.293310 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9918cfbd-5024-4b75-a11c-cf51b4a2acd6 None admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:23.293589 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9918cfbd-5024-4b75-a11c-cf51b4a2acd6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:23.370642 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9918cfbd-5024-4b75-a11c-cf51b4a2acd6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:23.372115 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9918cfbd-5024-4b75-a11c-cf51b4a2acd6 None admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:23.385769 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305f8f0a-26a2-4017-8a84-df1ab4ab8af4 None admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:23.423519 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a20ed6-c7e9-4133-b5da-cb51185f53d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:23.424190 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a20ed6-c7e9-4133-b5da-cb51185f53d1 None admin] REQUEST_METHOD: `POST` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:23.424478 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a20ed6-c7e9-4133-b5da-cb51185f53d1 None admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:23.424757 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a20ed6-c7e9-4133-b5da-cb51185f53d1 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:23.425527 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a20ed6-c7e9-4133-b5da-cb51185f53d1 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:23.426905 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a20ed6-c7e9-4133-b5da-cb51185f53d1 None admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:23.440330 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=100 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:23.443236 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:23.456948 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 406/810] 10.222.0.16 () {60 vars in 1144 bytes} [Thu Jul 14 10:40:23 2022] POST /identity/v3/endpoints => generated 327 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:40:23.456948 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdf110c-f53a-4464-b14c-581286c564f4 None None] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:23.456948 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdf110c-f53a-4464-b14c-581286c564f4 None None] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:23.456948 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdf110c-f53a-4464-b14c-581286c564f4 None None] PATH_INFO: `/` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:23.456948 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 407/811] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jul 14 10:40:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:40:23.456948 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bdf110c-f53a-4464-b14c-581286c564f4 None None] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:23.511381 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 405/812] 10.222.0.16 () {58 vars in 1282 bytes} [Thu Jul 14 10:40:23 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 14 10:40:23.513309 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e319b794-f4ba-4ac7-99b0-b54f68cf731f None None] REQUEST_METHOD: `POST` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:23.513712 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e319b794-f4ba-4ac7-99b0-b54f68cf731f None None] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:23.514163 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e319b794-f4ba-4ac7-99b0-b54f68cf731f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:23.544356 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.auth.core [None req-e319b794-f4ba-4ac7-99b0-b54f68cf731f None None] MFA Rules not processed for user `ae4bcdd8106d4bebbdcae96be33505bc`. Rule list: `[]` (Enabled: `True`). {{(pid=86655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:40:23.546132 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-e319b794-f4ba-4ac7-99b0-b54f68cf731f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:40:23.612970 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bdf110c-f53a-4464-b14c-581286c564f4 None None] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:23.654543 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 406/813] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jul 14 10:40:23 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 10:40:23.656250 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e319b794-f4ba-4ac7-99b0-b54f68cf731f None None] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:23.662639 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55693730-be46-463a-8fd6-737a084aa752 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:23.663833 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55693730-be46-463a-8fd6-737a084aa752 None admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:23.664269 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55693730-be46-463a-8fd6-737a084aa752 None admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:23.664718 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55693730-be46-463a-8fd6-737a084aa752 None admin] PATH_INFO: `/v3/services` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:23.665741 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55693730-be46-463a-8fd6-737a084aa752 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=86656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:40:23.666202 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55693730-be46-463a-8fd6-737a084aa752 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:23.667788 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55693730-be46-463a-8fd6-737a084aa752 None admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:23.674337 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 408/814] 10.222.0.16 () {56 vars in 1124 bytes} [Thu Jul 14 10:40:23 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:40:23.680201 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55693730-be46-463a-8fd6-737a084aa752 None admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:23.748663 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=100 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:23.770681 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=100 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:23.775089 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e319b794-f4ba-4ac7-99b0-b54f68cf731f None None] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:23.798488 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55693730-be46-463a-8fd6-737a084aa752 None admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:23.819961 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2a3b93-da20-497a-b2ff-3fc3437f27f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:23.820754 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2a3b93-da20-497a-b2ff-3fc3437f27f9 None admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:23.821066 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2a3b93-da20-497a-b2ff-3fc3437f27f9 None admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:23.821333 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2a3b93-da20-497a-b2ff-3fc3437f27f9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:23.831738 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2a3b93-da20-497a-b2ff-3fc3437f27f9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:23.833219 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2a3b93-da20-497a-b2ff-3fc3437f27f9 None admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:23.841063 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c118289-0a0a-443a-9074-f39abf985946 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:23.841941 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c118289-0a0a-443a-9074-f39abf985946 None admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:23.843180 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c118289-0a0a-443a-9074-f39abf985946 None admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:23.843609 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c118289-0a0a-443a-9074-f39abf985946 None admin] PATH_INFO: `/v3/services` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:23.844473 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c118289-0a0a-443a-9074-f39abf985946 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=86656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:40:23.844976 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c118289-0a0a-443a-9074-f39abf985946 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:23.846525 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c118289-0a0a-443a-9074-f39abf985946 None admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:23.850841 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application [None req-7f2a3b93-da20-497a-b2ff-3fc3437f27f9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 10:40:23.850841 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:40:23.850841 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:40:23.850841 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:40:23.850841 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:40:23.850841 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:40:23.850841 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:40:23.850841 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:40:23.850841 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:40:23.850841 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:40:23.850841 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:40:23.850841 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:40:23.850841 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 10:40:23.850841 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 10:40:23.850841 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 10:40:23.851871 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 10:40:23.851871 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:40:23.851871 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:40:23.851871 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:40:23.851871 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:40:23.851871 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:40:23.851871 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:40:23.851871 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:40:23.851871 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application with Lock( Jul 14 10:40:23.851871 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:40:23.851871 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:40:23.851871 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:40:23.851871 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:40:23.851871 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:40:23.851871 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:40:23.851871 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:40:23.851871 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:40:23.853025 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 10:40:23.853025 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 10:40:23.853025 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 10:40:23.853025 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application Jul 14 10:40:23.859317 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 407/815] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Jul 14 10:40:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:40:23.859470 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 409/816] 10.222.0.16 () {56 vars in 1124 bytes} [Thu Jul 14 10:40:23 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:40:23.859565 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2a3b93-da20-497a-b2ff-3fc3437f27f9 None admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:23.860432 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c118289-0a0a-443a-9074-f39abf985946 None admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:23.960098 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2a3b93-da20-497a-b2ff-3fc3437f27f9 None admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:23.970298 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c118289-0a0a-443a-9074-f39abf985946 None admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:23.994131 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=100 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:24.000319 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e78dca-4740-4b3b-8b9a-0781ddb88810 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:24.001263 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e78dca-4740-4b3b-8b9a-0781ddb88810 None admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:24.001751 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e78dca-4740-4b3b-8b9a-0781ddb88810 None admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:24.002101 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e78dca-4740-4b3b-8b9a-0781ddb88810 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:24.006070 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a461218d-3f5c-4ac0-9c74-4ff34409adb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:24.006737 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a461218d-3f5c-4ac0-9c74-4ff34409adb9 None admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:24.007077 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a461218d-3f5c-4ac0-9c74-4ff34409adb9 None admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:24.007356 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a461218d-3f5c-4ac0-9c74-4ff34409adb9 None admin] PATH_INFO: `/v3/domains` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:24.008011 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a461218d-3f5c-4ac0-9c74-4ff34409adb9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:40:24.008321 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a461218d-3f5c-4ac0-9c74-4ff34409adb9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:24.009715 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a461218d-3f5c-4ac0-9c74-4ff34409adb9 None admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:24.012854 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e78dca-4740-4b3b-8b9a-0781ddb88810 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 10:40:24.020893 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application [None req-76e78dca-4740-4b3b-8b9a-0781ddb88810 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 14 10:40:24.020893 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:40:24.020893 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:40:24.020893 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:40:24.020893 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:40:24.020893 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:40:24.020893 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:40:24.020893 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:40:24.020893 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:40:24.020893 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:40:24.020893 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:40:24.020893 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:40:24.020893 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 10:40:24.020893 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 10:40:24.020893 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 10:40:24.020893 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 10:40:24.021805 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 10:40:24.021805 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 10:40:24.021805 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 10:40:24.021805 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 10:40:24.021805 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:40:24.021805 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:40:24.021805 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:40:24.021805 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:40:24.021805 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:40:24.021805 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:40:24.021805 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:40:24.021805 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application with Lock( Jul 14 10:40:24.021805 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:40:24.021805 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:40:24.021805 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:40:24.021805 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:40:24.022652 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:40:24.022652 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:40:24.022652 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:40:24.022652 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:40:24.022652 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 10:40:24.022652 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 10:40:24.022652 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 10:40:24.022652 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 10:40:24.022652 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 10:40:24.022652 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 10:40:24.022652 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 14 10:40:24.022652 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application Jul 14 10:40:24.025089 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 410/817] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Jul 14 10:40:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 10:40:24.026415 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a461218d-3f5c-4ac0-9c74-4ff34409adb9 None admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:24.026951 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 408/818] 10.222.0.16 () {56 vars in 1102 bytes} [Thu Jul 14 10:40:23 2022] GET /identity/v3/roles/service => generated 85 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:40:24.027786 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e78dca-4740-4b3b-8b9a-0781ddb88810 None admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:24.040935 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=100 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:24.138608 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a461218d-3f5c-4ac0-9c74-4ff34409adb9 None admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:24.138812 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e78dca-4740-4b3b-8b9a-0781ddb88810 None admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:24.176698 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f997acab-d90a-42e0-ae4e-9c9baa7cbc90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:24.177527 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f997acab-d90a-42e0-ae4e-9c9baa7cbc90 None admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:24.177811 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f997acab-d90a-42e0-ae4e-9c9baa7cbc90 None admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:24.178096 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f997acab-d90a-42e0-ae4e-9c9baa7cbc90 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:24.179426 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03443e45-1ee6-49e3-bf72-73a0d0013c93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:24.180093 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03443e45-1ee6-49e3-bf72-73a0d0013c93 None admin] REQUEST_METHOD: `POST` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:24.180379 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03443e45-1ee6-49e3-bf72-73a0d0013c93 None admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:24.180654 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03443e45-1ee6-49e3-bf72-73a0d0013c93 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:24.181441 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03443e45-1ee6-49e3-bf72-73a0d0013c93 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:24.182820 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03443e45-1ee6-49e3-bf72-73a0d0013c93 None admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:24.185269 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f997acab-d90a-42e0-ae4e-9c9baa7cbc90 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:24.187701 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f997acab-d90a-42e0-ae4e-9c9baa7cbc90 None admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:24.208807 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application [None req-f997acab-d90a-42e0-ae4e-9c9baa7cbc90 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 10:40:24.208807 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:40:24.208807 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:40:24.208807 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:40:24.208807 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:40:24.208807 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:40:24.208807 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:40:24.208807 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:40:24.208807 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:40:24.208807 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:40:24.208807 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:40:24.208807 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:40:24.208807 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 10:40:24.208807 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 10:40:24.208807 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 10:40:24.209765 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 10:40:24.209765 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:40:24.209765 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:40:24.209765 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:40:24.209765 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:40:24.209765 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:40:24.209765 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:40:24.209765 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:40:24.209765 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application with Lock( Jul 14 10:40:24.209765 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:40:24.209765 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:40:24.209765 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:40:24.209765 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:40:24.209765 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:40:24.209765 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:40:24.209765 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:40:24.209765 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:40:24.210724 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 10:40:24.210724 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 10:40:24.210724 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 10:40:24.210724 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 10:40:24.210724 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 10:40:24.210724 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 10:40:24.210724 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 10:40:24.210724 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application Jul 14 10:40:24.211196 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 411/819] 10.222.0.16 () {60 vars in 1144 bytes} [Thu Jul 14 10:40:24 2022] POST /identity/v3/endpoints => generated 346 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:40:24.211196 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03443e45-1ee6-49e3-bf72-73a0d0013c93 None admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:24.211324 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 409/820] 10.222.0.16 () {56 vars in 1111 bytes} [Thu Jul 14 10:40:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:40:24.211324 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f997acab-d90a-42e0-ae4e-9c9baa7cbc90 None admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:24.263620 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:24.316019 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=100 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:24.344179 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03443e45-1ee6-49e3-bf72-73a0d0013c93 None admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:24.359863 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f997acab-d90a-42e0-ae4e-9c9baa7cbc90 None admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:24.387096 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe195de-9e1d-4805-b954-95ae0cf4a00c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:24.387933 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe195de-9e1d-4805-b954-95ae0cf4a00c None admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:24.388318 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe195de-9e1d-4805-b954-95ae0cf4a00c None admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:24.388697 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe195de-9e1d-4805-b954-95ae0cf4a00c None admin] PATH_INFO: `/v3/roles` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:24.390406 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe195de-9e1d-4805-b954-95ae0cf4a00c None admin] RBAC: Adding query filter params (name=service) {{(pid=86656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:40:24.390819 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe195de-9e1d-4805-b954-95ae0cf4a00c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:24.392302 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe195de-9e1d-4805-b954-95ae0cf4a00c None admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:24.399174 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b37bb52-6b9f-4595-bb62-335f514dd9e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:24.399839 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b37bb52-6b9f-4595-bb62-335f514dd9e3 None admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:24.400124 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b37bb52-6b9f-4595-bb62-335f514dd9e3 None admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:24.400400 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b37bb52-6b9f-4595-bb62-335f514dd9e3 None admin] PATH_INFO: `/v3/projects` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:24.401228 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b37bb52-6b9f-4595-bb62-335f514dd9e3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:40:24.401552 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b37bb52-6b9f-4595-bb62-335f514dd9e3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:24.401740 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 412/821] 10.222.0.16 () {56 vars in 1103 bytes} [Thu Jul 14 10:40:24 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:40:24.403209 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b37bb52-6b9f-4595-bb62-335f514dd9e3 None admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:24.407016 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe195de-9e1d-4805-b954-95ae0cf4a00c None admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:24.419262 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 410/822] 10.222.0.16 () {56 vars in 1148 bytes} [Thu Jul 14 10:40:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 10:40:24.425882 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b37bb52-6b9f-4595-bb62-335f514dd9e3 None admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:24.532594 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=100 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:24.540590 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe195de-9e1d-4805-b954-95ae0cf4a00c None admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:24.550130 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b37bb52-6b9f-4595-bb62-335f514dd9e3 None admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:24.582940 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=100 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:24.584526 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80708cc2-28c5-42f4-99eb-a885fa17d026 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:24.585706 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80708cc2-28c5-42f4-99eb-a885fa17d026 None admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:24.585993 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80708cc2-28c5-42f4-99eb-a885fa17d026 None admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:24.586271 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80708cc2-28c5-42f4-99eb-a885fa17d026 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:24.591994 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eeb76ff-7aa5-4bd7-8c7b-dbf5896ab826 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:24.593528 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eeb76ff-7aa5-4bd7-8c7b-dbf5896ab826 None admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:24.594043 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eeb76ff-7aa5-4bd7-8c7b-dbf5896ab826 None admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:24.594612 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eeb76ff-7aa5-4bd7-8c7b-dbf5896ab826 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:24.595673 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eeb76ff-7aa5-4bd7-8c7b-dbf5896ab826 None admin] RBAC: Adding query filter params (role.id=153539819e5542df99269d2913bbecfb, scope.project.id=59391272ecbe48b0aa736cb43807be1d, user.id=26aa294c913c408499a913ec25bb677d) {{(pid=86655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:40:24.596284 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eeb76ff-7aa5-4bd7-8c7b-dbf5896ab826 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:24.598003 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eeb76ff-7aa5-4bd7-8c7b-dbf5896ab826 None admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:24.598402 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80708cc2-28c5-42f4-99eb-a885fa17d026 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:24.599853 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80708cc2-28c5-42f4-99eb-a885fa17d026 None admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:24.605898 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 411/823] 10.222.0.16 () {56 vars in 1374 bytes} [Thu Jul 14 10:40:24 2022] GET /identity/v3/role_assignments?user.id=26aa294c913c408499a913ec25bb677d&scope.project.id=59391272ecbe48b0aa736cb43807be1d&role.id=153539819e5542df99269d2913bbecfb => generated 608 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 10:40:24.624957 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application [None req-80708cc2-28c5-42f4-99eb-a885fa17d026 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 10:40:24.624957 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:40:24.624957 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:40:24.624957 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:40:24.624957 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:40:24.624957 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:40:24.624957 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:40:24.624957 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:40:24.624957 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:40:24.624957 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:40:24.624957 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:40:24.624957 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:40:24.624957 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 10:40:24.624957 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 10:40:24.624957 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 10:40:24.625930 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 10:40:24.625930 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:40:24.625930 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:40:24.625930 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:40:24.625930 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:40:24.625930 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:40:24.625930 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:40:24.625930 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:40:24.625930 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application with Lock( Jul 14 10:40:24.625930 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:40:24.625930 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:40:24.625930 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:40:24.625930 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:40:24.625930 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:40:24.625930 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:40:24.625930 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:40:24.625930 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:40:24.626847 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 10:40:24.626847 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 10:40:24.626847 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 10:40:24.626847 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application Jul 14 10:40:24.629356 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 413/824] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Jul 14 10:40:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 10:40:24.638025 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eeb76ff-7aa5-4bd7-8c7b-dbf5896ab826 None admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:24.750815 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eeb76ff-7aa5-4bd7-8c7b-dbf5896ab826 None admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:24.792112 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3118da86-c365-461d-b276-ec7a3507ab00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:24.792758 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3118da86-c365-461d-b276-ec7a3507ab00 None admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:24.797017 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3118da86-c365-461d-b276-ec7a3507ab00 None admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:24.797297 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3118da86-c365-461d-b276-ec7a3507ab00 None admin] PATH_INFO: `/v3/domains` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:24.798058 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3118da86-c365-461d-b276-ec7a3507ab00 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:40:24.798366 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3118da86-c365-461d-b276-ec7a3507ab00 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:24.799767 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3118da86-c365-461d-b276-ec7a3507ab00 None admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:24.817119 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 412/825] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Jul 14 10:40:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:40:24.818532 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80708cc2-28c5-42f4-99eb-a885fa17d026 None admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:24.928676 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80708cc2-28c5-42f4-99eb-a885fa17d026 None admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:24.963446 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7630eef4-da11-4e7d-a931-bc3428a339ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:24.964261 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7630eef4-da11-4e7d-a931-bc3428a339ee None admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:24.964543 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7630eef4-da11-4e7d-a931-bc3428a339ee None admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:24.964840 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7630eef4-da11-4e7d-a931-bc3428a339ee None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:24.973315 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7630eef4-da11-4e7d-a931-bc3428a339ee None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:24.974763 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7630eef4-da11-4e7d-a931-bc3428a339ee None admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:24.990078 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application [None req-7630eef4-da11-4e7d-a931-bc3428a339ee None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 14 10:40:24.990078 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:40:24.990078 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:40:24.990078 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:40:24.990078 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:40:24.990078 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:40:24.990078 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:40:24.990078 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:40:24.990078 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:40:24.990078 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:40:24.990078 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:40:24.990078 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:40:24.990078 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 10:40:24.990078 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 10:40:24.990078 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 10:40:24.990078 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 10:40:24.991214 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:40:24.991214 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:40:24.991214 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 10:40:24.991214 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 10:40:24.991214 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 10:40:24.991214 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 10:40:24.991214 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:40:24.991214 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:40:24.991214 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:40:24.991214 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:40:24.991214 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:40:24.991214 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application with Lock( Jul 14 10:40:24.991214 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:40:24.991214 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:40:24.991214 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:40:24.991214 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:40:24.991214 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:40:24.991214 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:40:24.992356 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:40:24.992356 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:40:24.992356 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 10:40:24.992356 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 10:40:24.992356 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 10:40:24.992356 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 10:40:24.992356 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 10:40:24.992356 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 10:40:24.992356 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 14 10:40:24.992356 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application Jul 14 10:40:24.992356 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 414/826] 10.222.0.16 () {56 vars in 1117 bytes} [Thu Jul 14 10:40:24 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:40:24.997007 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3118da86-c365-461d-b276-ec7a3507ab00 None admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:25.057063 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=100 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:25.083398 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed78316d-7974-4165-b733-0abb392149c8 None None] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:25.083684 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed78316d-7974-4165-b733-0abb392149c8 None None] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:25.083960 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed78316d-7974-4165-b733-0abb392149c8 None None] PATH_INFO: `/` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:25.085636 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 415/827] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jul 14 10:40:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 14 10:40:25.090531 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae5c3ae-f685-496b-98ff-72938074a51a None None] REQUEST_METHOD: `POST` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:25.090820 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae5c3ae-f685-496b-98ff-72938074a51a None None] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:25.091101 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae5c3ae-f685-496b-98ff-72938074a51a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:25.108666 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3118da86-c365-461d-b276-ec7a3507ab00 None admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:25.109522 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.auth.core [None req-3ae5c3ae-f685-496b-98ff-72938074a51a None None] MFA Rules not processed for user `ae4bcdd8106d4bebbdcae96be33505bc`. Rule list: `[]` (Enabled: `True`). {{(pid=86656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:40:25.110822 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-3ae5c3ae-f685-496b-98ff-72938074a51a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:40:25.112935 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=100 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:25.146833 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9611c03b-f729-4107-bde8-e4ca5112a930 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:25.147506 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9611c03b-f729-4107-bde8-e4ca5112a930 None admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:25.147792 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9611c03b-f729-4107-bde8-e4ca5112a930 None admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:25.148065 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9611c03b-f729-4107-bde8-e4ca5112a930 None admin] PATH_INFO: `/v3/users` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:25.148950 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9611c03b-f729-4107-bde8-e4ca5112a930 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=86655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:40:25.149246 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9611c03b-f729-4107-bde8-e4ca5112a930 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:25.150667 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9611c03b-f729-4107-bde8-e4ca5112a930 None admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:25.174535 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 413/828] 10.222.0.16 () {56 vars in 1149 bytes} [Thu Jul 14 10:40:24 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 10:40:25.180376 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9611c03b-f729-4107-bde8-e4ca5112a930 None admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:25.195877 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 416/829] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jul 14 10:40:25 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 14 10:40:25.221270 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae5c3ae-f685-496b-98ff-72938074a51a None None] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:25.302993 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9611c03b-f729-4107-bde8-e4ca5112a930 None admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:25.320490 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=100 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:25.335709 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae5c3ae-f685-496b-98ff-72938074a51a None None] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:25.349682 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd0283b-d9c7-406f-a1ec-7d33339f4170 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:25.351475 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd0283b-d9c7-406f-a1ec-7d33339f4170 None admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:25.351915 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd0283b-d9c7-406f-a1ec-7d33339f4170 None admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:25.352361 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd0283b-d9c7-406f-a1ec-7d33339f4170 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:25.368277 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd0283b-d9c7-406f-a1ec-7d33339f4170 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:25.369982 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd0283b-d9c7-406f-a1ec-7d33339f4170 None admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:25.375029 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010d8047-aca9-4154-af12-deeefcd88759 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:25.376086 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010d8047-aca9-4154-af12-deeefcd88759 None admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:25.376572 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010d8047-aca9-4154-af12-deeefcd88759 None admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:25.377067 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010d8047-aca9-4154-af12-deeefcd88759 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:25.385037 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=100 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:25.389644 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010d8047-aca9-4154-af12-deeefcd88759 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 10:40:25.393366 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application [None req-4cd0283b-d9c7-406f-a1ec-7d33339f4170 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 10:40:25.393366 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:40:25.393366 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:40:25.393366 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:40:25.393366 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:40:25.393366 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:40:25.393366 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:40:25.393366 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:40:25.393366 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:40:25.393366 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:40:25.393366 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:40:25.393366 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:40:25.393366 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 10:40:25.393366 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 10:40:25.393366 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 10:40:25.394221 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 10:40:25.394221 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:40:25.394221 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:40:25.394221 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:40:25.394221 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:40:25.394221 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:40:25.394221 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:40:25.394221 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:40:25.394221 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application with Lock( Jul 14 10:40:25.394221 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:40:25.394221 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:40:25.394221 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:40:25.394221 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:40:25.394221 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:40:25.394221 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:40:25.394221 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:40:25.394221 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:40:25.395096 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 10:40:25.395096 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 10:40:25.395096 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 10:40:25.395096 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application Jul 14 10:40:25.400195 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 414/830] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Jul 14 10:40:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 10:40:25.400478 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application [None req-010d8047-aca9-4154-af12-deeefcd88759 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 10:40:25.400478 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:40:25.400478 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:40:25.400478 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:40:25.400478 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:40:25.400478 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:40:25.400478 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:40:25.400478 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:40:25.400478 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:40:25.400478 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:40:25.400478 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:40:25.400478 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:40:25.400478 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 10:40:25.400478 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 10:40:25.400478 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 10:40:25.400478 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 10:40:25.401599 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 10:40:25.401599 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 10:40:25.401599 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 10:40:25.401599 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 10:40:25.401599 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:40:25.401599 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:40:25.401599 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:40:25.401599 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:40:25.401599 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:40:25.401599 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:40:25.401599 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:40:25.401599 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application with Lock( Jul 14 10:40:25.401599 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:40:25.401599 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:40:25.401599 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:40:25.401599 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:40:25.402423 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:40:25.402423 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:40:25.402423 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:40:25.402423 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:40:25.402423 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 10:40:25.402423 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 10:40:25.402423 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 10:40:25.402423 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 10:40:25.402423 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 10:40:25.402423 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 10:40:25.402423 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 10:40:25.402423 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application Jul 14 10:40:25.403043 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd0283b-d9c7-406f-a1ec-7d33339f4170 None admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:25.405353 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 417/831] 10.222.0.16 () {56 vars in 1096 bytes} [Thu Jul 14 10:40:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 10:40:25.412920 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010d8047-aca9-4154-af12-deeefcd88759 None admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:25.524569 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010d8047-aca9-4154-af12-deeefcd88759 None admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:25.531731 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd0283b-d9c7-406f-a1ec-7d33339f4170 None admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:25.561952 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c013fda7-18fb-476e-ae2e-86a262aba264 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:25.563170 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c013fda7-18fb-476e-ae2e-86a262aba264 None admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:25.563894 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c013fda7-18fb-476e-ae2e-86a262aba264 None admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:25.564765 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c013fda7-18fb-476e-ae2e-86a262aba264 None admin] PATH_INFO: `/v3/roles` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:25.565978 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c013fda7-18fb-476e-ae2e-86a262aba264 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:40:25.566540 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c013fda7-18fb-476e-ae2e-86a262aba264 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:25.568237 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c013fda7-18fb-476e-ae2e-86a262aba264 None admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:25.569244 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f92de7-b61f-4019-a74d-9ab6f02dca37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:25.570025 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f92de7-b61f-4019-a74d-9ab6f02dca37 None admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:25.570305 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f92de7-b61f-4019-a74d-9ab6f02dca37 None admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:25.570649 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f92de7-b61f-4019-a74d-9ab6f02dca37 None admin] PATH_INFO: `/v3/domains` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:25.571607 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f92de7-b61f-4019-a74d-9ab6f02dca37 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:40:25.571763 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f92de7-b61f-4019-a74d-9ab6f02dca37 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:25.573125 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f92de7-b61f-4019-a74d-9ab6f02dca37 None admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:25.584006 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 418/832] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Jul 14 10:40:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:40:25.585516 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c013fda7-18fb-476e-ae2e-86a262aba264 None admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:25.594684 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 415/833] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Jul 14 10:40:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:40:25.597901 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f92de7-b61f-4019-a74d-9ab6f02dca37 None admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:25.626212 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=100 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:25.663041 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=100 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:25.715304 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c013fda7-18fb-476e-ae2e-86a262aba264 None admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:25.716313 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f92de7-b61f-4019-a74d-9ab6f02dca37 None admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:25.756238 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5dc8c0-2e32-4b3b-a461-9859227f2c64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:25.757375 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5dc8c0-2e32-4b3b-a461-9859227f2c64 None admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:25.757783 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5dc8c0-2e32-4b3b-a461-9859227f2c64 None admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:25.758157 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5dc8c0-2e32-4b3b-a461-9859227f2c64 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:25.759072 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963396df-22a8-4d54-8362-42ac2217ec63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:25.760051 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963396df-22a8-4d54-8362-42ac2217ec63 None admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:25.760653 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963396df-22a8-4d54-8362-42ac2217ec63 None admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:25.761126 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963396df-22a8-4d54-8362-42ac2217ec63 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:25.766295 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5dc8c0-2e32-4b3b-a461-9859227f2c64 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:25.767901 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5dc8c0-2e32-4b3b-a461-9859227f2c64 None admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:25.774474 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963396df-22a8-4d54-8362-42ac2217ec63 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:25.776112 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963396df-22a8-4d54-8362-42ac2217ec63 None admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:25.790132 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application [None req-6b5dc8c0-2e32-4b3b-a461-9859227f2c64 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 10:40:25.790132 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:40:25.790132 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:40:25.790132 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:40:25.790132 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:40:25.790132 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:40:25.790132 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:40:25.790132 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:40:25.790132 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:40:25.790132 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:40:25.790132 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:40:25.790132 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:40:25.790132 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 10:40:25.790132 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 10:40:25.790132 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 10:40:25.791024 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 10:40:25.791024 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:40:25.791024 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:40:25.791024 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:40:25.791024 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:40:25.791024 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:40:25.791024 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:40:25.791024 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:40:25.791024 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application with Lock( Jul 14 10:40:25.791024 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:40:25.791024 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:40:25.791024 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:40:25.791024 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:40:25.791024 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:40:25.791024 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:40:25.791024 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:40:25.791024 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:40:25.791928 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 10:40:25.791928 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 10:40:25.791928 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 10:40:25.791928 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 10:40:25.791928 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 10:40:25.791928 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 10:40:25.791928 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 10:40:25.791928 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application Jul 14 10:40:25.797118 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 416/834] 10.222.0.16 () {56 vars in 1111 bytes} [Thu Jul 14 10:40:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 10:40:25.800889 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5dc8c0-2e32-4b3b-a461-9859227f2c64 None admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:25.802184 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application [None req-963396df-22a8-4d54-8362-42ac2217ec63 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 10:40:25.802184 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:40:25.802184 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:40:25.802184 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:40:25.802184 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:40:25.802184 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:40:25.802184 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:40:25.802184 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:40:25.802184 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:40:25.802184 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:40:25.802184 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:40:25.802184 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:40:25.802184 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 10:40:25.802184 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 10:40:25.802184 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 10:40:25.803044 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 10:40:25.803044 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:40:25.803044 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:40:25.803044 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:40:25.803044 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:40:25.803044 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:40:25.803044 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:40:25.803044 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:40:25.803044 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application with Lock( Jul 14 10:40:25.803044 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:40:25.803044 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:40:25.803044 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:40:25.803044 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:40:25.803044 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:40:25.803044 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:40:25.803044 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:40:25.803044 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:40:25.803915 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 10:40:25.803915 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 10:40:25.803915 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 10:40:25.803915 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application Jul 14 10:40:25.812172 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 419/835] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Jul 14 10:40:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 10:40:25.813538 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963396df-22a8-4d54-8362-42ac2217ec63 None admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:25.906245 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=100 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:25.924821 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5dc8c0-2e32-4b3b-a461-9859227f2c64 None admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:25.943781 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963396df-22a8-4d54-8362-42ac2217ec63 None admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:25.960598 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=100 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:25.963476 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ce0d76-616d-491d-9d24-84ee909c0dad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:25.964515 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ce0d76-616d-491d-9d24-84ee909c0dad None admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:25.964788 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ce0d76-616d-491d-9d24-84ee909c0dad None admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:25.965191 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ce0d76-616d-491d-9d24-84ee909c0dad None admin] PATH_INFO: `/v3/projects` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:25.966289 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ce0d76-616d-491d-9d24-84ee909c0dad None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:40:25.966705 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ce0d76-616d-491d-9d24-84ee909c0dad None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:25.969500 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ce0d76-616d-491d-9d24-84ee909c0dad None admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:25.982523 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 417/836] 10.222.0.16 () {56 vars in 1148 bytes} [Thu Jul 14 10:40:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 10:40:25.984645 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f3e9e8-c98e-4525-8577-77e27d07b794 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:25.985350 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f3e9e8-c98e-4525-8577-77e27d07b794 None admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:25.985635 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f3e9e8-c98e-4525-8577-77e27d07b794 None admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:25.985913 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f3e9e8-c98e-4525-8577-77e27d07b794 None admin] PATH_INFO: `/v3/domains` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:25.986638 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f3e9e8-c98e-4525-8577-77e27d07b794 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:40:25.986946 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f3e9e8-c98e-4525-8577-77e27d07b794 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:25.988490 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f3e9e8-c98e-4525-8577-77e27d07b794 None admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:25.989115 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ce0d76-616d-491d-9d24-84ee909c0dad None admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:26.004870 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 420/837] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Jul 14 10:40:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 10:40:26.009160 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f3e9e8-c98e-4525-8577-77e27d07b794 None admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:26.112937 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ce0d76-616d-491d-9d24-84ee909c0dad None admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:26.128969 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f3e9e8-c98e-4525-8577-77e27d07b794 None admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:26.149331 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed4ef4c-b8f9-42b2-a648-2905d082f4b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:26.150227 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed4ef4c-b8f9-42b2-a648-2905d082f4b0 None admin] REQUEST_METHOD: `PUT` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:26.150512 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed4ef4c-b8f9-42b2-a648-2905d082f4b0 None admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:26.150789 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed4ef4c-b8f9-42b2-a648-2905d082f4b0 None admin] PATH_INFO: `/v3/projects/59391272ecbe48b0aa736cb43807be1d/users/0dfc7cd9c05e4f268d2ce316d531c4bd/roles/d58911e96aad48cf9ca61ac5df79e21d` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:26.166318 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eeff87f-acd6-496e-9cc7-0ced5ec7f3a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:26.166476 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed4ef4c-b8f9-42b2-a648-2905d082f4b0 None admin] RBAC: Authorizing `identity:create_grant(project_id=59391272ecbe48b0aa736cb43807be1d, user_id=0dfc7cd9c05e4f268d2ce316d531c4bd, role_id=d58911e96aad48cf9ca61ac5df79e21d)` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:26.167260 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eeff87f-acd6-496e-9cc7-0ced5ec7f3a1 None admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:26.167649 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eeff87f-acd6-496e-9cc7-0ced5ec7f3a1 None admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:26.167772 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed4ef4c-b8f9-42b2-a648-2905d082f4b0 None admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:26.168104 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eeff87f-acd6-496e-9cc7-0ced5ec7f3a1 None admin] PATH_INFO: `/v3/users/swift` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:26.169951 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=100 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:26.178873 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eeff87f-acd6-496e-9cc7-0ced5ec7f3a1 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:26.181271 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eeff87f-acd6-496e-9cc7-0ced5ec7f3a1 None admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:26.192797 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 418/838] 10.222.0.16 () {58 vars in 1439 bytes} [Thu Jul 14 10:40:25 2022] PUT /identity/v3/projects/59391272ecbe48b0aa736cb43807be1d/users/0dfc7cd9c05e4f268d2ce316d531c4bd/roles/d58911e96aad48cf9ca61ac5df79e21d => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:40:26.200323 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application [None req-3eeff87f-acd6-496e-9cc7-0ced5ec7f3a1 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 14 10:40:26.200323 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:40:26.200323 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:40:26.200323 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:40:26.200323 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:40:26.200323 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:40:26.200323 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:40:26.200323 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:40:26.200323 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:40:26.200323 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:40:26.200323 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:40:26.200323 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:40:26.200323 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 10:40:26.200323 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 10:40:26.200323 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 10:40:26.200323 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 10:40:26.201914 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:40:26.201914 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:40:26.201914 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 10:40:26.201914 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 10:40:26.201914 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 10:40:26.201914 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 10:40:26.201914 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:40:26.201914 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:40:26.201914 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:40:26.201914 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:40:26.201914 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:40:26.201914 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application with Lock( Jul 14 10:40:26.201914 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:40:26.201914 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:40:26.201914 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:40:26.201914 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:40:26.201914 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:40:26.201914 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:40:26.203163 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:40:26.203163 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:40:26.203163 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 10:40:26.203163 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 10:40:26.203163 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 10:40:26.203163 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 10:40:26.203163 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 10:40:26.203163 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 10:40:26.203163 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 14 10:40:26.203163 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application Jul 14 10:40:26.207167 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 421/839] 10.222.0.16 () {56 vars in 1096 bytes} [Thu Jul 14 10:40:26 2022] GET /identity/v3/users/swift => generated 83 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 10:40:26.210787 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed4ef4c-b8f9-42b2-a648-2905d082f4b0 None admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:26.334252 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed4ef4c-b8f9-42b2-a648-2905d082f4b0 None admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:26.374182 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094a4dd4-3179-4e06-adbe-4e8d177ae9c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:26.374950 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094a4dd4-3179-4e06-adbe-4e8d177ae9c3 None admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:26.375239 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094a4dd4-3179-4e06-adbe-4e8d177ae9c3 None admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:26.375517 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094a4dd4-3179-4e06-adbe-4e8d177ae9c3 None admin] PATH_INFO: `/v3/users` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:26.376371 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094a4dd4-3179-4e06-adbe-4e8d177ae9c3 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=86655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:40:26.376681 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094a4dd4-3179-4e06-adbe-4e8d177ae9c3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:26.378184 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094a4dd4-3179-4e06-adbe-4e8d177ae9c3 None admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:26.383513 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6799803b-7084-4c10-922f-cfe89a13dd1a None None] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:26.383803 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6799803b-7084-4c10-922f-cfe89a13dd1a None None] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:26.384080 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6799803b-7084-4c10-922f-cfe89a13dd1a None None] PATH_INFO: `/` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:26.386204 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 422/840] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jul 14 10:40:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 14 10:40:26.392573 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e412510f-38b9-4299-bfcb-8afbccb81db8 None None] REQUEST_METHOD: `POST` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:26.392893 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e412510f-38b9-4299-bfcb-8afbccb81db8 None None] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:26.393173 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e412510f-38b9-4299-bfcb-8afbccb81db8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:26.397479 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 419/841] 10.222.0.16 () {56 vars in 1135 bytes} [Thu Jul 14 10:40:26 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:40:26.403059 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094a4dd4-3179-4e06-adbe-4e8d177ae9c3 None admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:26.419755 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.auth.core [None req-e412510f-38b9-4299-bfcb-8afbccb81db8 None None] MFA Rules not processed for user `ae4bcdd8106d4bebbdcae96be33505bc`. Rule list: `[]` (Enabled: `True`). {{(pid=86656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:40:26.421351 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-e412510f-38b9-4299-bfcb-8afbccb81db8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:40:26.458117 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=100 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:26.462667 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:26.514245 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094a4dd4-3179-4e06-adbe-4e8d177ae9c3 None admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:26.519789 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 423/842] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jul 14 10:40:26 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 10:40:26.543372 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e412510f-38b9-4299-bfcb-8afbccb81db8 None None] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:26.566835 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc64716d-89a3-404d-ab55-5632cfe8fcd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:26.567862 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc64716d-89a3-404d-ab55-5632cfe8fcd2 None admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:26.568824 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc64716d-89a3-404d-ab55-5632cfe8fcd2 None admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:26.569340 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc64716d-89a3-404d-ab55-5632cfe8fcd2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:26.662633 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc64716d-89a3-404d-ab55-5632cfe8fcd2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:26.664942 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc64716d-89a3-404d-ab55-5632cfe8fcd2 None admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:26.669277 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e412510f-38b9-4299-bfcb-8afbccb81db8 None None] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:26.714362 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628d1022-9c1d-43be-b8e9-284687f2403a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:26.715469 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628d1022-9c1d-43be-b8e9-284687f2403a None admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:26.715962 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628d1022-9c1d-43be-b8e9-284687f2403a None admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:26.716435 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628d1022-9c1d-43be-b8e9-284687f2403a None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:26.717362 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628d1022-9c1d-43be-b8e9-284687f2403a None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:26.718962 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628d1022-9c1d-43be-b8e9-284687f2403a None admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:26.729138 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=100 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:26.731784 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application [None req-628d1022-9c1d-43be-b8e9-284687f2403a None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 14 10:40:26.731784 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:40:26.731784 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 14 10:40:26.731784 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 14 10:40:26.731784 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 14 10:40:26.731784 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 14 10:40:26.731784 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 14 10:40:26.731784 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 10:40:26.731784 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 14 10:40:26.731784 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application Jul 14 10:40:26.731784 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 10:40:26.731784 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application Jul 14 10:40:26.731784 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:40:26.731784 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:40:26.731784 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:40:26.731784 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:40:26.731784 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:40:26.733371 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:40:26.733371 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:40:26.733371 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:40:26.733371 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:40:26.733371 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:40:26.733371 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:40:26.733371 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 14 10:40:26.733371 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 14 10:40:26.733371 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 14 10:40:26.733371 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 14 10:40:26.733371 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:40:26.733371 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:40:26.733371 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:40:26.733371 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:40:26.733371 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:40:26.733371 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:40:26.734180 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:40:26.734180 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application with Lock( Jul 14 10:40:26.734180 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:40:26.734180 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:40:26.734180 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:40:26.734180 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:40:26.734180 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:40:26.734180 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:40:26.734180 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:40:26.734180 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:40:26.734180 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 14 10:40:26.734180 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 10:40:26.734180 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 14 10:40:26.734180 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application Jul 14 10:40:26.741116 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 424/843] 10.222.0.16 () {56 vars in 1114 bytes} [Thu Jul 14 10:40:26 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:40:26.743234 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628d1022-9c1d-43be-b8e9-284687f2403a None admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:26.772817 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=100 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:26.785964 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 420/844] 10.222.0.16 () {58 vars in 1282 bytes} [Thu Jul 14 10:40:26 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 14 10:40:26.787375 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc64716d-89a3-404d-ab55-5632cfe8fcd2 None admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:26.864121 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628d1022-9c1d-43be-b8e9-284687f2403a None admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:26.888445 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc64716d-89a3-404d-ab55-5632cfe8fcd2 None admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:26.901060 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872188b0-3af4-4ce8-86ef-f770b4a95175 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:26.901731 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872188b0-3af4-4ce8-86ef-f770b4a95175 None admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:26.902017 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872188b0-3af4-4ce8-86ef-f770b4a95175 None admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:26.902296 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872188b0-3af4-4ce8-86ef-f770b4a95175 None admin] PATH_INFO: `/v3/services` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:26.903011 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872188b0-3af4-4ce8-86ef-f770b4a95175 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=86656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:40:26.903323 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872188b0-3af4-4ce8-86ef-f770b4a95175 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:26.905506 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872188b0-3af4-4ce8-86ef-f770b4a95175 None admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:26.910629 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 425/845] 10.222.0.16 () {56 vars in 1114 bytes} [Thu Jul 14 10:40:26 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 10:40:26.916206 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781dce7b-cf77-458b-9cd9-b17e038c5b69 None None] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:26.916495 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781dce7b-cf77-458b-9cd9-b17e038c5b69 None None] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:26.916803 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781dce7b-cf77-458b-9cd9-b17e038c5b69 None None] PATH_INFO: `/` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:26.920824 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 426/846] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jul 14 10:40:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:40:26.920824 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781dce7b-cf77-458b-9cd9-b17e038c5b69 None None] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:26.930158 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f35f86c-659a-44dc-bcf4-4a6e4c213576 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:26.931040 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f35f86c-659a-44dc-bcf4-4a6e4c213576 None admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:26.931410 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f35f86c-659a-44dc-bcf4-4a6e4c213576 None admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:26.931742 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f35f86c-659a-44dc-bcf4-4a6e4c213576 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:26.942579 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f35f86c-659a-44dc-bcf4-4a6e4c213576 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:26.944007 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f35f86c-659a-44dc-bcf4-4a6e4c213576 None admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:26.962353 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application [None req-3f35f86c-659a-44dc-bcf4-4a6e4c213576 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 10:40:26.962353 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:40:26.962353 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:40:26.962353 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:40:26.962353 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:40:26.962353 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:40:26.962353 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:40:26.962353 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:40:26.962353 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:40:26.962353 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:40:26.962353 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:40:26.962353 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:40:26.962353 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 10:40:26.962353 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 10:40:26.962353 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 10:40:26.963277 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 10:40:26.963277 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:40:26.963277 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:40:26.963277 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:40:26.963277 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:40:26.963277 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:40:26.963277 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:40:26.963277 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:40:26.963277 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application with Lock( Jul 14 10:40:26.963277 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:40:26.963277 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:40:26.963277 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:40:26.963277 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:40:26.963277 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:40:26.963277 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:40:26.963277 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:40:26.963277 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:40:26.964190 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 10:40:26.964190 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 10:40:26.964190 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 10:40:26.964190 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application Jul 14 10:40:26.964190 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 421/847] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Jul 14 10:40:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:40:26.965436 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e394af1d-abf9-4524-8466-14d42573147f None None] REQUEST_METHOD: `POST` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:26.965436 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e394af1d-abf9-4524-8466-14d42573147f None None] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:26.965436 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e394af1d-abf9-4524-8466-14d42573147f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:26.972965 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=100 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:26.985614 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.auth.core [None req-e394af1d-abf9-4524-8466-14d42573147f None None] MFA Rules not processed for user `ae4bcdd8106d4bebbdcae96be33505bc`. Rule list: `[]` (Enabled: `True`). {{(pid=86655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:40:26.986804 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-e394af1d-abf9-4524-8466-14d42573147f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:40:27.029194 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=100 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:27.041733 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781dce7b-cf77-458b-9cd9-b17e038c5b69 None None] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:27.058421 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 422/848] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jul 14 10:40:26 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 10:40:27.059439 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e394af1d-abf9-4524-8466-14d42573147f None None] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:27.082648 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba173d2-942a-4daa-8957-b7d9a187f4fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:27.083316 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba173d2-942a-4daa-8957-b7d9a187f4fc None admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:27.083712 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba173d2-942a-4daa-8957-b7d9a187f4fc None admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:27.083990 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba173d2-942a-4daa-8957-b7d9a187f4fc None admin] PATH_INFO: `/v3/services` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:27.084846 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba173d2-942a-4daa-8957-b7d9a187f4fc None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=86656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:40:27.085158 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba173d2-942a-4daa-8957-b7d9a187f4fc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:27.086525 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba173d2-942a-4daa-8957-b7d9a187f4fc None admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:27.095439 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 427/849] 10.222.0.16 () {56 vars in 1114 bytes} [Thu Jul 14 10:40:26 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:40:27.095439 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba173d2-942a-4daa-8957-b7d9a187f4fc None admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:27.190363 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e394af1d-abf9-4524-8466-14d42573147f None None] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:27.229459 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44e50a5-2ac0-49a3-8d5c-40e359048435 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:27.230175 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44e50a5-2ac0-49a3-8d5c-40e359048435 None admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:27.230564 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44e50a5-2ac0-49a3-8d5c-40e359048435 None admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:27.230916 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44e50a5-2ac0-49a3-8d5c-40e359048435 None admin] PATH_INFO: `/v3/domains` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:27.231776 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44e50a5-2ac0-49a3-8d5c-40e359048435 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:40:27.232333 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44e50a5-2ac0-49a3-8d5c-40e359048435 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:27.233922 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44e50a5-2ac0-49a3-8d5c-40e359048435 None admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:27.234759 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba173d2-942a-4daa-8957-b7d9a187f4fc None admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:27.235768 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=100 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:27.249910 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 423/850] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Jul 14 10:40:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:40:27.255607 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44e50a5-2ac0-49a3-8d5c-40e359048435 None admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:27.277045 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f4f6d0-9f8c-45b2-b248-c44f80a0e8d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:27.277855 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f4f6d0-9f8c-45b2-b248-c44f80a0e8d2 None admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:27.278137 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f4f6d0-9f8c-45b2-b248-c44f80a0e8d2 None admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:27.278410 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f4f6d0-9f8c-45b2-b248-c44f80a0e8d2 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:27.279070 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f4f6d0-9f8c-45b2-b248-c44f80a0e8d2 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:27.281094 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f4f6d0-9f8c-45b2-b248-c44f80a0e8d2 None admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:27.293547 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application [None req-85f4f6d0-9f8c-45b2-b248-c44f80a0e8d2 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 14 10:40:27.293547 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:40:27.293547 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 14 10:40:27.293547 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 14 10:40:27.293547 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 14 10:40:27.293547 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 14 10:40:27.293547 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 14 10:40:27.293547 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 10:40:27.293547 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 14 10:40:27.293547 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application Jul 14 10:40:27.293547 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 10:40:27.293547 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application Jul 14 10:40:27.293547 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:40:27.293547 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:40:27.293547 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:40:27.293547 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:40:27.294492 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:40:27.294492 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:40:27.294492 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:40:27.294492 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:40:27.294492 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:40:27.294492 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:40:27.294492 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:40:27.294492 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 14 10:40:27.294492 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 14 10:40:27.294492 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 14 10:40:27.294492 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 14 10:40:27.294492 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:40:27.294492 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:40:27.294492 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:40:27.294492 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:40:27.294492 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:40:27.295401 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:40:27.295401 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:40:27.295401 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application with Lock( Jul 14 10:40:27.295401 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:40:27.295401 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:40:27.295401 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:40:27.295401 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:40:27.295401 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:40:27.295401 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:40:27.295401 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:40:27.295401 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:40:27.295401 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 14 10:40:27.295401 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 10:40:27.295401 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 14 10:40:27.295401 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application Jul 14 10:40:27.295401 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 428/851] 10.222.0.16 () {56 vars in 1132 bytes} [Thu Jul 14 10:40:27 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:40:27.301088 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f4f6d0-9f8c-45b2-b248-c44f80a0e8d2 None admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:27.328217 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=100 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:27.385199 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44e50a5-2ac0-49a3-8d5c-40e359048435 None admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:27.422338 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317b12c1-54d5-4c8a-b5bc-5f2d40d08e7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:27.423151 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317b12c1-54d5-4c8a-b5bc-5f2d40d08e7d None admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:27.423447 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317b12c1-54d5-4c8a-b5bc-5f2d40d08e7d None admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:27.423733 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317b12c1-54d5-4c8a-b5bc-5f2d40d08e7d None admin] PATH_INFO: `/v3/projects/service` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:27.430931 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317b12c1-54d5-4c8a-b5bc-5f2d40d08e7d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:27.432569 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317b12c1-54d5-4c8a-b5bc-5f2d40d08e7d None admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:27.434979 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f4f6d0-9f8c-45b2-b248-c44f80a0e8d2 None admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:27.448363 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application [None req-317b12c1-54d5-4c8a-b5bc-5f2d40d08e7d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 10:40:27.448363 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:40:27.448363 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:40:27.448363 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:40:27.448363 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:40:27.448363 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:40:27.448363 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:40:27.448363 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:40:27.448363 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:40:27.448363 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:40:27.448363 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:40:27.448363 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:40:27.448363 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 10:40:27.448363 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 10:40:27.448363 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 10:40:27.449287 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 10:40:27.449287 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:40:27.449287 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:40:27.449287 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:40:27.449287 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:40:27.449287 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:40:27.449287 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:40:27.449287 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:40:27.449287 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application with Lock( Jul 14 10:40:27.449287 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:40:27.449287 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:40:27.449287 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:40:27.449287 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:40:27.449287 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:40:27.449287 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:40:27.449287 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:40:27.449287 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:40:27.450357 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 10:40:27.450357 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 10:40:27.450357 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 10:40:27.450357 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 10:40:27.450357 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 10:40:27.450357 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 10:40:27.450357 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 10:40:27.450357 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application Jul 14 10:40:27.450357 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 424/852] 10.222.0.16 () {56 vars in 1111 bytes} [Thu Jul 14 10:40:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 10:40:27.456056 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317b12c1-54d5-4c8a-b5bc-5f2d40d08e7d None admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:27.476944 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bc1c1f-cdcb-4ea0-ad53-f244680a6a6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:27.477789 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bc1c1f-cdcb-4ea0-ad53-f244680a6a6f None admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:27.478177 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bc1c1f-cdcb-4ea0-ad53-f244680a6a6f None admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:27.478564 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bc1c1f-cdcb-4ea0-ad53-f244680a6a6f None admin] PATH_INFO: `/v3/services` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:27.479382 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59bc1c1f-cdcb-4ea0-ad53-f244680a6a6f None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=86656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:40:27.479852 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59bc1c1f-cdcb-4ea0-ad53-f244680a6a6f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:27.481373 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59bc1c1f-cdcb-4ea0-ad53-f244680a6a6f None admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:27.493319 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 429/853] 10.222.0.16 () {56 vars in 1126 bytes} [Thu Jul 14 10:40:27 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 10:40:27.494427 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bc1c1f-cdcb-4ea0-ad53-f244680a6a6f None admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:27.533127 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=100 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:27.583892 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=100 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:27.586662 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317b12c1-54d5-4c8a-b5bc-5f2d40d08e7d None admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:27.605714 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bc1c1f-cdcb-4ea0-ad53-f244680a6a6f None admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:27.649239 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53ca19b-f8de-434e-a40a-534b930da82a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:27.650219 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53ca19b-f8de-434e-a40a-534b930da82a None admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:27.650655 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53ca19b-f8de-434e-a40a-534b930da82a None admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:27.651080 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53ca19b-f8de-434e-a40a-534b930da82a None admin] PATH_INFO: `/v3/services` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:27.651961 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53ca19b-f8de-434e-a40a-534b930da82a None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=86656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:40:27.652429 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53ca19b-f8de-434e-a40a-534b930da82a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:27.654088 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53ca19b-f8de-434e-a40a-534b930da82a None admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:27.660479 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 430/854] 10.222.0.16 () {56 vars in 1126 bytes} [Thu Jul 14 10:40:27 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:40:27.761944 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459a8eac-4bfb-422f-802b-cdf5e412ab80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:27.762551 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459a8eac-4bfb-422f-802b-cdf5e412ab80 None admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:27.762838 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459a8eac-4bfb-422f-802b-cdf5e412ab80 None admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:27.763117 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459a8eac-4bfb-422f-802b-cdf5e412ab80 None admin] PATH_INFO: `/v3/projects` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:27.764475 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459a8eac-4bfb-422f-802b-cdf5e412ab80 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:40:27.764799 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459a8eac-4bfb-422f-802b-cdf5e412ab80 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:27.766449 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459a8eac-4bfb-422f-802b-cdf5e412ab80 None admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:27.780364 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 425/855] 10.222.0.16 () {56 vars in 1148 bytes} [Thu Jul 14 10:40:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 325 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:40:27.786934 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53ca19b-f8de-434e-a40a-534b930da82a None admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:27.899879 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53ca19b-f8de-434e-a40a-534b930da82a None admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:27.934996 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e5a8e6-e80a-4566-b94f-ee217ca0e53d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:27.936453 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e5a8e6-e80a-4566-b94f-ee217ca0e53d None admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:27.936732 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e5a8e6-e80a-4566-b94f-ee217ca0e53d None admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:27.937037 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e5a8e6-e80a-4566-b94f-ee217ca0e53d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:27.937871 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e5a8e6-e80a-4566-b94f-ee217ca0e53d None admin] RBAC: Adding query filter params (role.id=153539819e5542df99269d2913bbecfb, scope.project.id=59391272ecbe48b0aa736cb43807be1d, user.id=8a23de49b80643eaab7a212f2884d62e) {{(pid=86656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:40:27.938182 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e5a8e6-e80a-4566-b94f-ee217ca0e53d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:27.939637 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e5a8e6-e80a-4566-b94f-ee217ca0e53d None admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:27.946294 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 431/856] 10.222.0.16 () {56 vars in 1374 bytes} [Thu Jul 14 10:40:27 2022] GET /identity/v3/role_assignments?user.id=8a23de49b80643eaab7a212f2884d62e&scope.project.id=59391272ecbe48b0aa736cb43807be1d&role.id=153539819e5542df99269d2913bbecfb => generated 608 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:40:28.339555 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea3d03e-7f6b-46af-a7ff-86681d85501d None None] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:28.340412 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea3d03e-7f6b-46af-a7ff-86681d85501d None None] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:28.340868 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea3d03e-7f6b-46af-a7ff-86681d85501d None None] PATH_INFO: `/` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:28.342804 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 426/857] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jul 14 10:40:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:40:28.348403 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004c7583-a084-42c6-b680-d01feb01dcd6 None None] REQUEST_METHOD: `POST` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:28.349273 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004c7583-a084-42c6-b680-d01feb01dcd6 None None] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:28.349758 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004c7583-a084-42c6-b680-d01feb01dcd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:28.367942 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.auth.core [None req-004c7583-a084-42c6-b680-d01feb01dcd6 None None] MFA Rules not processed for user `ae4bcdd8106d4bebbdcae96be33505bc`. Rule list: `[]` (Enabled: `True`). {{(pid=86656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:40:28.369516 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-004c7583-a084-42c6-b680-d01feb01dcd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:40:28.374466 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=100 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:28.442337 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 432/858] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jul 14 10:40:28 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 10:40:28.465632 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea3d03e-7f6b-46af-a7ff-86681d85501d None None] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:28.571075 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea3d03e-7f6b-46af-a7ff-86681d85501d None None] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:28.589368 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=100 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:28.607580 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc941de2-9934-4795-a58a-f2d3ff732ee0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:28.608394 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc941de2-9934-4795-a58a-f2d3ff732ee0 None admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:28.608677 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc941de2-9934-4795-a58a-f2d3ff732ee0 None admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:28.608981 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc941de2-9934-4795-a58a-f2d3ff732ee0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:28.619600 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc941de2-9934-4795-a58a-f2d3ff732ee0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 10:40:28.628155 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application [None req-fc941de2-9934-4795-a58a-f2d3ff732ee0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 14 10:40:28.628155 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:40:28.628155 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:40:28.628155 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:40:28.628155 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:40:28.628155 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:40:28.628155 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:40:28.628155 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:40:28.628155 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:40:28.628155 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:40:28.628155 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:40:28.628155 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:40:28.628155 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 10:40:28.628155 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 10:40:28.628155 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 10:40:28.628155 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 10:40:28.629121 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 10:40:28.629121 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 10:40:28.629121 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 10:40:28.629121 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 10:40:28.629121 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:40:28.629121 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:40:28.629121 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:40:28.629121 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:40:28.629121 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:40:28.629121 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:40:28.629121 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:40:28.629121 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application with Lock( Jul 14 10:40:28.629121 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:40:28.629121 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:40:28.629121 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:40:28.629121 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:40:28.629964 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:40:28.629964 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:40:28.629964 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:40:28.629964 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:40:28.629964 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 10:40:28.629964 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 10:40:28.629964 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 10:40:28.629964 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 10:40:28.629964 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 10:40:28.629964 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 10:40:28.629964 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 14 10:40:28.629964 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application Jul 14 10:40:28.629964 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 427/859] 10.222.0.16 () {56 vars in 1102 bytes} [Thu Jul 14 10:40:28 2022] GET /identity/v3/roles/service => generated 85 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:40:28.637082 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004c7583-a084-42c6-b680-d01feb01dcd6 None None] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:28.745787 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004c7583-a084-42c6-b680-d01feb01dcd6 None None] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:28.786744 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5209434f-1589-4c87-9d20-1ad14f912ecd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:28.786744 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5209434f-1589-4c87-9d20-1ad14f912ecd None admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:28.786744 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5209434f-1589-4c87-9d20-1ad14f912ecd None admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:28.786744 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5209434f-1589-4c87-9d20-1ad14f912ecd None admin] PATH_INFO: `/v3/roles` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:28.787086 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5209434f-1589-4c87-9d20-1ad14f912ecd None admin] RBAC: Adding query filter params (name=service) {{(pid=86656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:40:28.787086 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5209434f-1589-4c87-9d20-1ad14f912ecd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:28.787086 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5209434f-1589-4c87-9d20-1ad14f912ecd None admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:28.795678 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 433/860] 10.222.0.16 () {56 vars in 1103 bytes} [Thu Jul 14 10:40:28 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:40:28.809900 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc941de2-9934-4795-a58a-f2d3ff732ee0 None admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:28.919054 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc941de2-9934-4795-a58a-f2d3ff732ee0 None admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:28.953869 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ecb96f-48ff-4406-ad6c-3cc72c08e089 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:28.954661 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ecb96f-48ff-4406-ad6c-3cc72c08e089 None admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:28.954948 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ecb96f-48ff-4406-ad6c-3cc72c08e089 None admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:28.955219 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ecb96f-48ff-4406-ad6c-3cc72c08e089 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:28.965909 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ecb96f-48ff-4406-ad6c-3cc72c08e089 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:28.967516 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ecb96f-48ff-4406-ad6c-3cc72c08e089 None admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:28.985370 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application [None req-50ecb96f-48ff-4406-ad6c-3cc72c08e089 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 10:40:28.985370 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:40:28.985370 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:40:28.985370 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:40:28.985370 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:40:28.985370 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:40:28.985370 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:40:28.985370 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:40:28.985370 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:40:28.985370 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:40:28.985370 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:40:28.985370 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:40:28.985370 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 10:40:28.985370 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 10:40:28.985370 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 10:40:28.986278 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 10:40:28.986278 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:40:28.986278 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:40:28.986278 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:40:28.986278 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:40:28.986278 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:40:28.986278 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:40:28.986278 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:40:28.986278 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application with Lock( Jul 14 10:40:28.986278 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:40:28.986278 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:40:28.986278 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:40:28.986278 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:40:28.986278 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:40:28.986278 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:40:28.986278 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:40:28.986278 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:40:28.987158 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 10:40:28.987158 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 10:40:28.987158 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 10:40:28.987158 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application Jul 14 10:40:28.987158 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 428/861] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Jul 14 10:40:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:40:28.993556 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5209434f-1589-4c87-9d20-1ad14f912ecd None admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:28.996738 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=100 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:29.096860 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5209434f-1589-4c87-9d20-1ad14f912ecd None admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:29.141273 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4251523a-c79c-41cf-b02e-2f513cfeefa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:29.141941 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4251523a-c79c-41cf-b02e-2f513cfeefa4 None admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:29.142222 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4251523a-c79c-41cf-b02e-2f513cfeefa4 None admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:29.142495 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4251523a-c79c-41cf-b02e-2f513cfeefa4 None admin] PATH_INFO: `/v3/domains` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:29.143226 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4251523a-c79c-41cf-b02e-2f513cfeefa4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:40:29.143532 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4251523a-c79c-41cf-b02e-2f513cfeefa4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:29.144928 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4251523a-c79c-41cf-b02e-2f513cfeefa4 None admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:29.157873 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 434/862] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Jul 14 10:40:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:40:29.163393 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ecb96f-48ff-4406-ad6c-3cc72c08e089 None admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:29.193048 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=100 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:29.261334 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff01d3e-5fca-43e6-a469-6aa6356a0797 None None] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:29.261660 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff01d3e-5fca-43e6-a469-6aa6356a0797 None None] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:29.261904 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff01d3e-5fca-43e6-a469-6aa6356a0797 None None] PATH_INFO: `/` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:29.263275 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 435/863] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jul 14 10:40:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 14 10:40:29.268554 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064cb718-3bdb-4ebd-82d2-ffc790a59f47 None None] REQUEST_METHOD: `POST` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:29.269114 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064cb718-3bdb-4ebd-82d2-ffc790a59f47 None None] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:29.269593 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064cb718-3bdb-4ebd-82d2-ffc790a59f47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:29.272807 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ecb96f-48ff-4406-ad6c-3cc72c08e089 None admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:29.286437 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.auth.core [None req-064cb718-3bdb-4ebd-82d2-ffc790a59f47 None None] MFA Rules not processed for user `ae4bcdd8106d4bebbdcae96be33505bc`. Rule list: `[]` (Enabled: `True`). {{(pid=86656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:40:29.287899 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-064cb718-3bdb-4ebd-82d2-ffc790a59f47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:40:29.319610 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45b26b0-0284-42a6-8f4a-46c141d086f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:29.320920 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45b26b0-0284-42a6-8f4a-46c141d086f1 None admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:29.321450 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45b26b0-0284-42a6-8f4a-46c141d086f1 None admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:29.321962 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45b26b0-0284-42a6-8f4a-46c141d086f1 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:29.330609 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45b26b0-0284-42a6-8f4a-46c141d086f1 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:29.332352 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45b26b0-0284-42a6-8f4a-46c141d086f1 None admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:29.349989 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application [None req-b45b26b0-0284-42a6-8f4a-46c141d086f1 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 14 10:40:29.349989 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:40:29.349989 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:40:29.349989 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:40:29.349989 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:40:29.349989 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:40:29.349989 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:40:29.349989 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:40:29.349989 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:40:29.349989 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:40:29.349989 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:40:29.349989 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:40:29.349989 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 10:40:29.349989 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 10:40:29.349989 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 10:40:29.349989 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 10:40:29.351365 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:40:29.351365 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:40:29.351365 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 10:40:29.351365 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 10:40:29.351365 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 10:40:29.351365 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 10:40:29.351365 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:40:29.351365 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:40:29.351365 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:40:29.351365 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:40:29.351365 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:40:29.351365 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application with Lock( Jul 14 10:40:29.351365 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:40:29.351365 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:40:29.351365 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:40:29.351365 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:40:29.351365 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:40:29.351365 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:40:29.352300 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:40:29.352300 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:40:29.352300 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 10:40:29.352300 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 10:40:29.352300 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 10:40:29.352300 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 10:40:29.352300 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 10:40:29.352300 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 10:40:29.352300 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 14 10:40:29.352300 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application Jul 14 10:40:29.353765 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=100 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:29.356481 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 429/864] 10.222.0.16 () {56 vars in 1117 bytes} [Thu Jul 14 10:40:29 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:40:29.362500 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45b26b0-0284-42a6-8f4a-46c141d086f1 None admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:29.369421 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 436/865] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jul 14 10:40:29 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 14 10:40:29.391492 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064cb718-3bdb-4ebd-82d2-ffc790a59f47 None None] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:29.469267 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=100 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:29.479401 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45b26b0-0284-42a6-8f4a-46c141d086f1 None admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:29.507648 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064cb718-3bdb-4ebd-82d2-ffc790a59f47 None None] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:29.528584 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc97424-68fc-4d70-829b-86a94b64c623 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:29.530823 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc97424-68fc-4d70-829b-86a94b64c623 None admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:29.531263 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc97424-68fc-4d70-829b-86a94b64c623 None admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:29.531723 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc97424-68fc-4d70-829b-86a94b64c623 None admin] PATH_INFO: `/v3/users` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:29.533003 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc97424-68fc-4d70-829b-86a94b64c623 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=86655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:40:29.533724 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc97424-68fc-4d70-829b-86a94b64c623 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:29.536019 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc97424-68fc-4d70-829b-86a94b64c623 None admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:29.546170 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866699c6-149a-435f-b5f8-f44fb224a310 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:29.547140 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866699c6-149a-435f-b5f8-f44fb224a310 None admin] REQUEST_METHOD: `POST` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:29.547621 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866699c6-149a-435f-b5f8-f44fb224a310 None admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:29.548008 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866699c6-149a-435f-b5f8-f44fb224a310 None admin] PATH_INFO: `/v3/services` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:29.549223 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866699c6-149a-435f-b5f8-f44fb224a310 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:29.550423 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866699c6-149a-435f-b5f8-f44fb224a310 None admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:29.563442 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 430/866] 10.222.0.16 () {56 vars in 1149 bytes} [Thu Jul 14 10:40:29 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:40:29.565552 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc97424-68fc-4d70-829b-86a94b64c623 None admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:29.566832 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 437/867] 10.222.0.16 () {60 vars in 1141 bytes} [Thu Jul 14 10:40:29 2022] POST /identity/v3/services => generated 251 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 10:40:29.690359 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc97424-68fc-4d70-829b-86a94b64c623 None admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:29.737022 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec75c14-3a44-477d-831e-93c5007e185c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:29.737933 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec75c14-3a44-477d-831e-93c5007e185c None admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:29.738372 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec75c14-3a44-477d-831e-93c5007e185c None admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:29.738792 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec75c14-3a44-477d-831e-93c5007e185c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:29.751333 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=100 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:29.824225 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec75c14-3a44-477d-831e-93c5007e185c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:29.826059 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec75c14-3a44-477d-831e-93c5007e185c None admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:29.840078 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d95d775-68bc-4fd2-85f5-60acb94db033 None None] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:29.840403 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d95d775-68bc-4fd2-85f5-60acb94db033 None None] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:29.840724 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d95d775-68bc-4fd2-85f5-60acb94db033 None None] PATH_INFO: `/` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:29.843037 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 438/868] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jul 14 10:40:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:40:29.848387 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd92066-e351-41c2-b931-24f2fe345503 None None] REQUEST_METHOD: `POST` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:29.848681 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd92066-e351-41c2-b931-24f2fe345503 None None] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:29.848982 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd92066-e351-41c2-b931-24f2fe345503 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:29.869988 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.auth.core [None req-6fd92066-e351-41c2-b931-24f2fe345503 None None] MFA Rules not processed for user `ae4bcdd8106d4bebbdcae96be33505bc`. Rule list: `[]` (Enabled: `True`). {{(pid=86656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:40:29.871244 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-6fd92066-e351-41c2-b931-24f2fe345503 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:40:29.938636 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:29.939651 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 431/869] 10.222.0.16 () {58 vars in 1282 bytes} [Thu Jul 14 10:40:29 2022] GET /identity/v3/auth/tokens => generated 1252 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 14 10:40:29.945637 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec75c14-3a44-477d-831e-93c5007e185c None admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:29.974028 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 439/870] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jul 14 10:40:29 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 10:40:29.997697 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd92066-e351-41c2-b931-24f2fe345503 None None] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:29.999468 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=100 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:30.063131 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec75c14-3a44-477d-831e-93c5007e185c None admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:30.100795 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb890dc-d34a-4655-a596-24d79d3db2df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:30.101708 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb890dc-d34a-4655-a596-24d79d3db2df None admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:30.101974 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd92066-e351-41c2-b931-24f2fe345503 None None] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:30.102074 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb890dc-d34a-4655-a596-24d79d3db2df None admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:30.102421 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb890dc-d34a-4655-a596-24d79d3db2df None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:30.115201 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb890dc-d34a-4655-a596-24d79d3db2df None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:30.116764 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb890dc-d34a-4655-a596-24d79d3db2df None admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:30.135127 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application [None req-1fb890dc-d34a-4655-a596-24d79d3db2df None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 10:40:30.135127 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:40:30.135127 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:40:30.135127 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:40:30.135127 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:40:30.135127 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:40:30.135127 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:40:30.135127 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:40:30.135127 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:40:30.135127 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:40:30.135127 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:40:30.135127 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:40:30.135127 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 10:40:30.135127 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 10:40:30.135127 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 10:40:30.136064 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 10:40:30.136064 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:40:30.136064 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:40:30.136064 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:40:30.136064 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:40:30.136064 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:40:30.136064 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:40:30.136064 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:40:30.136064 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application with Lock( Jul 14 10:40:30.136064 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:40:30.136064 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:40:30.136064 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:40:30.136064 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:40:30.136064 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:40:30.136064 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:40:30.136064 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:40:30.136064 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:40:30.137553 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 10:40:30.137553 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 10:40:30.137553 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 10:40:30.137553 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application Jul 14 10:40:30.137553 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 432/871] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Jul 14 10:40:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 10:40:30.137839 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070f0560-fa79-4491-bc54-6f25b3b6fe60 None None] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:30.137905 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070f0560-fa79-4491-bc54-6f25b3b6fe60 None None] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:30.138181 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070f0560-fa79-4491-bc54-6f25b3b6fe60 None None] PATH_INFO: `/` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:30.140044 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 433/872] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jul 14 10:40:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:40:30.142736 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d071c1-e4b1-4cf2-98f8-70177d1dd97c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:30.143514 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d071c1-e4b1-4cf2-98f8-70177d1dd97c None admin] REQUEST_METHOD: `POST` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:30.143928 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d071c1-e4b1-4cf2-98f8-70177d1dd97c None admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:30.144103 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d071c1-e4b1-4cf2-98f8-70177d1dd97c None admin] PATH_INFO: `/v3/services` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:30.144520 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070f0560-fa79-4491-bc54-6f25b3b6fe60 None None] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:30.144838 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d071c1-e4b1-4cf2-98f8-70177d1dd97c None admin] RBAC: Authorizing `identity:create_service()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:30.146321 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d071c1-e4b1-4cf2-98f8-70177d1dd97c None admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:30.164935 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 440/873] 10.222.0.16 () {60 vars in 1141 bytes} [Thu Jul 14 10:40:29 2022] POST /identity/v3/services => generated 269 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 10:40:30.166278 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fbd67e-6633-4e8f-a5bf-cb8d41552726 None None] REQUEST_METHOD: `POST` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:30.166575 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fbd67e-6633-4e8f-a5bf-cb8d41552726 None None] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:30.166858 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fbd67e-6633-4e8f-a5bf-cb8d41552726 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:30.192236 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.auth.core [None req-f7fbd67e-6633-4e8f-a5bf-cb8d41552726 None None] MFA Rules not processed for user `ae4bcdd8106d4bebbdcae96be33505bc`. Rule list: `[]` (Enabled: `True`). {{(pid=86656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:40:30.193979 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-f7fbd67e-6633-4e8f-a5bf-cb8d41552726 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:40:30.245913 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:30.277268 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=100 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:30.285472 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070f0560-fa79-4491-bc54-6f25b3b6fe60 None None] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:30.293257 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 441/874] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jul 14 10:40:30 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 10:40:30.316463 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fbd67e-6633-4e8f-a5bf-cb8d41552726 None None] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:30.333230 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9f92ac-4f7a-41ea-a23d-a0bfb97c11b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:30.334307 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9f92ac-4f7a-41ea-a23d-a0bfb97c11b7 None admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:30.334783 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9f92ac-4f7a-41ea-a23d-a0bfb97c11b7 None admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:30.335443 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9f92ac-4f7a-41ea-a23d-a0bfb97c11b7 None admin] PATH_INFO: `/v3/domains` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:30.336195 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9f92ac-4f7a-41ea-a23d-a0bfb97c11b7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:40:30.336508 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9f92ac-4f7a-41ea-a23d-a0bfb97c11b7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:30.338347 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9f92ac-4f7a-41ea-a23d-a0bfb97c11b7 None admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:30.352392 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 434/875] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Jul 14 10:40:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:40:30.359705 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9f92ac-4f7a-41ea-a23d-a0bfb97c11b7 None admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:30.456848 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fbd67e-6633-4e8f-a5bf-cb8d41552726 None None] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:30.477529 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9f92ac-4f7a-41ea-a23d-a0bfb97c11b7 None admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:30.502215 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c659ee-4193-4bbf-98ee-bd51cba2d78f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:30.503667 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c659ee-4193-4bbf-98ee-bd51cba2d78f None admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:30.504055 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c659ee-4193-4bbf-98ee-bd51cba2d78f None admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:30.504712 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c659ee-4193-4bbf-98ee-bd51cba2d78f None admin] PATH_INFO: `/v3/services/object-store` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:30.505502 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c659ee-4193-4bbf-98ee-bd51cba2d78f None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:30.507654 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c659ee-4193-4bbf-98ee-bd51cba2d78f None admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:30.518645 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5cc7a4-2648-46ce-8e81-fbcdbb194585 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:30.519637 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5cc7a4-2648-46ce-8e81-fbcdbb194585 None admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:30.520072 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5cc7a4-2648-46ce-8e81-fbcdbb194585 None admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:30.520497 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5cc7a4-2648-46ce-8e81-fbcdbb194585 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:30.523818 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application [None req-25c659ee-4193-4bbf-98ee-bd51cba2d78f None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 14 10:40:30.523818 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:40:30.523818 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 14 10:40:30.523818 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 14 10:40:30.523818 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 14 10:40:30.523818 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 14 10:40:30.523818 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 14 10:40:30.523818 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 10:40:30.523818 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 14 10:40:30.523818 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application Jul 14 10:40:30.523818 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 10:40:30.523818 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application Jul 14 10:40:30.523818 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:40:30.523818 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:40:30.523818 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:40:30.523818 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:40:30.523818 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:40:30.525136 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:40:30.525136 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:40:30.525136 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:40:30.525136 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:40:30.525136 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:40:30.525136 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:40:30.525136 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 14 10:40:30.525136 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 14 10:40:30.525136 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 14 10:40:30.525136 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 14 10:40:30.525136 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:40:30.525136 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:40:30.525136 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:40:30.525136 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:40:30.525136 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:40:30.525136 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:40:30.525999 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:40:30.525999 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application with Lock( Jul 14 10:40:30.525999 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:40:30.525999 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:40:30.525999 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:40:30.525999 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:40:30.525999 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:40:30.525999 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:40:30.525999 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:40:30.525999 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:40:30.525999 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 14 10:40:30.525999 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 10:40:30.525999 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 14 10:40:30.525999 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application Jul 14 10:40:30.525999 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 442/876] 10.222.0.16 () {56 vars in 1126 bytes} [Thu Jul 14 10:40:30 2022] GET /identity/v3/services/object-store => generated 93 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 10:40:30.531780 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c659ee-4193-4bbf-98ee-bd51cba2d78f None admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:30.534032 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5cc7a4-2648-46ce-8e81-fbcdbb194585 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:30.535705 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5cc7a4-2648-46ce-8e81-fbcdbb194585 None admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:30.551075 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application [None req-2b5cc7a4-2648-46ce-8e81-fbcdbb194585 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 10:40:30.551075 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:40:30.551075 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:40:30.551075 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:40:30.551075 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:40:30.551075 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:40:30.551075 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:40:30.551075 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:40:30.551075 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:40:30.551075 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:40:30.551075 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:40:30.551075 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:40:30.551075 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 10:40:30.551075 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 10:40:30.551075 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 10:40:30.552000 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 10:40:30.552000 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:40:30.552000 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:40:30.552000 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:40:30.552000 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:40:30.552000 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:40:30.552000 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:40:30.552000 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:40:30.552000 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application with Lock( Jul 14 10:40:30.552000 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:40:30.552000 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:40:30.552000 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:40:30.552000 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:40:30.552000 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:40:30.552000 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:40:30.552000 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:40:30.552000 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:40:30.552907 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 10:40:30.552907 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 10:40:30.552907 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 10:40:30.552907 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 10:40:30.552907 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 10:40:30.552907 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 10:40:30.552907 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 10:40:30.552907 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application Jul 14 10:40:30.552907 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 435/877] 10.222.0.16 () {56 vars in 1111 bytes} [Thu Jul 14 10:40:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:40:30.557835 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5cc7a4-2648-46ce-8e81-fbcdbb194585 None admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:30.574334 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=100 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:30.579185 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=100 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:30.661229 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c659ee-4193-4bbf-98ee-bd51cba2d78f None admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:30.679414 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5cc7a4-2648-46ce-8e81-fbcdbb194585 None admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:30.701879 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5afab0-4550-48a3-85a9-a4a21bc2bb03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:30.702708 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5afab0-4550-48a3-85a9-a4a21bc2bb03 None admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:30.703113 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5afab0-4550-48a3-85a9-a4a21bc2bb03 None admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:30.703495 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5afab0-4550-48a3-85a9-a4a21bc2bb03 None admin] PATH_INFO: `/v3/services` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:30.704311 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5afab0-4550-48a3-85a9-a4a21bc2bb03 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=86656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:40:30.704849 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5afab0-4550-48a3-85a9-a4a21bc2bb03 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:30.706410 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5afab0-4550-48a3-85a9-a4a21bc2bb03 None admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:30.716697 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 443/878] 10.222.0.16 () {56 vars in 1122 bytes} [Thu Jul 14 10:40:30 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:40:30.718220 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5afab0-4550-48a3-85a9-a4a21bc2bb03 None admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:30.719841 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2ee208-f4e2-4579-8d60-191f6d9b74cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:30.720524 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2ee208-f4e2-4579-8d60-191f6d9b74cc None admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:30.720850 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2ee208-f4e2-4579-8d60-191f6d9b74cc None admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:30.721136 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2ee208-f4e2-4579-8d60-191f6d9b74cc None admin] PATH_INFO: `/v3/projects` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:30.721941 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2ee208-f4e2-4579-8d60-191f6d9b74cc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:40:30.722252 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2ee208-f4e2-4579-8d60-191f6d9b74cc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:30.723722 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2ee208-f4e2-4579-8d60-191f6d9b74cc None admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:30.736886 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 436/879] 10.222.0.16 () {56 vars in 1148 bytes} [Thu Jul 14 10:40:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 10:40:30.742708 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2ee208-f4e2-4579-8d60-191f6d9b74cc None admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:30.826480 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=100 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:30.843800 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=100 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:30.847525 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5afab0-4550-48a3-85a9-a4a21bc2bb03 None admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:30.867239 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2ee208-f4e2-4579-8d60-191f6d9b74cc None admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:30.890485 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ac7ac7-95a8-4d89-adc3-1aaaaeed56b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:30.891736 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ac7ac7-95a8-4d89-adc3-1aaaaeed56b3 None admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:30.892511 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ac7ac7-95a8-4d89-adc3-1aaaaeed56b3 None admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:30.893248 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ac7ac7-95a8-4d89-adc3-1aaaaeed56b3 None admin] PATH_INFO: `/v3/services` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:30.894264 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ac7ac7-95a8-4d89-adc3-1aaaaeed56b3 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=86656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:40:30.894755 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ac7ac7-95a8-4d89-adc3-1aaaaeed56b3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:30.896849 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ac7ac7-95a8-4d89-adc3-1aaaaeed56b3 None admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:30.902291 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 444/880] 10.222.0.16 () {56 vars in 1122 bytes} [Thu Jul 14 10:40:30 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:40:30.905595 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d2abb0-821c-4dc6-8186-e76fb5971ff5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:30.906498 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d2abb0-821c-4dc6-8186-e76fb5971ff5 None admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:30.906958 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d2abb0-821c-4dc6-8186-e76fb5971ff5 None admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:30.907436 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d2abb0-821c-4dc6-8186-e76fb5971ff5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:30.908474 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d2abb0-821c-4dc6-8186-e76fb5971ff5 None admin] RBAC: Adding query filter params (role.id=d58911e96aad48cf9ca61ac5df79e21d, scope.project.id=59391272ecbe48b0aa736cb43807be1d, user.id=0dfc7cd9c05e4f268d2ce316d531c4bd) {{(pid=86655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:40:30.908997 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d2abb0-821c-4dc6-8186-e76fb5971ff5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:30.910641 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d2abb0-821c-4dc6-8186-e76fb5971ff5 None admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:30.924942 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 437/881] 10.222.0.16 () {56 vars in 1374 bytes} [Thu Jul 14 10:40:30 2022] GET /identity/v3/role_assignments?user.id=0dfc7cd9c05e4f268d2ce316d531c4bd&scope.project.id=59391272ecbe48b0aa736cb43807be1d&role.id=d58911e96aad48cf9ca61ac5df79e21d => generated 608 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:40:31.684666 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b31d33-ac5f-4804-87b5-50757d8c1363 None None] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:31.685457 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b31d33-ac5f-4804-87b5-50757d8c1363 None None] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:31.686052 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b31d33-ac5f-4804-87b5-50757d8c1363 None None] PATH_INFO: `/` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:31.687930 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 445/882] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jul 14 10:40:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:40:31.693318 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0311dc8c-6059-4e28-8ea8-ac9e19f1e6e1 None None] REQUEST_METHOD: `POST` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:31.693782 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0311dc8c-6059-4e28-8ea8-ac9e19f1e6e1 None None] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:31.694065 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0311dc8c-6059-4e28-8ea8-ac9e19f1e6e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:31.710932 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.auth.core [None req-0311dc8c-6059-4e28-8ea8-ac9e19f1e6e1 None None] MFA Rules not processed for user `ae4bcdd8106d4bebbdcae96be33505bc`. Rule list: `[]` (Enabled: `True`). {{(pid=86655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:40:31.712108 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-0311dc8c-6059-4e28-8ea8-ac9e19f1e6e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:40:31.783530 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 438/883] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jul 14 10:40:31 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 10:40:31.805655 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b31d33-ac5f-4804-87b5-50757d8c1363 None None] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:31.913048 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b31d33-ac5f-4804-87b5-50757d8c1363 None None] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:31.948156 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4707045f-2f3e-43a8-bb37-da34618f7689 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:31.949464 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4707045f-2f3e-43a8-bb37-da34618f7689 None admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:31.949969 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4707045f-2f3e-43a8-bb37-da34618f7689 None admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:31.950441 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4707045f-2f3e-43a8-bb37-da34618f7689 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:31.951447 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4707045f-2f3e-43a8-bb37-da34618f7689 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:31.953059 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4707045f-2f3e-43a8-bb37-da34618f7689 None admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:31.965310 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application [None req-4707045f-2f3e-43a8-bb37-da34618f7689 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 14 10:40:31.965310 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:40:31.965310 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 14 10:40:31.965310 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 14 10:40:31.965310 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 14 10:40:31.965310 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 14 10:40:31.965310 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 14 10:40:31.965310 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 10:40:31.965310 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 14 10:40:31.965310 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application Jul 14 10:40:31.965310 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 10:40:31.965310 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application Jul 14 10:40:31.965310 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:40:31.965310 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:40:31.965310 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:40:31.965310 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:40:31.965310 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:40:31.966279 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:40:31.966279 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:40:31.966279 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:40:31.966279 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:40:31.966279 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:40:31.966279 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:40:31.966279 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 14 10:40:31.966279 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 14 10:40:31.966279 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 14 10:40:31.966279 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 14 10:40:31.966279 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:40:31.966279 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:40:31.966279 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:40:31.966279 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:40:31.966279 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:40:31.966279 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:40:31.967128 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:40:31.967128 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application with Lock( Jul 14 10:40:31.967128 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:40:31.967128 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:40:31.967128 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:40:31.967128 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:40:31.967128 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:40:31.967128 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:40:31.967128 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:40:31.967128 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:40:31.967128 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 14 10:40:31.967128 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 10:40:31.967128 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 14 10:40:31.967128 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application Jul 14 10:40:31.969988 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 446/884] 10.222.0.16 () {56 vars in 1114 bytes} [Thu Jul 14 10:40:31 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:40:31.976826 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0311dc8c-6059-4e28-8ea8-ac9e19f1e6e1 None None] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:32.037013 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=100 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:32.081505 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0311dc8c-6059-4e28-8ea8-ac9e19f1e6e1 None None] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:32.119449 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d931ee1-f39e-4e9d-91f1-5bfa9fd929b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:32.120488 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d931ee1-f39e-4e9d-91f1-5bfa9fd929b1 None admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:32.121009 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d931ee1-f39e-4e9d-91f1-5bfa9fd929b1 None admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:32.121505 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d931ee1-f39e-4e9d-91f1-5bfa9fd929b1 None admin] PATH_INFO: `/v3/services` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:32.122437 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d931ee1-f39e-4e9d-91f1-5bfa9fd929b1 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=86655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:40:32.123014 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d931ee1-f39e-4e9d-91f1-5bfa9fd929b1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:32.124746 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d931ee1-f39e-4e9d-91f1-5bfa9fd929b1 None admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:32.130533 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 439/885] 10.222.0.16 () {56 vars in 1114 bytes} [Thu Jul 14 10:40:31 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:40:32.138008 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4707045f-2f3e-43a8-bb37-da34618f7689 None admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:32.168983 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=100 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:32.242817 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4707045f-2f3e-43a8-bb37-da34618f7689 None admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:32.277249 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28efc550-720a-4022-b736-c98aba621284 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:32.278149 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28efc550-720a-4022-b736-c98aba621284 None admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:32.278577 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28efc550-720a-4022-b736-c98aba621284 None admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:32.279089 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28efc550-720a-4022-b736-c98aba621284 None admin] PATH_INFO: `/v3/services` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:32.280869 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28efc550-720a-4022-b736-c98aba621284 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=86656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:40:32.281329 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28efc550-720a-4022-b736-c98aba621284 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:32.281441 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1511486e-fa60-4cdb-8e40-bf6c36ca2cfd None None] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:32.281729 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1511486e-fa60-4cdb-8e40-bf6c36ca2cfd None None] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:32.282146 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1511486e-fa60-4cdb-8e40-bf6c36ca2cfd None None] PATH_INFO: `/` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:32.283254 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28efc550-720a-4022-b736-c98aba621284 None admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:32.284451 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 440/886] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jul 14 10:40:32 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:40:32.289393 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 447/887] 10.222.0.16 () {56 vars in 1114 bytes} [Thu Jul 14 10:40:32 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:40:32.290161 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58599f31-357f-4c0e-ad5f-dd5ef01f1dbe None None] REQUEST_METHOD: `POST` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:32.290452 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58599f31-357f-4c0e-ad5f-dd5ef01f1dbe None None] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:32.290731 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58599f31-357f-4c0e-ad5f-dd5ef01f1dbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:32.300811 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28efc550-720a-4022-b736-c98aba621284 None admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:32.308735 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.auth.core [None req-58599f31-357f-4c0e-ad5f-dd5ef01f1dbe None None] MFA Rules not processed for user `ae4bcdd8106d4bebbdcae96be33505bc`. Rule list: `[]` (Enabled: `True`). {{(pid=86655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:40:32.309940 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-58599f31-357f-4c0e-ad5f-dd5ef01f1dbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:40:32.380357 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 441/888] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jul 14 10:40:32 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 14 10:40:32.401846 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28efc550-720a-4022-b736-c98aba621284 None admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:32.402691 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58599f31-357f-4c0e-ad5f-dd5ef01f1dbe None None] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:32.405125 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=100 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:32.448364 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422ed97e-2250-47d0-9461-ac22aba6e408 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:32.449055 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422ed97e-2250-47d0-9461-ac22aba6e408 None admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:32.449344 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422ed97e-2250-47d0-9461-ac22aba6e408 None admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:32.449629 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422ed97e-2250-47d0-9461-ac22aba6e408 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:32.450418 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422ed97e-2250-47d0-9461-ac22aba6e408 None admin] RBAC: Adding query filter params (interface=public, service_id=f33e6f59fca546b6a303023ecc415a9e, region_id=RegionOne) {{(pid=86656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:40:32.450736 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422ed97e-2250-47d0-9461-ac22aba6e408 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:32.452685 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422ed97e-2250-47d0-9461-ac22aba6e408 None admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:32.458203 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 448/889] 10.222.0.16 () {56 vars in 1251 bytes} [Thu Jul 14 10:40:32 2022] GET /identity/v3/endpoints?service_id=f33e6f59fca546b6a303023ecc415a9e&interface=public®ion_id=RegionOne => generated 194 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:40:32.463603 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422ed97e-2250-47d0-9461-ac22aba6e408 None admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:32.464706 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=100 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:32.525952 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58599f31-357f-4c0e-ad5f-dd5ef01f1dbe None None] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:32.565035 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73526d4-fb9d-406a-b09c-d6d0f9bb1273 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:32.566020 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73526d4-fb9d-406a-b09c-d6d0f9bb1273 None admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:32.566310 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73526d4-fb9d-406a-b09c-d6d0f9bb1273 None admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:32.566590 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73526d4-fb9d-406a-b09c-d6d0f9bb1273 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:32.567306 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73526d4-fb9d-406a-b09c-d6d0f9bb1273 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:32.568850 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73526d4-fb9d-406a-b09c-d6d0f9bb1273 None admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:32.578912 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422ed97e-2250-47d0-9461-ac22aba6e408 None admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:32.582703 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application [None req-a73526d4-fb9d-406a-b09c-d6d0f9bb1273 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 14 10:40:32.582703 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:40:32.582703 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 14 10:40:32.582703 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 14 10:40:32.582703 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 14 10:40:32.582703 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 14 10:40:32.582703 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 14 10:40:32.582703 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 10:40:32.582703 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 14 10:40:32.582703 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application Jul 14 10:40:32.582703 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 10:40:32.582703 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application Jul 14 10:40:32.582703 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:40:32.582703 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:40:32.582703 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:40:32.582703 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:40:32.583604 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:40:32.583604 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:40:32.583604 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:40:32.583604 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:40:32.583604 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:40:32.583604 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:40:32.583604 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:40:32.583604 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 14 10:40:32.583604 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 14 10:40:32.583604 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 14 10:40:32.583604 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 14 10:40:32.583604 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:40:32.583604 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:40:32.583604 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:40:32.583604 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:40:32.583604 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:40:32.584428 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:40:32.584428 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:40:32.584428 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application with Lock( Jul 14 10:40:32.584428 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:40:32.584428 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:40:32.584428 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:40:32.584428 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:40:32.584428 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:40:32.584428 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:40:32.584428 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:40:32.584428 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:40:32.584428 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 14 10:40:32.584428 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 10:40:32.584428 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 14 10:40:32.584428 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application Jul 14 10:40:32.584428 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 442/890] 10.222.0.16 () {56 vars in 1132 bytes} [Thu Jul 14 10:40:32 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:40:32.593039 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73526d4-fb9d-406a-b09c-d6d0f9bb1273 None admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:32.619064 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a597a312-fee3-4938-8fe4-9149961b74fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:32.619741 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a597a312-fee3-4938-8fe4-9149961b74fc None admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:32.620028 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a597a312-fee3-4938-8fe4-9149961b74fc None admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:32.620309 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a597a312-fee3-4938-8fe4-9149961b74fc None admin] PATH_INFO: `/v3/services` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:32.621038 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a597a312-fee3-4938-8fe4-9149961b74fc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:32.622416 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a597a312-fee3-4938-8fe4-9149961b74fc None admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:32.629449 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 449/891] 10.222.0.16 () {56 vars in 1087 bytes} [Thu Jul 14 10:40:32 2022] GET /identity/v3/services => generated 1268 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 10:40:32.712285 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73526d4-fb9d-406a-b09c-d6d0f9bb1273 None admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:32.735516 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=100 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:32.751931 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59e0de8-2ef7-4f4d-9713-199f0e7fd1b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:32.752618 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59e0de8-2ef7-4f4d-9713-199f0e7fd1b5 None admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:32.753015 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59e0de8-2ef7-4f4d-9713-199f0e7fd1b5 None admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:32.753296 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59e0de8-2ef7-4f4d-9713-199f0e7fd1b5 None admin] PATH_INFO: `/v3/services` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:32.754029 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59e0de8-2ef7-4f4d-9713-199f0e7fd1b5 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=86655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:40:32.754337 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59e0de8-2ef7-4f4d-9713-199f0e7fd1b5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:32.755737 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59e0de8-2ef7-4f4d-9713-199f0e7fd1b5 None admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:32.761708 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 443/892] 10.222.0.16 () {56 vars in 1126 bytes} [Thu Jul 14 10:40:32 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 10:40:32.768112 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a597a312-fee3-4938-8fe4-9149961b74fc None admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:32.797791 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=100 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:32.882150 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a597a312-fee3-4938-8fe4-9149961b74fc None admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:32.918652 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0f417c-02fb-4bce-a58e-397678e2e8d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:32.919324 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0f417c-02fb-4bce-a58e-397678e2e8d3 None admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:32.919608 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0f417c-02fb-4bce-a58e-397678e2e8d3 None admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:32.920437 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0f417c-02fb-4bce-a58e-397678e2e8d3 None admin] PATH_INFO: `/v3/services` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:32.921184 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0f417c-02fb-4bce-a58e-397678e2e8d3 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=86656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:40:32.921498 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0f417c-02fb-4bce-a58e-397678e2e8d3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:32.922872 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0f417c-02fb-4bce-a58e-397678e2e8d3 None admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:32.928201 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 450/893] 10.222.0.16 () {56 vars in 1126 bytes} [Thu Jul 14 10:40:32 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:40:32.933908 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59e0de8-2ef7-4f4d-9713-199f0e7fd1b5 None admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:33.042038 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59e0de8-2ef7-4f4d-9713-199f0e7fd1b5 None admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:33.078347 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6295e35d-490f-45be-8d1b-52cbbee7b3c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:33.078986 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6295e35d-490f-45be-8d1b-52cbbee7b3c0 None admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:33.079274 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6295e35d-490f-45be-8d1b-52cbbee7b3c0 None admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:33.079553 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6295e35d-490f-45be-8d1b-52cbbee7b3c0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:33.080355 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6295e35d-490f-45be-8d1b-52cbbee7b3c0 None admin] RBAC: Adding query filter params (interface=public, service_id=ca2f84b733784c5e8744a70c1d191bc1, region_id=RegionOne) {{(pid=86655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:40:33.080670 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6295e35d-490f-45be-8d1b-52cbbee7b3c0 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:33.082069 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6295e35d-490f-45be-8d1b-52cbbee7b3c0 None admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:33.087313 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 444/894] 10.222.0.16 () {56 vars in 1251 bytes} [Thu Jul 14 10:40:32 2022] GET /identity/v3/endpoints?service_id=ca2f84b733784c5e8744a70c1d191bc1&interface=public®ion_id=RegionOne => generated 194 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:40:33.093527 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0f417c-02fb-4bce-a58e-397678e2e8d3 None admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:33.099712 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a9082f-12d0-4312-8194-b5059d4ad8ec None None] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:33.100003 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a9082f-12d0-4312-8194-b5059d4ad8ec None None] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:33.100412 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a9082f-12d0-4312-8194-b5059d4ad8ec None None] PATH_INFO: `/` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:33.102853 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 445/895] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jul 14 10:40:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 14 10:40:33.106874 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde22697-dfa6-4fad-ae72-e6bb144f95e9 None None] REQUEST_METHOD: `POST` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:33.107164 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde22697-dfa6-4fad-ae72-e6bb144f95e9 None None] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:33.108024 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde22697-dfa6-4fad-ae72-e6bb144f95e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:33.125282 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.auth.core [None req-fde22697-dfa6-4fad-ae72-e6bb144f95e9 None None] MFA Rules not processed for user `ae4bcdd8106d4bebbdcae96be33505bc`. Rule list: `[]` (Enabled: `True`). {{(pid=86655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:40:33.126903 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-fde22697-dfa6-4fad-ae72-e6bb144f95e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:40:33.174337 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=100 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:33.193486 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=100 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:33.199742 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 446/896] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jul 14 10:40:33 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 14 10:40:33.201044 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61cda66-d0a8-43b3-8479-3b6f56a8fe45 None None] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:33.201861 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61cda66-d0a8-43b3-8479-3b6f56a8fe45 None None] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:33.202157 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61cda66-d0a8-43b3-8479-3b6f56a8fe45 None None] PATH_INFO: `/` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:33.203605 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 447/897] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jul 14 10:40:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:40:33.208745 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2192124c-93d7-4801-a590-ae09d4f0cf8b None None] REQUEST_METHOD: `POST` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:33.209061 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2192124c-93d7-4801-a590-ae09d4f0cf8b None None] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:33.209505 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2192124c-93d7-4801-a590-ae09d4f0cf8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:33.214389 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0f417c-02fb-4bce-a58e-397678e2e8d3 None admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:33.228078 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.auth.core [None req-2192124c-93d7-4801-a590-ae09d4f0cf8b None None] MFA Rules not processed for user `ae4bcdd8106d4bebbdcae96be33505bc`. Rule list: `[]` (Enabled: `True`). {{(pid=86655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:40:33.229635 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-2192124c-93d7-4801-a590-ae09d4f0cf8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:40:33.252193 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f477f1-d60f-4245-8ee4-1e22f5b8b18b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:33.252908 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f477f1-d60f-4245-8ee4-1e22f5b8b18b None admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:33.253184 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f477f1-d60f-4245-8ee4-1e22f5b8b18b None admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:33.253459 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f477f1-d60f-4245-8ee4-1e22f5b8b18b None admin] PATH_INFO: `/v3/services` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:33.254145 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f477f1-d60f-4245-8ee4-1e22f5b8b18b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:33.255510 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f477f1-d60f-4245-8ee4-1e22f5b8b18b None admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:33.269037 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 451/898] 10.222.0.16 () {56 vars in 1087 bytes} [Thu Jul 14 10:40:33 2022] GET /identity/v3/services => generated 1268 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:40:33.269037 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f477f1-d60f-4245-8ee4-1e22f5b8b18b None admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:33.314348 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 448/899] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jul 14 10:40:33 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 14 10:40:33.337765 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2192124c-93d7-4801-a590-ae09d4f0cf8b None None] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:33.384473 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f477f1-d60f-4245-8ee4-1e22f5b8b18b None admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:33.424452 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ff9f7d-8e63-417f-ab36-3fdf394c232c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:33.425326 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ff9f7d-8e63-417f-ab36-3fdf394c232c None admin] REQUEST_METHOD: `POST` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:33.425681 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ff9f7d-8e63-417f-ab36-3fdf394c232c None admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:33.426068 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ff9f7d-8e63-417f-ab36-3fdf394c232c None admin] PATH_INFO: `/v3/services` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:33.426917 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ff9f7d-8e63-417f-ab36-3fdf394c232c None admin] RBAC: Authorizing `identity:create_service()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:33.428343 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ff9f7d-8e63-417f-ab36-3fdf394c232c None admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:33.445875 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 452/900] 10.222.0.16 () {60 vars in 1141 bytes} [Thu Jul 14 10:40:33 2022] POST /identity/v3/services => generated 241 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:40:33.466956 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2192124c-93d7-4801-a590-ae09d4f0cf8b None None] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:33.481456 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=100 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:33.523787 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a9df1b-0eda-43c9-a6f5-8eb7313b0105 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:33.524908 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a9df1b-0eda-43c9-a6f5-8eb7313b0105 None admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:33.525343 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a9df1b-0eda-43c9-a6f5-8eb7313b0105 None admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:33.525794 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a9df1b-0eda-43c9-a6f5-8eb7313b0105 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:33.546504 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a9df1b-0eda-43c9-a6f5-8eb7313b0105 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 10:40:33.555577 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application [None req-05a9df1b-0eda-43c9-a6f5-8eb7313b0105 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 14 10:40:33.555577 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:40:33.555577 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:40:33.555577 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:40:33.555577 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:40:33.555577 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:40:33.555577 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:40:33.555577 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:40:33.555577 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:40:33.555577 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:40:33.555577 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:40:33.555577 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:40:33.555577 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 10:40:33.555577 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 10:40:33.555577 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 10:40:33.555577 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 10:40:33.556738 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 10:40:33.556738 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 10:40:33.556738 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 10:40:33.556738 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 10:40:33.556738 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:40:33.556738 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:40:33.556738 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:40:33.556738 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:40:33.556738 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:40:33.556738 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:40:33.556738 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:40:33.556738 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application with Lock( Jul 14 10:40:33.556738 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:40:33.556738 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:40:33.556738 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:40:33.556738 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:40:33.557810 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:40:33.557810 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:40:33.557810 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:40:33.557810 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:40:33.557810 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 10:40:33.557810 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 10:40:33.557810 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 10:40:33.557810 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 10:40:33.557810 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 10:40:33.557810 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 10:40:33.557810 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 14 10:40:33.557810 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application Jul 14 10:40:33.557810 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 449/901] 10.222.0.16 () {56 vars in 1120 bytes} [Thu Jul 14 10:40:33 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 10:40:33.564295 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ff9f7d-8e63-417f-ab36-3fdf394c232c None admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:33.577711 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:33.673696 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ff9f7d-8e63-417f-ab36-3fdf394c232c None admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:33.710325 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d53d728-bba3-4090-bd31-4a4a09abfd21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:33.711160 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d53d728-bba3-4090-bd31-4a4a09abfd21 None admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:33.711539 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d53d728-bba3-4090-bd31-4a4a09abfd21 None admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:33.711921 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d53d728-bba3-4090-bd31-4a4a09abfd21 None admin] PATH_INFO: `/v3/roles` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:33.712758 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d53d728-bba3-4090-bd31-4a4a09abfd21 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=86656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:40:33.713098 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d53d728-bba3-4090-bd31-4a4a09abfd21 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:33.714467 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d53d728-bba3-4090-bd31-4a4a09abfd21 None admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:33.723302 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 453/902] 10.222.0.16 () {56 vars in 1115 bytes} [Thu Jul 14 10:40:33 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:40:33.728607 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a9df1b-0eda-43c9-a6f5-8eb7313b0105 None admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:33.849407 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a9df1b-0eda-43c9-a6f5-8eb7313b0105 None admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:33.887613 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5452078-c3e6-4586-a9d2-b0fe2a57daaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:33.888860 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5452078-c3e6-4586-a9d2-b0fe2a57daaf None admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:33.889348 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5452078-c3e6-4586-a9d2-b0fe2a57daaf None admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:33.889865 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5452078-c3e6-4586-a9d2-b0fe2a57daaf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:33.901329 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5452078-c3e6-4586-a9d2-b0fe2a57daaf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:33.903071 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5452078-c3e6-4586-a9d2-b0fe2a57daaf None admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:33.921440 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application [None req-e5452078-c3e6-4586-a9d2-b0fe2a57daaf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 10:40:33.921440 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:40:33.921440 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:40:33.921440 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:40:33.921440 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:40:33.921440 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:40:33.921440 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:40:33.921440 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:40:33.921440 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:40:33.921440 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:40:33.921440 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:40:33.921440 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:40:33.921440 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 10:40:33.921440 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 10:40:33.921440 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 10:40:33.922365 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 10:40:33.922365 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:40:33.922365 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:40:33.922365 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:40:33.922365 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:40:33.922365 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:40:33.922365 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:40:33.922365 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:40:33.922365 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application with Lock( Jul 14 10:40:33.922365 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:40:33.922365 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:40:33.922365 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:40:33.922365 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:40:33.922365 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:40:33.922365 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:40:33.922365 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:40:33.922365 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:40:33.923241 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 10:40:33.923241 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 10:40:33.923241 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 10:40:33.923241 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application Jul 14 10:40:33.925531 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 450/903] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Jul 14 10:40:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:40:33.932800 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d53d728-bba3-4090-bd31-4a4a09abfd21 None admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:34.008425 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=100 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:34.041119 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d53d728-bba3-4090-bd31-4a4a09abfd21 None admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:34.078078 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e41542-688d-4f99-a673-c87c971caebe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:34.078750 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e41542-688d-4f99-a673-c87c971caebe None admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:34.079036 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e41542-688d-4f99-a673-c87c971caebe None admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:34.079311 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e41542-688d-4f99-a673-c87c971caebe None admin] PATH_INFO: `/v3/domains` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:34.080097 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e41542-688d-4f99-a673-c87c971caebe None admin] RBAC: Adding query filter params (name=Default) {{(pid=86656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:40:34.080409 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e41542-688d-4f99-a673-c87c971caebe None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:34.081829 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e41542-688d-4f99-a673-c87c971caebe None admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:34.094757 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 454/904] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Jul 14 10:40:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:40:34.099960 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5452078-c3e6-4586-a9d2-b0fe2a57daaf None admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:34.126719 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=100 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:34.211949 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5452078-c3e6-4586-a9d2-b0fe2a57daaf None admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:34.246415 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d2b3d9-5e12-4a90-8f1f-c26f3b20ef94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:34.247233 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d2b3d9-5e12-4a90-8f1f-c26f3b20ef94 None admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:34.247518 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d2b3d9-5e12-4a90-8f1f-c26f3b20ef94 None admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:34.247863 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d2b3d9-5e12-4a90-8f1f-c26f3b20ef94 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:34.255732 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d2b3d9-5e12-4a90-8f1f-c26f3b20ef94 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:34.257201 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d2b3d9-5e12-4a90-8f1f-c26f3b20ef94 None admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:34.272893 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application [None req-69d2b3d9-5e12-4a90-8f1f-c26f3b20ef94 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 14 10:40:34.272893 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:40:34.272893 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:40:34.272893 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:40:34.272893 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:40:34.272893 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:40:34.272893 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:40:34.272893 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:40:34.272893 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:40:34.272893 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:40:34.272893 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:40:34.272893 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:40:34.272893 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 10:40:34.272893 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 10:40:34.272893 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 10:40:34.272893 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 10:40:34.273907 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:40:34.273907 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:40:34.273907 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 10:40:34.273907 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 10:40:34.273907 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 10:40:34.273907 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 10:40:34.273907 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:40:34.273907 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:40:34.273907 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:40:34.273907 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:40:34.273907 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:40:34.273907 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application with Lock( Jul 14 10:40:34.273907 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:40:34.273907 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:40:34.273907 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:40:34.273907 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:40:34.273907 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:40:34.273907 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:40:34.274903 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:40:34.274903 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:40:34.274903 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 10:40:34.274903 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 10:40:34.274903 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 10:40:34.274903 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 10:40:34.274903 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 10:40:34.274903 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 10:40:34.274903 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 14 10:40:34.274903 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application Jul 14 10:40:34.274903 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 451/905] 10.222.0.16 () {56 vars in 1117 bytes} [Thu Jul 14 10:40:34 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:40:34.280118 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e41542-688d-4f99-a673-c87c971caebe None admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:34.391892 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e41542-688d-4f99-a673-c87c971caebe None admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:34.421928 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=100 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:34.427798 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08740d0-ef31-4847-9cbf-bc510a10eefe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:34.428471 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08740d0-ef31-4847-9cbf-bc510a10eefe None admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:34.428753 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08740d0-ef31-4847-9cbf-bc510a10eefe None admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:34.429054 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08740d0-ef31-4847-9cbf-bc510a10eefe None admin] PATH_INFO: `/v3/users` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:34.429894 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08740d0-ef31-4847-9cbf-bc510a10eefe None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=86656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:40:34.430202 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08740d0-ef31-4847-9cbf-bc510a10eefe None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:34.431625 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08740d0-ef31-4847-9cbf-bc510a10eefe None admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:34.449964 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 455/906] 10.222.0.16 () {56 vars in 1149 bytes} [Thu Jul 14 10:40:34 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:40:34.455911 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d2b3d9-5e12-4a90-8f1f-c26f3b20ef94 None admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:34.545585 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=100 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:34.566193 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d2b3d9-5e12-4a90-8f1f-c26f3b20ef94 None admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:34.610963 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b01d49-c09d-4dcb-883f-1a49069d7da9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:34.611625 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b01d49-c09d-4dcb-883f-1a49069d7da9 None admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:34.611911 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b01d49-c09d-4dcb-883f-1a49069d7da9 None admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:34.612192 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b01d49-c09d-4dcb-883f-1a49069d7da9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:34.685989 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b01d49-c09d-4dcb-883f-1a49069d7da9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:34.687536 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b01d49-c09d-4dcb-883f-1a49069d7da9 None admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:34.765419 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=100 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:34.801371 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 452/907] 10.222.0.16 () {58 vars in 1282 bytes} [Thu Jul 14 10:40:34 2022] GET /identity/v3/auth/tokens => generated 1464 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 14 10:40:34.806947 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08740d0-ef31-4847-9cbf-bc510a10eefe None admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:34.819591 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a132282e-d2f1-46f0-98ed-e7f1f60e9c05 None None] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:34.819892 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a132282e-d2f1-46f0-98ed-e7f1f60e9c05 None None] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:34.820182 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a132282e-d2f1-46f0-98ed-e7f1f60e9c05 None None] PATH_INFO: `/` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:34.821884 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 453/908] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jul 14 10:40:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:40:34.826605 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e236dbf6-f901-45ca-995e-1b870e06c2a7 None None] REQUEST_METHOD: `POST` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:34.826894 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e236dbf6-f901-45ca-995e-1b870e06c2a7 None None] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:34.827176 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e236dbf6-f901-45ca-995e-1b870e06c2a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:34.844976 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.auth.core [None req-e236dbf6-f901-45ca-995e-1b870e06c2a7 None None] MFA Rules not processed for user `ae4bcdd8106d4bebbdcae96be33505bc`. Rule list: `[]` (Enabled: `True`). {{(pid=86655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:40:34.846173 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-e236dbf6-f901-45ca-995e-1b870e06c2a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:40:34.925074 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 454/909] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jul 14 10:40:34 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 14 10:40:34.927908 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08740d0-ef31-4847-9cbf-bc510a10eefe None admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:34.940940 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e236dbf6-f901-45ca-995e-1b870e06c2a7 None None] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:34.974871 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07139c7c-b4d1-4e05-909f-104aeaf39cfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:34.975687 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07139c7c-b4d1-4e05-909f-104aeaf39cfa None admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:34.975969 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07139c7c-b4d1-4e05-909f-104aeaf39cfa None admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:34.976261 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07139c7c-b4d1-4e05-909f-104aeaf39cfa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:34.987409 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07139c7c-b4d1-4e05-909f-104aeaf39cfa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:34.988924 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07139c7c-b4d1-4e05-909f-104aeaf39cfa None admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:35.007860 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application [None req-07139c7c-b4d1-4e05-909f-104aeaf39cfa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 10:40:35.007860 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:40:35.007860 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:40:35.007860 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:40:35.007860 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:40:35.007860 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:40:35.007860 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:40:35.007860 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:40:35.007860 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:40:35.007860 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:40:35.007860 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:40:35.007860 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:40:35.007860 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 10:40:35.007860 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 10:40:35.007860 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 10:40:35.008824 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 10:40:35.008824 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:40:35.008824 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:40:35.008824 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:40:35.008824 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:40:35.008824 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:40:35.008824 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:40:35.008824 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:40:35.008824 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application with Lock( Jul 14 10:40:35.008824 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:40:35.008824 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:40:35.008824 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:40:35.008824 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:40:35.008824 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:40:35.008824 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:40:35.008824 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:40:35.008824 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:40:35.009713 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 10:40:35.009713 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 10:40:35.009713 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 10:40:35.009713 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application Jul 14 10:40:35.009713 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 456/910] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Jul 14 10:40:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:40:35.016653 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07139c7c-b4d1-4e05-909f-104aeaf39cfa None admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:35.071489 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e236dbf6-f901-45ca-995e-1b870e06c2a7 None None] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:35.080636 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=100 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:35.085884 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=100 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:35.117629 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77088feb-4f7e-4742-a038-69fe2d2acf92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:35.119068 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77088feb-4f7e-4742-a038-69fe2d2acf92 None admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:35.119801 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77088feb-4f7e-4742-a038-69fe2d2acf92 None admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:35.121026 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77088feb-4f7e-4742-a038-69fe2d2acf92 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:35.121730 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77088feb-4f7e-4742-a038-69fe2d2acf92 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:35.123213 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77088feb-4f7e-4742-a038-69fe2d2acf92 None admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:35.135926 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application [None req-77088feb-4f7e-4742-a038-69fe2d2acf92 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 14 10:40:35.135926 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:40:35.135926 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 14 10:40:35.135926 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 14 10:40:35.135926 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 14 10:40:35.135926 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 14 10:40:35.135926 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 14 10:40:35.135926 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 10:40:35.135926 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 14 10:40:35.135926 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application Jul 14 10:40:35.135926 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 10:40:35.135926 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application Jul 14 10:40:35.135926 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:40:35.135926 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:40:35.135926 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:40:35.135926 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:40:35.135926 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:40:35.137182 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:40:35.137182 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:40:35.137182 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:40:35.137182 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:40:35.137182 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:40:35.137182 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:40:35.137182 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 14 10:40:35.137182 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 14 10:40:35.137182 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 14 10:40:35.137182 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 14 10:40:35.137182 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:40:35.137182 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:40:35.137182 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:40:35.137182 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:40:35.137182 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:40:35.137182 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:40:35.138085 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:40:35.138085 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application with Lock( Jul 14 10:40:35.138085 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:40:35.138085 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:40:35.138085 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:40:35.138085 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:40:35.138085 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:40:35.138085 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:40:35.138085 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:40:35.138085 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:40:35.138085 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 14 10:40:35.138085 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 10:40:35.138085 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 14 10:40:35.138085 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application Jul 14 10:40:35.140454 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 455/911] 10.222.0.16 () {56 vars in 1114 bytes} [Thu Jul 14 10:40:34 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:40:35.144558 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77088feb-4f7e-4742-a038-69fe2d2acf92 None admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:35.161990 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07139c7c-b4d1-4e05-909f-104aeaf39cfa None admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:35.209363 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ffe720-1cdd-47f1-8dd1-d5db4b70f806 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:35.210973 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ffe720-1cdd-47f1-8dd1-d5db4b70f806 None admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:35.211480 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ffe720-1cdd-47f1-8dd1-d5db4b70f806 None admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:35.212106 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ffe720-1cdd-47f1-8dd1-d5db4b70f806 None admin] PATH_INFO: `/v3/domains` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:35.213215 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ffe720-1cdd-47f1-8dd1-d5db4b70f806 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:40:35.213601 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ffe720-1cdd-47f1-8dd1-d5db4b70f806 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:35.215064 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ffe720-1cdd-47f1-8dd1-d5db4b70f806 None admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:35.236375 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 457/912] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Jul 14 10:40:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:40:35.236946 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ffe720-1cdd-47f1-8dd1-d5db4b70f806 None admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:35.273004 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77088feb-4f7e-4742-a038-69fe2d2acf92 None admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:35.318733 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310268e7-2dae-497b-82d2-5363e71eaa1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:35.319573 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310268e7-2dae-497b-82d2-5363e71eaa1b None admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:35.319863 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310268e7-2dae-497b-82d2-5363e71eaa1b None admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:35.320145 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310268e7-2dae-497b-82d2-5363e71eaa1b None admin] PATH_INFO: `/v3/services` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:35.321401 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310268e7-2dae-497b-82d2-5363e71eaa1b None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=86655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:40:35.321996 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310268e7-2dae-497b-82d2-5363e71eaa1b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:35.323541 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310268e7-2dae-497b-82d2-5363e71eaa1b None admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:35.332868 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 456/913] 10.222.0.16 () {56 vars in 1114 bytes} [Thu Jul 14 10:40:35 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 10:40:35.335111 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310268e7-2dae-497b-82d2-5363e71eaa1b None admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:35.362284 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=100 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:35.367771 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ffe720-1cdd-47f1-8dd1-d5db4b70f806 None admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:35.380069 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=100 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:35.412693 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5b5eb3-1a8d-4dae-af7e-c6d7976fce00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:35.413788 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5b5eb3-1a8d-4dae-af7e-c6d7976fce00 None admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:35.414177 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5b5eb3-1a8d-4dae-af7e-c6d7976fce00 None admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:35.414635 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5b5eb3-1a8d-4dae-af7e-c6d7976fce00 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:35.422060 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5b5eb3-1a8d-4dae-af7e-c6d7976fce00 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:35.423745 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5b5eb3-1a8d-4dae-af7e-c6d7976fce00 None admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:35.440070 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application [None req-fd5b5eb3-1a8d-4dae-af7e-c6d7976fce00 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 10:40:35.440070 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:40:35.440070 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:40:35.440070 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:40:35.440070 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:40:35.440070 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:40:35.440070 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:40:35.440070 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:40:35.440070 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:40:35.440070 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:40:35.440070 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:40:35.440070 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:40:35.440070 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 10:40:35.440070 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 10:40:35.440070 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 10:40:35.441211 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 10:40:35.441211 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:40:35.441211 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:40:35.441211 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:40:35.441211 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:40:35.441211 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:40:35.441211 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:40:35.441211 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:40:35.441211 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application with Lock( Jul 14 10:40:35.441211 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:40:35.441211 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:40:35.441211 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:40:35.441211 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:40:35.441211 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:40:35.441211 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:40:35.441211 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:40:35.441211 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:40:35.442316 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 10:40:35.442316 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 10:40:35.442316 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 10:40:35.442316 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 10:40:35.442316 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 10:40:35.442316 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 10:40:35.442316 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 10:40:35.442316 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application Jul 14 10:40:35.444112 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 458/914] 10.222.0.16 () {56 vars in 1111 bytes} [Thu Jul 14 10:40:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:40:35.449468 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5b5eb3-1a8d-4dae-af7e-c6d7976fce00 None admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:35.458859 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310268e7-2dae-497b-82d2-5363e71eaa1b None admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:35.499963 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b86392-04be-4fdc-8734-6cc61b403ec4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:35.500568 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b86392-04be-4fdc-8734-6cc61b403ec4 None admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:35.500894 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b86392-04be-4fdc-8734-6cc61b403ec4 None admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:35.501180 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b86392-04be-4fdc-8734-6cc61b403ec4 None admin] PATH_INFO: `/v3/services` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:35.501902 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b86392-04be-4fdc-8734-6cc61b403ec4 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=86655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:40:35.502213 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b86392-04be-4fdc-8734-6cc61b403ec4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:35.503596 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b86392-04be-4fdc-8734-6cc61b403ec4 None admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:35.509232 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 457/915] 10.222.0.16 () {56 vars in 1114 bytes} [Thu Jul 14 10:40:35 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:40:35.515287 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b86392-04be-4fdc-8734-6cc61b403ec4 None admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:35.578466 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5b5eb3-1a8d-4dae-af7e-c6d7976fce00 None admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:35.617039 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae47161-2446-4c07-873a-412f7d497e42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:35.617821 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae47161-2446-4c07-873a-412f7d497e42 None admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:35.618109 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae47161-2446-4c07-873a-412f7d497e42 None admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:35.618389 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae47161-2446-4c07-873a-412f7d497e42 None admin] PATH_INFO: `/v3/projects` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:35.619183 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae47161-2446-4c07-873a-412f7d497e42 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:40:35.619500 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae47161-2446-4c07-873a-412f7d497e42 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:35.620963 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae47161-2446-4c07-873a-412f7d497e42 None admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:35.623481 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=100 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:35.628072 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b86392-04be-4fdc-8734-6cc61b403ec4 None admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:35.635281 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 459/916] 10.222.0.16 () {56 vars in 1148 bytes} [Thu Jul 14 10:40:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 10:40:35.635651 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7d62c5-3dee-4019-a17c-dd2c8d821642 None None] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:35.635945 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7d62c5-3dee-4019-a17c-dd2c8d821642 None None] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:35.636237 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7d62c5-3dee-4019-a17c-dd2c8d821642 None None] PATH_INFO: `/` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:35.637500 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 460/917] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jul 14 10:40:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:40:35.639826 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4866aef8-336e-457a-8544-72839c815a8a None None] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:35.640124 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4866aef8-336e-457a-8544-72839c815a8a None None] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:35.640407 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4866aef8-336e-457a-8544-72839c815a8a None None] PATH_INFO: `/` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:35.641807 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 461/918] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jul 14 10:40:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:40:35.642390 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4866aef8-336e-457a-8544-72839c815a8a None None] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:35.665669 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=100 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:35.666538 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef31ef2-a192-4e1d-9042-69de4fd3ea09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:35.667202 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef31ef2-a192-4e1d-9042-69de4fd3ea09 None admin] REQUEST_METHOD: `POST` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:35.667492 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef31ef2-a192-4e1d-9042-69de4fd3ea09 None admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:35.667798 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef31ef2-a192-4e1d-9042-69de4fd3ea09 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:35.668520 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef31ef2-a192-4e1d-9042-69de4fd3ea09 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:35.670049 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef31ef2-a192-4e1d-9042-69de4fd3ea09 None admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:35.689373 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 458/919] 10.222.0.16 () {60 vars in 1144 bytes} [Thu Jul 14 10:40:35 2022] POST /identity/v3/endpoints => generated 346 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:40:35.690675 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d560a5-d302-47f4-a820-ecec1f132aca None None] REQUEST_METHOD: `POST` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:35.690975 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d560a5-d302-47f4-a820-ecec1f132aca None None] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:35.691259 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d560a5-d302-47f4-a820-ecec1f132aca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:35.718409 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.auth.core [None req-86d560a5-d302-47f4-a820-ecec1f132aca None None] MFA Rules not processed for user `ae4bcdd8106d4bebbdcae96be33505bc`. Rule list: `[]` (Enabled: `True`). {{(pid=86655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:40:35.719701 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-86d560a5-d302-47f4-a820-ecec1f132aca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:40:35.766385 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4866aef8-336e-457a-8544-72839c815a8a None None] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:35.812823 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 459/920] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jul 14 10:40:35 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 10:40:35.812823 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e01618d-0c4f-4745-a64f-7d3f6b39a02c None None] REQUEST_METHOD: `POST` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:35.812823 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e01618d-0c4f-4745-a64f-7d3f6b39a02c None None] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:35.812823 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e01618d-0c4f-4745-a64f-7d3f6b39a02c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:35.818493 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21b6032-356a-43f0-a5bf-8e34d00458a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:35.819260 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21b6032-356a-43f0-a5bf-8e34d00458a3 None admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:35.819719 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21b6032-356a-43f0-a5bf-8e34d00458a3 None admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:35.820068 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21b6032-356a-43f0-a5bf-8e34d00458a3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:35.821063 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21b6032-356a-43f0-a5bf-8e34d00458a3 None admin] RBAC: Adding query filter params (role.id=ced8748f90594f3b81cabd4051d44e91, scope.project.id=59391272ecbe48b0aa736cb43807be1d, user.id=0dfc7cd9c05e4f268d2ce316d531c4bd) {{(pid=86656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:40:35.821452 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21b6032-356a-43f0-a5bf-8e34d00458a3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:35.823029 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21b6032-356a-43f0-a5bf-8e34d00458a3 None admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:35.837264 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 462/921] 10.222.0.16 () {56 vars in 1374 bytes} [Thu Jul 14 10:40:35 2022] GET /identity/v3/role_assignments?user.id=0dfc7cd9c05e4f268d2ce316d531c4bd&scope.project.id=59391272ecbe48b0aa736cb43807be1d&role.id=ced8748f90594f3b81cabd4051d44e91 => generated 259 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:40:35.838334 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21b6032-356a-43f0-a5bf-8e34d00458a3 None admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:35.839270 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.auth.core [None req-6e01618d-0c4f-4745-a64f-7d3f6b39a02c None None] MFA Rules not processed for user `ae4bcdd8106d4bebbdcae96be33505bc`. Rule list: `[]` (Enabled: `True`). {{(pid=86655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:40:35.841320 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-6e01618d-0c4f-4745-a64f-7d3f6b39a02c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:40:35.947013 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 460/922] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jul 14 10:40:35 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 10:40:35.948913 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=100 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:35.976172 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e01618d-0c4f-4745-a64f-7d3f6b39a02c None None] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:35.977106 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21b6032-356a-43f0-a5bf-8e34d00458a3 None admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:36.007696 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:36.016676 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4089f57-86ca-4750-a1b4-49019bee2b98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:36.017572 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4089f57-86ca-4750-a1b4-49019bee2b98 None admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:36.018113 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4089f57-86ca-4750-a1b4-49019bee2b98 None admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:36.018488 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4089f57-86ca-4750-a1b4-49019bee2b98 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:36.020312 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4089f57-86ca-4750-a1b4-49019bee2b98 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:36.022058 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4089f57-86ca-4750-a1b4-49019bee2b98 None admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:36.037796 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application [None req-a4089f57-86ca-4750-a1b4-49019bee2b98 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 14 10:40:36.037796 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:40:36.037796 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 14 10:40:36.037796 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 14 10:40:36.037796 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 14 10:40:36.037796 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 14 10:40:36.037796 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 14 10:40:36.037796 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 10:40:36.037796 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 14 10:40:36.037796 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application Jul 14 10:40:36.037796 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 10:40:36.037796 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application Jul 14 10:40:36.037796 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:40:36.037796 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:40:36.037796 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:40:36.037796 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:40:36.038992 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:40:36.038992 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:40:36.038992 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:40:36.038992 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:40:36.038992 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:40:36.038992 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:40:36.038992 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:40:36.038992 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 14 10:40:36.038992 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 14 10:40:36.038992 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 14 10:40:36.038992 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 14 10:40:36.038992 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:40:36.038992 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:40:36.038992 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:40:36.038992 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:40:36.038992 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:40:36.039909 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:40:36.039909 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:40:36.039909 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application with Lock( Jul 14 10:40:36.039909 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:40:36.039909 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:40:36.039909 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:40:36.039909 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:40:36.039909 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:40:36.039909 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:40:36.039909 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:40:36.039909 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:40:36.039909 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 14 10:40:36.039909 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 10:40:36.039909 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 14 10:40:36.039909 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application Jul 14 10:40:36.045222 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 463/923] 10.222.0.16 () {56 vars in 1132 bytes} [Thu Jul 14 10:40:35 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:40:36.047449 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4089f57-86ca-4750-a1b4-49019bee2b98 None admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:36.113570 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e01618d-0c4f-4745-a64f-7d3f6b39a02c None None] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:36.164477 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d297106f-7624-458e-ab29-667322a9ef88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:36.165584 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d297106f-7624-458e-ab29-667322a9ef88 None admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:36.165846 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d297106f-7624-458e-ab29-667322a9ef88 None admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:36.166128 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d297106f-7624-458e-ab29-667322a9ef88 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:36.167039 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d297106f-7624-458e-ab29-667322a9ef88 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:36.169132 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d297106f-7624-458e-ab29-667322a9ef88 None admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:36.178622 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4089f57-86ca-4750-a1b4-49019bee2b98 None admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:36.185902 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application [None req-d297106f-7624-458e-ab29-667322a9ef88 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 14 10:40:36.185902 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:40:36.185902 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 14 10:40:36.185902 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 14 10:40:36.185902 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 14 10:40:36.185902 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 14 10:40:36.185902 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 14 10:40:36.185902 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 10:40:36.185902 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 14 10:40:36.185902 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application Jul 14 10:40:36.185902 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 10:40:36.185902 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application Jul 14 10:40:36.185902 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:40:36.185902 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:40:36.185902 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:40:36.185902 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:40:36.185902 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:40:36.187845 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:40:36.187845 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:40:36.187845 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:40:36.187845 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:40:36.187845 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:40:36.187845 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:40:36.187845 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 14 10:40:36.187845 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 14 10:40:36.187845 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 14 10:40:36.187845 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 14 10:40:36.187845 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:40:36.187845 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:40:36.187845 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:40:36.187845 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:40:36.187845 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:40:36.187845 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:40:36.188905 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:40:36.188905 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application with Lock( Jul 14 10:40:36.188905 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:40:36.188905 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:40:36.188905 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:40:36.188905 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:40:36.188905 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:40:36.188905 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:40:36.188905 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:40:36.188905 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:40:36.188905 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 14 10:40:36.188905 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 10:40:36.188905 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 14 10:40:36.188905 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application Jul 14 10:40:36.194224 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 461/924] 10.222.0.16 () {56 vars in 1126 bytes} [Thu Jul 14 10:40:35 2022] GET /identity/v3/services/object-store => generated 93 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 10:40:36.194224 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d297106f-7624-458e-ab29-667322a9ef88 None admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:36.224364 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569c664a-2b86-47a6-9997-82705e93f16e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:36.225247 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569c664a-2b86-47a6-9997-82705e93f16e None admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:36.225712 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569c664a-2b86-47a6-9997-82705e93f16e None admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:36.226199 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569c664a-2b86-47a6-9997-82705e93f16e None admin] PATH_INFO: `/v3/services` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:36.227085 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569c664a-2b86-47a6-9997-82705e93f16e None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=86656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:40:36.227508 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569c664a-2b86-47a6-9997-82705e93f16e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:36.229292 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569c664a-2b86-47a6-9997-82705e93f16e None admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:36.236010 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 464/925] 10.222.0.16 () {56 vars in 1126 bytes} [Thu Jul 14 10:40:36 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 10:40:36.242523 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569c664a-2b86-47a6-9997-82705e93f16e None admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:36.257432 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=100 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:36.288762 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=100 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:36.314851 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d297106f-7624-458e-ab29-667322a9ef88 None admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:36.359357 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42523384-443a-48c2-852b-617dd05e67af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:36.359876 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569c664a-2b86-47a6-9997-82705e93f16e None admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:36.360434 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42523384-443a-48c2-852b-617dd05e67af None admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:36.360961 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42523384-443a-48c2-852b-617dd05e67af None admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:36.361381 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42523384-443a-48c2-852b-617dd05e67af None admin] PATH_INFO: `/v3/services` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:36.363402 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42523384-443a-48c2-852b-617dd05e67af None admin] RBAC: Adding query filter params (name=object-store) {{(pid=86655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:40:36.363882 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42523384-443a-48c2-852b-617dd05e67af None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:36.365418 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42523384-443a-48c2-852b-617dd05e67af None admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:36.372018 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 462/926] 10.222.0.16 () {56 vars in 1122 bytes} [Thu Jul 14 10:40:36 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:40:36.377839 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42523384-443a-48c2-852b-617dd05e67af None admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:36.402301 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d184bb-b222-403d-8b64-d89679799ad2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:36.403066 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d184bb-b222-403d-8b64-d89679799ad2 None admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:36.403413 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d184bb-b222-403d-8b64-d89679799ad2 None admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:36.403756 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d184bb-b222-403d-8b64-d89679799ad2 None admin] PATH_INFO: `/v3/services` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:36.404841 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d184bb-b222-403d-8b64-d89679799ad2 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=86656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:40:36.405245 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d184bb-b222-403d-8b64-d89679799ad2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:36.406842 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d184bb-b222-403d-8b64-d89679799ad2 None admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:36.417164 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 465/927] 10.222.0.16 () {56 vars in 1126 bytes} [Thu Jul 14 10:40:36 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:40:36.417954 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d184bb-b222-403d-8b64-d89679799ad2 None admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:36.497580 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=100 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:36.515394 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42523384-443a-48c2-852b-617dd05e67af None admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:36.531379 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d184bb-b222-403d-8b64-d89679799ad2 None admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:36.562046 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74569b5d-e488-4dd1-b19b-d83a0d87f778 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:36.563254 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74569b5d-e488-4dd1-b19b-d83a0d87f778 None admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:36.563976 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74569b5d-e488-4dd1-b19b-d83a0d87f778 None admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:36.564455 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74569b5d-e488-4dd1-b19b-d83a0d87f778 None admin] PATH_INFO: `/v3/services` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:36.565929 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74569b5d-e488-4dd1-b19b-d83a0d87f778 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=86655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:40:36.566550 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74569b5d-e488-4dd1-b19b-d83a0d87f778 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:36.568319 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74569b5d-e488-4dd1-b19b-d83a0d87f778 None admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:36.569486 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597f9b9d-1ff8-4ada-a473-adaf8c854eb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:36.570170 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597f9b9d-1ff8-4ada-a473-adaf8c854eb9 None admin] REQUEST_METHOD: `POST` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:36.570435 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597f9b9d-1ff8-4ada-a473-adaf8c854eb9 None admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:36.570713 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597f9b9d-1ff8-4ada-a473-adaf8c854eb9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:36.571482 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597f9b9d-1ff8-4ada-a473-adaf8c854eb9 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:36.572862 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597f9b9d-1ff8-4ada-a473-adaf8c854eb9 None admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:36.576626 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 463/928] 10.222.0.16 () {56 vars in 1122 bytes} [Thu Jul 14 10:40:36 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:40:36.581911 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74569b5d-e488-4dd1-b19b-d83a0d87f778 None admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:36.593798 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=100 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:36.604825 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 466/929] 10.222.0.16 () {60 vars in 1144 bytes} [Thu Jul 14 10:40:36 2022] POST /identity/v3/endpoints => generated 347 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:40:36.725656 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74569b5d-e488-4dd1-b19b-d83a0d87f778 None admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:36.771484 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1efe603a-c03c-4220-82cd-01bfccd7b3bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:36.772141 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efe603a-c03c-4220-82cd-01bfccd7b3bc None admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:36.772432 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efe603a-c03c-4220-82cd-01bfccd7b3bc None admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:36.772717 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efe603a-c03c-4220-82cd-01bfccd7b3bc None admin] PATH_INFO: `/v3/endpoints` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:36.773559 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1efe603a-c03c-4220-82cd-01bfccd7b3bc None admin] RBAC: Adding query filter params (interface=public, service_id=7bd97e2fede342b39829d345bca0d7bb, region_id=RegionOne) {{(pid=86655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:40:36.773877 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1efe603a-c03c-4220-82cd-01bfccd7b3bc None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:36.775255 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1efe603a-c03c-4220-82cd-01bfccd7b3bc None admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:36.781912 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 464/930] 10.222.0.16 () {56 vars in 1251 bytes} [Thu Jul 14 10:40:36 2022] GET /identity/v3/endpoints?service_id=7bd97e2fede342b39829d345bca0d7bb&interface=public®ion_id=RegionOne => generated 194 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 10:40:36.787624 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597f9b9d-1ff8-4ada-a473-adaf8c854eb9 None admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:36.908251 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597f9b9d-1ff8-4ada-a473-adaf8c854eb9 None admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:36.936012 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:36.947042 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59495067-b1d0-4983-b77e-500b1c84b824 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:36.947986 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59495067-b1d0-4983-b77e-500b1c84b824 None admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:36.948421 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59495067-b1d0-4983-b77e-500b1c84b824 None admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:36.948879 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59495067-b1d0-4983-b77e-500b1c84b824 None admin] PATH_INFO: `/v3/services` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:36.949767 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59495067-b1d0-4983-b77e-500b1c84b824 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:36.951387 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59495067-b1d0-4983-b77e-500b1c84b824 None admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:36.964926 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 467/931] 10.222.0.16 () {56 vars in 1087 bytes} [Thu Jul 14 10:40:36 2022] GET /identity/v3/services => generated 1497 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 10:40:37.877256 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351231dd-d077-4c1f-b661-ce8118723507 None None] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:37.877781 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351231dd-d077-4c1f-b661-ce8118723507 None None] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:37.877781 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351231dd-d077-4c1f-b661-ce8118723507 None None] PATH_INFO: `/` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:37.879421 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 465/932] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jul 14 10:40:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:40:37.884421 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f93a0d-29c8-4fca-b1c5-b1a0937bac2c None None] REQUEST_METHOD: `POST` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:37.884842 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f93a0d-29c8-4fca-b1c5-b1a0937bac2c None None] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:37.885012 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f93a0d-29c8-4fca-b1c5-b1a0937bac2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:37.901747 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.auth.core [None req-81f93a0d-29c8-4fca-b1c5-b1a0937bac2c None None] MFA Rules not processed for user `ae4bcdd8106d4bebbdcae96be33505bc`. Rule list: `[]` (Enabled: `True`). {{(pid=86656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:40:37.902937 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-81f93a0d-29c8-4fca-b1c5-b1a0937bac2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:40:37.962902 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3295e11-2471-41e7-b22f-9a8a81a9cd6a None None] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:37.963196 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3295e11-2471-41e7-b22f-9a8a81a9cd6a None None] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:37.963484 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3295e11-2471-41e7-b22f-9a8a81a9cd6a None None] PATH_INFO: `/` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:37.965124 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 466/933] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jul 14 10:40:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:40:37.970283 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a84ab5-e75d-4725-9e90-8cf43aba1b66 None None] REQUEST_METHOD: `POST` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:37.970476 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 468/934] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jul 14 10:40:37 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 10:40:37.970581 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a84ab5-e75d-4725-9e90-8cf43aba1b66 None None] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:37.972881 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a84ab5-e75d-4725-9e90-8cf43aba1b66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:37.992983 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.auth.core [None req-62a84ab5-e75d-4725-9e90-8cf43aba1b66 None None] MFA Rules not processed for user `ae4bcdd8106d4bebbdcae96be33505bc`. Rule list: `[]` (Enabled: `True`). {{(pid=86655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:40:37.994465 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-62a84ab5-e75d-4725-9e90-8cf43aba1b66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:40:37.996441 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f93a0d-29c8-4fca-b1c5-b1a0937bac2c None None] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:38.077931 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=100 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:38.096816 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 467/935] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jul 14 10:40:37 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 14 10:40:38.117678 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a84ab5-e75d-4725-9e90-8cf43aba1b66 None None] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:38.120841 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f93a0d-29c8-4fca-b1c5-b1a0937bac2c None None] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:38.152640 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=100 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:38.166668 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd3a000-c60f-488b-9088-1bed51360dc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:38.167376 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd3a000-c60f-488b-9088-1bed51360dc4 None admin] REQUEST_METHOD: `POST` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:38.168067 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd3a000-c60f-488b-9088-1bed51360dc4 None admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:38.168363 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd3a000-c60f-488b-9088-1bed51360dc4 None admin] PATH_INFO: `/v3/projects` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:38.169116 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd3a000-c60f-488b-9088-1bed51360dc4 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:38.171613 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd3a000-c60f-488b-9088-1bed51360dc4 None admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:38.173774 dv-cinder-846146-7-smb devstack@keystone.service[86656]: WARNING keystone.server.flask.common [None req-4bd3a000-c60f-488b-9088-1bed51360dc4 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jul 14 10:40:38.197202 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.sql.core [None req-4bd3a000-c60f-488b-9088-1bed51360dc4 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 14 10:40:38.197202 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jul 14 10:40:38.197202 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [parameters: {'id': 'c156ff0732f94d709b3ddaf869ddc262', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jul 14 10:40:38.197202 dv-cinder-846146-7-smb devstack@keystone.service[86656]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=86656) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 14 10:40:38.208748 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application [None req-4bd3a000-c60f-488b-9088-1bed51360dc4 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id c156ff0732f94d709b3ddaf869ddc262.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id c156ff0732f94d709b3ddaf869ddc262. Jul 14 10:40:38.208748 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:40:38.208748 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 14 10:40:38.208748 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 14 10:40:38.208748 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 14 10:40:38.208748 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 14 10:40:38.208748 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 14 10:40:38.208748 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application result = self._query(query) Jul 14 10:40:38.208748 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 14 10:40:38.208748 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application conn.query(q) Jul 14 10:40:38.208748 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 14 10:40:38.208748 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 14 10:40:38.208748 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 14 10:40:38.209576 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application result.read() Jul 14 10:40:38.209576 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 14 10:40:38.209576 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 14 10:40:38.209576 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 14 10:40:38.209576 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 14 10:40:38.209576 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 14 10:40:38.209576 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 14 10:40:38.209576 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 14 10:40:38.209576 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 14 10:40:38.209576 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 14 10:40:38.209576 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application Jul 14 10:40:38.209576 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 14 10:40:38.209576 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application Jul 14 10:40:38.209576 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:40:38.209576 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 14 10:40:38.209576 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 14 10:40:38.209576 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Jul 14 10:40:38.209576 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return project_ref.to_dict() Jul 14 10:40:38.210683 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 14 10:40:38.210683 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application next(self.gen) Jul 14 10:40:38.210683 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 14 10:40:38.210683 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application yield resource Jul 14 10:40:38.210683 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 14 10:40:38.210683 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application next(self.gen) Jul 14 10:40:38.210683 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 14 10:40:38.210683 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application self.session.rollback() Jul 14 10:40:38.210683 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 14 10:40:38.210683 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application self.force_reraise() Jul 14 10:40:38.210683 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 14 10:40:38.210683 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application raise self.value Jul 14 10:40:38.210683 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 14 10:40:38.210683 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 14 10:40:38.210683 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 14 10:40:38.210683 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application session.commit() Jul 14 10:40:38.210683 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 14 10:40:38.211834 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 14 10:40:38.211834 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 14 10:40:38.211834 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application self._prepare_impl() Jul 14 10:40:38.211834 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 14 10:40:38.211834 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application self.session.flush() Jul 14 10:40:38.211834 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 14 10:40:38.211834 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application self._flush(objects) Jul 14 10:40:38.211834 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 14 10:40:38.211834 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 14 10:40:38.211834 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 14 10:40:38.211834 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application compat.raise_( Jul 14 10:40:38.211834 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 14 10:40:38.211834 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application raise exception Jul 14 10:40:38.211834 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 14 10:40:38.211834 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application flush_context.execute() Jul 14 10:40:38.211834 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 14 10:40:38.211834 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application rec.execute(self) Jul 14 10:40:38.212733 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 14 10:40:38.212733 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 14 10:40:38.212733 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 14 10:40:38.212733 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 14 10:40:38.212733 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jul 14 10:40:38.212733 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application c = connection._execute_20( Jul 14 10:40:38.212733 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 14 10:40:38.212733 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 14 10:40:38.212733 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 14 10:40:38.212733 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 14 10:40:38.212733 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 14 10:40:38.212733 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 14 10:40:38.212733 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 14 10:40:38.212733 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 14 10:40:38.212733 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 14 10:40:38.214291 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 14 10:40:38.214291 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 14 10:40:38.214291 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application raise exception Jul 14 10:40:38.214291 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 14 10:40:38.214291 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 14 10:40:38.214291 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 14 10:40:38.214291 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 14 10:40:38.214291 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 14 10:40:38.214291 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application result = self._query(query) Jul 14 10:40:38.214291 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 14 10:40:38.214291 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application conn.query(q) Jul 14 10:40:38.214291 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 14 10:40:38.214291 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 14 10:40:38.214291 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 14 10:40:38.214291 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application result.read() Jul 14 10:40:38.214291 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 14 10:40:38.214291 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 14 10:40:38.215930 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 14 10:40:38.215930 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 14 10:40:38.215930 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 14 10:40:38.215930 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 14 10:40:38.215930 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 14 10:40:38.215930 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 14 10:40:38.215930 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 14 10:40:38.215930 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jul 14 10:40:38.215930 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application [parameters: {'id': 'c156ff0732f94d709b3ddaf869ddc262', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jul 14 10:40:38.215930 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 14 10:40:38.215930 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application Jul 14 10:40:38.215930 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 10:40:38.215930 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application Jul 14 10:40:38.215930 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:40:38.215930 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Jul 14 10:40:38.217601 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Jul 14 10:40:38.217601 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 14 10:40:38.217601 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 14 10:40:38.217601 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Jul 14 10:40:38.217601 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application Jul 14 10:40:38.217601 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 10:40:38.217601 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application Jul 14 10:40:38.217601 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:40:38.217601 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:40:38.217601 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:40:38.217601 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:40:38.217601 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:40:38.217601 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:40:38.217601 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:40:38.217601 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:40:38.217601 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:40:38.217601 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:40:38.219184 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:40:38.219184 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Jul 14 10:40:38.219184 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Jul 14 10:40:38.219184 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:40:38.219184 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:40:38.219184 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Jul 14 10:40:38.219184 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application raise exception.Conflict( Jul 14 10:40:38.219184 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id c156ff0732f94d709b3ddaf869ddc262. Jul 14 10:40:38.219184 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application Jul 14 10:40:38.219184 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 469/936] 10.222.0.16 () {60 vars in 1140 bytes} [Thu Jul 14 10:40:37 2022] POST /identity/v3/projects => generated 262 bytes in 214 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Jul 14 10:40:38.219184 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd3a000-c60f-488b-9088-1bed51360dc4 None admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:38.249184 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a84ab5-e75d-4725-9e90-8cf43aba1b66 None None] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:38.298058 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd67fd4-0e8f-4de8-8623-bab9e7a0c625 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:38.299273 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd67fd4-0e8f-4de8-8623-bab9e7a0c625 None admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:38.299624 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd67fd4-0e8f-4de8-8623-bab9e7a0c625 None admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:38.299972 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd67fd4-0e8f-4de8-8623-bab9e7a0c625 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:38.315054 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd67fd4-0e8f-4de8-8623-bab9e7a0c625 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 10:40:38.326133 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application [None req-6dd67fd4-0e8f-4de8-8623-bab9e7a0c625 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 14 10:40:38.326133 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:40:38.326133 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:40:38.326133 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:40:38.326133 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:40:38.326133 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:40:38.326133 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:40:38.326133 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:40:38.326133 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:40:38.326133 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:40:38.326133 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:40:38.326133 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:40:38.326133 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 10:40:38.326133 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 10:40:38.326133 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 10:40:38.326133 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 10:40:38.327088 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 10:40:38.327088 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 10:40:38.327088 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 10:40:38.327088 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 10:40:38.327088 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:40:38.327088 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:40:38.327088 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:40:38.327088 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:40:38.327088 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:40:38.327088 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:40:38.327088 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:40:38.327088 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application with Lock( Jul 14 10:40:38.327088 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:40:38.327088 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:40:38.327088 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:40:38.327088 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:40:38.333290 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:40:38.333290 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:40:38.333290 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:40:38.333290 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:40:38.333290 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 10:40:38.333290 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 10:40:38.333290 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 10:40:38.333290 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 10:40:38.333290 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 10:40:38.333290 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 10:40:38.333290 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 14 10:40:38.333290 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application Jul 14 10:40:38.333290 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 468/937] 10.222.0.16 () {56 vars in 1120 bytes} [Thu Jul 14 10:40:38 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:40:38.335465 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd67fd4-0e8f-4de8-8623-bab9e7a0c625 None admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:38.338646 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd3a000-c60f-488b-9088-1bed51360dc4 None admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:38.382902 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02edd374-ba43-4e3e-958a-d5e3e396be90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:38.383822 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02edd374-ba43-4e3e-958a-d5e3e396be90 None admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:38.384109 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02edd374-ba43-4e3e-958a-d5e3e396be90 None admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:38.384389 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02edd374-ba43-4e3e-958a-d5e3e396be90 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:38.393499 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02edd374-ba43-4e3e-958a-d5e3e396be90 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:38.395754 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02edd374-ba43-4e3e-958a-d5e3e396be90 None admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:38.406123 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=100 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:38.414832 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application [None req-02edd374-ba43-4e3e-958a-d5e3e396be90 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 10:40:38.414832 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:40:38.414832 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:40:38.414832 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:40:38.414832 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:40:38.414832 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:40:38.414832 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:40:38.414832 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:40:38.414832 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:40:38.414832 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:40:38.414832 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:40:38.414832 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:40:38.414832 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 10:40:38.414832 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 10:40:38.414832 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 10:40:38.415729 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 10:40:38.415729 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:40:38.415729 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:40:38.415729 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:40:38.415729 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:40:38.415729 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:40:38.415729 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:40:38.415729 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:40:38.415729 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application with Lock( Jul 14 10:40:38.415729 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:40:38.415729 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:40:38.415729 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:40:38.415729 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:40:38.415729 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:40:38.415729 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:40:38.415729 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:40:38.415729 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:40:38.416832 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 10:40:38.416832 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 10:40:38.416832 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 10:40:38.416832 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 10:40:38.416832 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 10:40:38.416832 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 10:40:38.416832 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 10:40:38.416832 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application Jul 14 10:40:38.416832 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 470/938] 10.222.0.16 () {56 vars in 1111 bytes} [Thu Jul 14 10:40:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:40:38.422303 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02edd374-ba43-4e3e-958a-d5e3e396be90 None admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:38.474634 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd67fd4-0e8f-4de8-8623-bab9e7a0c625 None admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:38.476556 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:38.521273 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4688a311-0f8b-4870-b7d4-78d16b6afcef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:38.521956 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4688a311-0f8b-4870-b7d4-78d16b6afcef None admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:38.522243 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4688a311-0f8b-4870-b7d4-78d16b6afcef None admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:38.522521 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4688a311-0f8b-4870-b7d4-78d16b6afcef None admin] PATH_INFO: `/v3/roles` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:38.523280 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4688a311-0f8b-4870-b7d4-78d16b6afcef None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=86655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:40:38.523590 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4688a311-0f8b-4870-b7d4-78d16b6afcef None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:38.525043 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4688a311-0f8b-4870-b7d4-78d16b6afcef None admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:38.539226 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 469/939] 10.222.0.16 () {56 vars in 1115 bytes} [Thu Jul 14 10:40:38 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 10:40:38.546455 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4688a311-0f8b-4870-b7d4-78d16b6afcef None admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:38.561189 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02edd374-ba43-4e3e-958a-d5e3e396be90 None admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:38.599405 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43298d7a-047f-4fdf-8256-be1cd0dae901 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:38.600000 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43298d7a-047f-4fdf-8256-be1cd0dae901 None admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:38.600293 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43298d7a-047f-4fdf-8256-be1cd0dae901 None admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:38.600575 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43298d7a-047f-4fdf-8256-be1cd0dae901 None admin] PATH_INFO: `/v3/projects` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:38.601377 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43298d7a-047f-4fdf-8256-be1cd0dae901 None admin] RBAC: Adding query filter params (name=service) {{(pid=86656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:40:38.601689 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43298d7a-047f-4fdf-8256-be1cd0dae901 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:38.603129 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43298d7a-047f-4fdf-8256-be1cd0dae901 None admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:38.633057 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 471/940] 10.222.0.16 () {56 vars in 1112 bytes} [Thu Jul 14 10:40:38 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 10:40:38.683047 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4688a311-0f8b-4870-b7d4-78d16b6afcef None admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:38.704832 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=100 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:38.729121 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1415f41-1a88-476a-8bb2-22e6cc05d053 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:38.729942 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1415f41-1a88-476a-8bb2-22e6cc05d053 None admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:38.730237 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1415f41-1a88-476a-8bb2-22e6cc05d053 None admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:38.730516 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1415f41-1a88-476a-8bb2-22e6cc05d053 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:38.750617 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1415f41-1a88-476a-8bb2-22e6cc05d053 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:38.752155 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1415f41-1a88-476a-8bb2-22e6cc05d053 None admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:38.774016 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application [None req-f1415f41-1a88-476a-8bb2-22e6cc05d053 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 10:40:38.774016 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:40:38.774016 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:40:38.774016 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:40:38.774016 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:40:38.774016 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:40:38.774016 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:40:38.774016 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:40:38.774016 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:40:38.774016 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:40:38.774016 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:40:38.774016 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:40:38.774016 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 10:40:38.774016 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 10:40:38.774016 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 10:40:38.775232 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 10:40:38.775232 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:40:38.775232 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:40:38.775232 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:40:38.775232 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:40:38.775232 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:40:38.775232 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:40:38.775232 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:40:38.775232 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application with Lock( Jul 14 10:40:38.775232 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:40:38.775232 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:40:38.775232 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:40:38.775232 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:40:38.775232 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:40:38.775232 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:40:38.775232 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:40:38.775232 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:40:38.776090 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 10:40:38.776090 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 10:40:38.776090 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 10:40:38.776090 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application Jul 14 10:40:38.776090 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 470/941] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Jul 14 10:40:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 10:40:38.784105 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43298d7a-047f-4fdf-8256-be1cd0dae901 None admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:38.790879 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370fd9b5-b4c2-4cb4-88e7-e3213107057a None None] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:38.791180 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370fd9b5-b4c2-4cb4-88e7-e3213107057a None None] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:38.791455 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370fd9b5-b4c2-4cb4-88e7-e3213107057a None None] PATH_INFO: `/` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:38.793151 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 471/942] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jul 14 10:40:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 14 10:40:38.799606 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519031b1-afc5-4f84-b31c-da431449d522 None None] REQUEST_METHOD: `POST` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:38.799900 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519031b1-afc5-4f84-b31c-da431449d522 None None] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:38.800189 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519031b1-afc5-4f84-b31c-da431449d522 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:38.827195 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.auth.core [None req-519031b1-afc5-4f84-b31c-da431449d522 None None] MFA Rules not processed for user `ae4bcdd8106d4bebbdcae96be33505bc`. Rule list: `[]` (Enabled: `True`). {{(pid=86655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:40:38.828593 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-519031b1-afc5-4f84-b31c-da431449d522 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:40:38.911351 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=100 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:38.914518 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43298d7a-047f-4fdf-8256-be1cd0dae901 None admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:38.915327 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 472/943] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jul 14 10:40:38 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 10:40:38.945220 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519031b1-afc5-4f84-b31c-da431449d522 None None] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:38.954220 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c82a15b-864f-4cde-b435-18f9a63771a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:38.955838 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c82a15b-864f-4cde-b435-18f9a63771a8 None admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:38.956341 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c82a15b-864f-4cde-b435-18f9a63771a8 None admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:38.956860 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c82a15b-864f-4cde-b435-18f9a63771a8 None admin] PATH_INFO: `/v3/domains` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:38.958274 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c82a15b-864f-4cde-b435-18f9a63771a8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:40:38.959212 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c82a15b-864f-4cde-b435-18f9a63771a8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:38.961166 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c82a15b-864f-4cde-b435-18f9a63771a8 None admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:38.978680 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 472/944] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Jul 14 10:40:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:40:38.983648 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c82a15b-864f-4cde-b435-18f9a63771a8 None admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:39.066350 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=100 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:39.070475 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519031b1-afc5-4f84-b31c-da431449d522 None None] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:39.106078 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c82a15b-864f-4cde-b435-18f9a63771a8 None admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:39.117572 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d098c40-fbc2-49ef-a73d-080629b3679a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:39.118376 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d098c40-fbc2-49ef-a73d-080629b3679a None admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:39.118661 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d098c40-fbc2-49ef-a73d-080629b3679a None admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:39.118939 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d098c40-fbc2-49ef-a73d-080629b3679a None admin] PATH_INFO: `/v3/services/compute` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:39.119595 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d098c40-fbc2-49ef-a73d-080629b3679a None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:39.120999 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d098c40-fbc2-49ef-a73d-080629b3679a None admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:39.133568 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application [None req-4d098c40-fbc2-49ef-a73d-080629b3679a None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 14 10:40:39.133568 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:40:39.133568 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 14 10:40:39.133568 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 14 10:40:39.133568 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 14 10:40:39.133568 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 14 10:40:39.133568 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 14 10:40:39.133568 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 10:40:39.133568 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 14 10:40:39.133568 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application Jul 14 10:40:39.133568 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 10:40:39.133568 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application Jul 14 10:40:39.133568 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:40:39.133568 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:40:39.133568 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:40:39.133568 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:40:39.133568 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:40:39.134596 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:40:39.134596 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:40:39.134596 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:40:39.134596 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:40:39.134596 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:40:39.134596 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:40:39.134596 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 14 10:40:39.134596 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 14 10:40:39.134596 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 14 10:40:39.134596 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 14 10:40:39.134596 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:40:39.134596 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:40:39.134596 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:40:39.134596 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:40:39.134596 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:40:39.134596 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:40:39.135419 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:40:39.135419 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application with Lock( Jul 14 10:40:39.135419 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:40:39.135419 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:40:39.135419 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:40:39.135419 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:40:39.135419 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:40:39.135419 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:40:39.135419 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:40:39.135419 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:40:39.135419 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 14 10:40:39.135419 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 10:40:39.135419 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 14 10:40:39.135419 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application Jul 14 10:40:39.135419 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 473/945] 10.222.0.16 () {56 vars in 1111 bytes} [Thu Jul 14 10:40:38 2022] GET /identity/v3/services/compute => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 10:40:39.136211 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c2c478-926c-4490-ac63-6f4f781b38f2 None None] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:39.136285 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c2c478-926c-4490-ac63-6f4f781b38f2 None None] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:39.136729 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c2c478-926c-4490-ac63-6f4f781b38f2 None None] PATH_INFO: `/` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:39.137957 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 474/946] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jul 14 10:40:39 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:40:39.142395 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c2c478-926c-4490-ac63-6f4f781b38f2 None None] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:39.151748 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a628a9-ed2c-41e8-a936-4574a2153d21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:39.152565 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a628a9-ed2c-41e8-a936-4574a2153d21 None admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:39.152882 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a628a9-ed2c-41e8-a936-4574a2153d21 None admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:39.153164 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a628a9-ed2c-41e8-a936-4574a2153d21 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:39.161624 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a628a9-ed2c-41e8-a936-4574a2153d21 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:39.162999 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a628a9-ed2c-41e8-a936-4574a2153d21 None admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:39.178860 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application [None req-c1a628a9-ed2c-41e8-a936-4574a2153d21 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 14 10:40:39.178860 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:40:39.178860 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:40:39.178860 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:40:39.178860 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:40:39.178860 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:40:39.178860 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:40:39.178860 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:40:39.178860 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:40:39.178860 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:40:39.178860 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:40:39.178860 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:40:39.178860 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 10:40:39.178860 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 10:40:39.178860 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 10:40:39.178860 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 10:40:39.179849 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:40:39.179849 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:40:39.179849 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 10:40:39.179849 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 10:40:39.179849 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 10:40:39.179849 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 10:40:39.179849 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:40:39.179849 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:40:39.179849 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:40:39.179849 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:40:39.179849 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:40:39.179849 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application with Lock( Jul 14 10:40:39.179849 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:40:39.179849 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:40:39.179849 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:40:39.179849 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:40:39.179849 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:40:39.179849 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:40:39.180764 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:40:39.180764 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:40:39.180764 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 10:40:39.180764 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 10:40:39.180764 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 10:40:39.180764 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 10:40:39.180764 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 10:40:39.180764 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 10:40:39.180764 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 14 10:40:39.180764 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application Jul 14 10:40:39.184883 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 473/947] 10.222.0.16 () {56 vars in 1117 bytes} [Thu Jul 14 10:40:38 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:40:39.186675 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea45f577-b97b-4989-98b4-479be830e410 None None] REQUEST_METHOD: `POST` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:39.186969 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea45f577-b97b-4989-98b4-479be830e410 None None] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:39.187254 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea45f577-b97b-4989-98b4-479be830e410 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:39.204683 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.auth.core [None req-ea45f577-b97b-4989-98b4-479be830e410 None None] MFA Rules not processed for user `ae4bcdd8106d4bebbdcae96be33505bc`. Rule list: `[]` (Enabled: `True`). {{(pid=86656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:40:39.206235 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-ea45f577-b97b-4989-98b4-479be830e410 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:40:39.221526 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=100 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:39.263913 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c2c478-926c-4490-ac63-6f4f781b38f2 None None] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:39.282049 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 474/948] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jul 14 10:40:39 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 10:40:39.282986 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea45f577-b97b-4989-98b4-479be830e410 None None] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:39.319062 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43850205-35c7-4ce5-85e5-db417e6b325f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:39.319734 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43850205-35c7-4ce5-85e5-db417e6b325f None admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:39.320023 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43850205-35c7-4ce5-85e5-db417e6b325f None admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:39.320302 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43850205-35c7-4ce5-85e5-db417e6b325f None admin] PATH_INFO: `/v3/services` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:39.321071 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43850205-35c7-4ce5-85e5-db417e6b325f None admin] RBAC: Adding query filter params (name=compute) {{(pid=86655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:40:39.321380 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43850205-35c7-4ce5-85e5-db417e6b325f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:39.322753 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43850205-35c7-4ce5-85e5-db417e6b325f None admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:39.327997 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 475/949] 10.222.0.16 () {56 vars in 1112 bytes} [Thu Jul 14 10:40:39 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 10:40:39.327997 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43850205-35c7-4ce5-85e5-db417e6b325f None admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:39.362018 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=100 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:39.391299 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea45f577-b97b-4989-98b4-479be830e410 None None] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:39.424220 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fbf968-533d-4d91-a7ed-3e93176d7b26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:39.424953 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fbf968-533d-4d91-a7ed-3e93176d7b26 None admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:39.425241 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fbf968-533d-4d91-a7ed-3e93176d7b26 None admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:39.425522 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fbf968-533d-4d91-a7ed-3e93176d7b26 None admin] PATH_INFO: `/v3/users` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:39.426369 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19fbf968-533d-4d91-a7ed-3e93176d7b26 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=86656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:40:39.426683 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19fbf968-533d-4d91-a7ed-3e93176d7b26 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:39.428122 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19fbf968-533d-4d91-a7ed-3e93176d7b26 None admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:39.441380 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43850205-35c7-4ce5-85e5-db417e6b325f None admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:39.453540 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 475/950] 10.222.0.16 () {56 vars in 1149 bytes} [Thu Jul 14 10:40:39 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:40:39.453540 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fbf968-533d-4d91-a7ed-3e93176d7b26 None admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:39.461392 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=100 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:39.484237 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eddee7e-45e8-46b2-929c-7b2ddd8255a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:39.485479 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eddee7e-45e8-46b2-929c-7b2ddd8255a1 None admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:39.485590 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eddee7e-45e8-46b2-929c-7b2ddd8255a1 None admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:39.485860 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eddee7e-45e8-46b2-929c-7b2ddd8255a1 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:39.486640 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eddee7e-45e8-46b2-929c-7b2ddd8255a1 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:39.488107 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eddee7e-45e8-46b2-929c-7b2ddd8255a1 None admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:39.500822 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application [None req-7eddee7e-45e8-46b2-929c-7b2ddd8255a1 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 14 10:40:39.500822 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:40:39.500822 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 14 10:40:39.500822 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 14 10:40:39.500822 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 14 10:40:39.500822 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 14 10:40:39.500822 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 14 10:40:39.500822 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 10:40:39.500822 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 14 10:40:39.500822 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application Jul 14 10:40:39.500822 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 10:40:39.500822 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application Jul 14 10:40:39.500822 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:40:39.500822 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:40:39.500822 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:40:39.500822 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:40:39.500822 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:40:39.502017 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:40:39.502017 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:40:39.502017 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:40:39.502017 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:40:39.502017 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:40:39.502017 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:40:39.502017 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 14 10:40:39.502017 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 14 10:40:39.502017 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 14 10:40:39.502017 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 14 10:40:39.502017 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:40:39.502017 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:40:39.502017 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:40:39.502017 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:40:39.502017 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:40:39.502017 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:40:39.502840 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:40:39.502840 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application with Lock( Jul 14 10:40:39.502840 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:40:39.502840 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:40:39.502840 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:40:39.502840 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:40:39.502840 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:40:39.502840 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:40:39.502840 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:40:39.502840 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:40:39.502840 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 14 10:40:39.502840 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 10:40:39.502840 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 14 10:40:39.502840 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application Jul 14 10:40:39.502840 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 476/951] 10.222.0.16 () {56 vars in 1126 bytes} [Thu Jul 14 10:40:39 2022] GET /identity/v3/services/object-store => generated 93 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:40:39.503721 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eddee7e-45e8-46b2-929c-7b2ddd8255a1 None admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:39.572706 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fbf968-533d-4d91-a7ed-3e93176d7b26 None admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:39.602195 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=100 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:39.610880 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eddee7e-45e8-46b2-929c-7b2ddd8255a1 None admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:39.611174 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36630740-19a7-48ce-89bd-4508a402c71b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:39.611840 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36630740-19a7-48ce-89bd-4508a402c71b None admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:39.612125 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36630740-19a7-48ce-89bd-4508a402c71b None admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:39.612430 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36630740-19a7-48ce-89bd-4508a402c71b None admin] PATH_INFO: `/v3/services` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:39.613735 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36630740-19a7-48ce-89bd-4508a402c71b None admin] RBAC: Adding query filter params (type=compute) {{(pid=86656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:40:39.613735 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36630740-19a7-48ce-89bd-4508a402c71b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:39.614817 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36630740-19a7-48ce-89bd-4508a402c71b None admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:39.624808 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 476/952] 10.222.0.16 () {56 vars in 1112 bytes} [Thu Jul 14 10:40:39 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:40:39.624808 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36630740-19a7-48ce-89bd-4508a402c71b None admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:39.667910 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ba9140-f6cf-441b-aad0-57d1fa99b2d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:39.669096 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ba9140-f6cf-441b-aad0-57d1fa99b2d5 None admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:39.669539 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ba9140-f6cf-441b-aad0-57d1fa99b2d5 None admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:39.670329 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ba9140-f6cf-441b-aad0-57d1fa99b2d5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:39.686964 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ba9140-f6cf-441b-aad0-57d1fa99b2d5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:39.689239 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ba9140-f6cf-441b-aad0-57d1fa99b2d5 None admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:39.714261 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=100 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:39.715872 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application [None req-34ba9140-f6cf-441b-aad0-57d1fa99b2d5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 10:40:39.715872 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:40:39.715872 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:40:39.715872 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:40:39.715872 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:40:39.715872 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:40:39.715872 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:40:39.715872 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:40:39.715872 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:40:39.715872 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:40:39.715872 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:40:39.715872 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:40:39.715872 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 10:40:39.715872 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 10:40:39.715872 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 10:40:39.717756 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 10:40:39.717756 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:40:39.717756 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:40:39.717756 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:40:39.717756 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:40:39.717756 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:40:39.717756 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:40:39.717756 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:40:39.717756 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application with Lock( Jul 14 10:40:39.717756 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:40:39.717756 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:40:39.717756 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:40:39.717756 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:40:39.717756 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:40:39.717756 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:40:39.717756 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:40:39.717756 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:40:39.718798 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 10:40:39.718798 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 10:40:39.718798 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 10:40:39.718798 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application Jul 14 10:40:39.725116 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 477/953] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Jul 14 10:40:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:40:39.726104 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ba9140-f6cf-441b-aad0-57d1fa99b2d5 None admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:39.762286 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36630740-19a7-48ce-89bd-4508a402c71b None admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:39.807596 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a479266-0349-4982-add5-005e58a7d481 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:39.808636 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a479266-0349-4982-add5-005e58a7d481 None admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:39.809107 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a479266-0349-4982-add5-005e58a7d481 None admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:39.809392 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a479266-0349-4982-add5-005e58a7d481 None admin] PATH_INFO: `/v3/services` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:39.810918 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a479266-0349-4982-add5-005e58a7d481 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=86656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:40:39.811239 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a479266-0349-4982-add5-005e58a7d481 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:39.812632 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a479266-0349-4982-add5-005e58a7d481 None admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:39.820859 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 477/954] 10.222.0.16 () {56 vars in 1122 bytes} [Thu Jul 14 10:40:39 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:40:39.823406 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a479266-0349-4982-add5-005e58a7d481 None admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:39.876617 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ba9140-f6cf-441b-aad0-57d1fa99b2d5 None admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:39.917484 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a0afe4-bcf2-472e-b4ce-ad37e71e1478 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:39.918977 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a0afe4-bcf2-472e-b4ce-ad37e71e1478 None admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:39.919539 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a0afe4-bcf2-472e-b4ce-ad37e71e1478 None admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:39.920120 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a0afe4-bcf2-472e-b4ce-ad37e71e1478 None admin] PATH_INFO: `/v3/domains` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:39.921341 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a0afe4-bcf2-472e-b4ce-ad37e71e1478 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:40:39.921850 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a0afe4-bcf2-472e-b4ce-ad37e71e1478 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:39.923516 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a0afe4-bcf2-472e-b4ce-ad37e71e1478 None admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:39.938149 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 478/955] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Jul 14 10:40:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:40:39.939961 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a479266-0349-4982-add5-005e58a7d481 None admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:39.948827 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a0afe4-bcf2-472e-b4ce-ad37e71e1478 None admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:39.950621 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=100 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:39.976865 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c927736e-bb57-4d43-b28d-2e9d7fe51834 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:39.977505 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c927736e-bb57-4d43-b28d-2e9d7fe51834 None admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:39.977792 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c927736e-bb57-4d43-b28d-2e9d7fe51834 None admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:39.978074 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c927736e-bb57-4d43-b28d-2e9d7fe51834 None admin] PATH_INFO: `/v3/services` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:39.978821 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c927736e-bb57-4d43-b28d-2e9d7fe51834 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=86656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:40:39.979151 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c927736e-bb57-4d43-b28d-2e9d7fe51834 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:39.980688 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c927736e-bb57-4d43-b28d-2e9d7fe51834 None admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:39.982221 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=100 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:39.988592 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 478/956] 10.222.0.16 () {56 vars in 1122 bytes} [Thu Jul 14 10:40:39 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 10:40:39.993693 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c927736e-bb57-4d43-b28d-2e9d7fe51834 None admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:40.076480 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a0afe4-bcf2-472e-b4ce-ad37e71e1478 None admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:40.096678 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c927736e-bb57-4d43-b28d-2e9d7fe51834 None admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:40.121545 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce68c2e9-2c19-463f-83ad-4eef526a97d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:40.123554 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce68c2e9-2c19-463f-83ad-4eef526a97d9 None admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:40.125470 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce68c2e9-2c19-463f-83ad-4eef526a97d9 None admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:40.125587 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce68c2e9-2c19-463f-83ad-4eef526a97d9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:40.133029 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce68c2e9-2c19-463f-83ad-4eef526a97d9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:40.134548 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce68c2e9-2c19-463f-83ad-4eef526a97d9 None admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:40.135094 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99facf5a-523c-4d98-ae96-a4d3625a4795 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:40.135968 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99facf5a-523c-4d98-ae96-a4d3625a4795 None admin] REQUEST_METHOD: `POST` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:40.136644 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99facf5a-523c-4d98-ae96-a4d3625a4795 None admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:40.137099 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99facf5a-523c-4d98-ae96-a4d3625a4795 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:40.138456 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99facf5a-523c-4d98-ae96-a4d3625a4795 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:40.139953 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99facf5a-523c-4d98-ae96-a4d3625a4795 None admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:40.150238 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application [None req-ce68c2e9-2c19-463f-83ad-4eef526a97d9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 10:40:40.150238 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:40:40.150238 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:40:40.150238 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:40:40.150238 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:40:40.150238 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:40:40.150238 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:40:40.150238 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:40:40.150238 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:40:40.150238 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:40:40.150238 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:40:40.150238 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:40:40.150238 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 10:40:40.150238 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 10:40:40.150238 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 10:40:40.151520 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 10:40:40.151520 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:40:40.151520 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:40:40.151520 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:40:40.151520 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:40:40.151520 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:40:40.151520 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:40:40.151520 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:40:40.151520 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application with Lock( Jul 14 10:40:40.151520 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:40:40.151520 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:40:40.151520 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:40:40.151520 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:40:40.151520 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:40:40.151520 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:40:40.151520 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:40:40.151520 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:40:40.152448 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 10:40:40.152448 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 10:40:40.152448 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 10:40:40.152448 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 10:40:40.152448 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 10:40:40.152448 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 10:40:40.152448 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 10:40:40.152448 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application Jul 14 10:40:40.157136 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 479/957] 10.222.0.16 () {56 vars in 1111 bytes} [Thu Jul 14 10:40:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:40:40.158068 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce68c2e9-2c19-463f-83ad-4eef526a97d9 None admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:40.165402 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 479/958] 10.222.0.16 () {60 vars in 1144 bytes} [Thu Jul 14 10:40:39 2022] POST /identity/v3/endpoints => generated 349 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:40:40.238224 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=100 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:40.286882 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce68c2e9-2c19-463f-83ad-4eef526a97d9 None admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:40.333914 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049e520b-e67c-4f45-be83-28a471eb80dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:40.334610 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049e520b-e67c-4f45-be83-28a471eb80dd None admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:40.334891 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049e520b-e67c-4f45-be83-28a471eb80dd None admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:40.335167 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049e520b-e67c-4f45-be83-28a471eb80dd None admin] PATH_INFO: `/v3/projects` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:40.335962 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049e520b-e67c-4f45-be83-28a471eb80dd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:40:40.336270 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049e520b-e67c-4f45-be83-28a471eb80dd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:40.337730 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049e520b-e67c-4f45-be83-28a471eb80dd None admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:40.350939 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 480/959] 10.222.0.16 () {56 vars in 1148 bytes} [Thu Jul 14 10:40:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:40:40.356672 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99facf5a-523c-4d98-ae96-a4d3625a4795 None admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:40.422185 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:40.472604 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99facf5a-523c-4d98-ae96-a4d3625a4795 None admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:40.509769 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246b6353-e83c-495a-be7a-d31e393ff81d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:40.510587 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246b6353-e83c-495a-be7a-d31e393ff81d None admin] REQUEST_METHOD: `PUT` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:40.510875 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246b6353-e83c-495a-be7a-d31e393ff81d None admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:40.511154 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246b6353-e83c-495a-be7a-d31e393ff81d None admin] PATH_INFO: `/v3/projects/59391272ecbe48b0aa736cb43807be1d/users/0dfc7cd9c05e4f268d2ce316d531c4bd/roles/ced8748f90594f3b81cabd4051d44e91` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:40.514005 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246b6353-e83c-495a-be7a-d31e393ff81d None admin] RBAC: Authorizing `identity:create_grant(project_id=59391272ecbe48b0aa736cb43807be1d, user_id=0dfc7cd9c05e4f268d2ce316d531c4bd, role_id=ced8748f90594f3b81cabd4051d44e91)` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:40.515460 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246b6353-e83c-495a-be7a-d31e393ff81d None admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:40.533324 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 480/960] 10.222.0.16 () {58 vars in 1439 bytes} [Thu Jul 14 10:40:40 2022] PUT /identity/v3/projects/59391272ecbe48b0aa736cb43807be1d/users/0dfc7cd9c05e4f268d2ce316d531c4bd/roles/ced8748f90594f3b81cabd4051d44e91 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:40:40.858868 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e49029-52d1-4188-acab-e595e7df665e None None] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:40.859215 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e49029-52d1-4188-acab-e595e7df665e None None] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:40.859429 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e49029-52d1-4188-acab-e595e7df665e None None] PATH_INFO: `/` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:40.861061 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 481/961] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jul 14 10:40:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:40:40.866098 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40fa8e9-552c-412b-95dc-4c838339405a None None] REQUEST_METHOD: `POST` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:40.866386 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40fa8e9-552c-412b-95dc-4c838339405a None None] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:40.866666 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40fa8e9-552c-412b-95dc-4c838339405a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:40.883787 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.auth.core [None req-a40fa8e9-552c-412b-95dc-4c838339405a None None] MFA Rules not processed for user `ae4bcdd8106d4bebbdcae96be33505bc`. Rule list: `[]` (Enabled: `True`). {{(pid=86656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:40:40.884994 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-a40fa8e9-552c-412b-95dc-4c838339405a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:40:40.954802 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 481/962] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jul 14 10:40:40 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 10:40:40.978538 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e49029-52d1-4188-acab-e595e7df665e None None] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:41.086926 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e49029-52d1-4188-acab-e595e7df665e None None] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:41.108944 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=100 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:41.124242 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a8a7eb-6ca1-4140-bbda-02559ee59fa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:41.125281 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a8a7eb-6ca1-4140-bbda-02559ee59fa1 None admin] REQUEST_METHOD: `POST` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:41.125765 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a8a7eb-6ca1-4140-bbda-02559ee59fa1 None admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:41.126256 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a8a7eb-6ca1-4140-bbda-02559ee59fa1 None admin] PATH_INFO: `/v3/users` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:41.127173 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a8a7eb-6ca1-4140-bbda-02559ee59fa1 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:41.128846 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a8a7eb-6ca1-4140-bbda-02559ee59fa1 None admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:41.130383 dv-cinder-846146-7-smb devstack@keystone.service[86655]: WARNING keystone.server.flask.common [None req-30a8a7eb-6ca1-4140-bbda-02559ee59fa1 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jul 14 10:40:41.145572 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.sql.core [None req-30a8a7eb-6ca1-4140-bbda-02559ee59fa1 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 14 10:40:41.145572 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jul 14 10:40:41.145572 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [parameters: {'user_id': 'ec36ad2bf1ae41e6bbade3d472d6a19c', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jul 14 10:40:41.145572 dv-cinder-846146-7-smb devstack@keystone.service[86655]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=86655) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 14 10:40:41.167286 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application [None req-30a8a7eb-6ca1-4140-bbda-02559ee59fa1 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jul 14 10:40:41.167286 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:40:41.167286 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 14 10:40:41.167286 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 14 10:40:41.167286 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 14 10:40:41.167286 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 14 10:40:41.167286 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 14 10:40:41.167286 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application result = self._query(query) Jul 14 10:40:41.167286 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 14 10:40:41.167286 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application conn.query(q) Jul 14 10:40:41.167286 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 14 10:40:41.167286 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 14 10:40:41.167286 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 14 10:40:41.167286 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application result.read() Jul 14 10:40:41.167286 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 14 10:40:41.168243 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 14 10:40:41.168243 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 14 10:40:41.168243 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 14 10:40:41.168243 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 14 10:40:41.168243 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 14 10:40:41.168243 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 14 10:40:41.168243 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 14 10:40:41.168243 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 14 10:40:41.168243 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application Jul 14 10:40:41.168243 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 14 10:40:41.168243 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application Jul 14 10:40:41.168243 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:40:41.168243 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 14 10:40:41.168243 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 14 10:40:41.168243 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Jul 14 10:40:41.168243 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Jul 14 10:40:41.168243 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 14 10:40:41.168243 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application next(self.gen) Jul 14 10:40:41.169229 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 14 10:40:41.169229 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application yield resource Jul 14 10:40:41.169229 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 14 10:40:41.169229 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application next(self.gen) Jul 14 10:40:41.169229 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 14 10:40:41.169229 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application self.session.rollback() Jul 14 10:40:41.169229 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 14 10:40:41.169229 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application self.force_reraise() Jul 14 10:40:41.169229 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 14 10:40:41.169229 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application raise self.value Jul 14 10:40:41.169229 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 14 10:40:41.169229 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 14 10:40:41.169229 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 14 10:40:41.169229 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application session.commit() Jul 14 10:40:41.169229 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 14 10:40:41.169229 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 14 10:40:41.169229 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 14 10:40:41.170830 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application self._prepare_impl() Jul 14 10:40:41.170830 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 14 10:40:41.170830 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application self.session.flush() Jul 14 10:40:41.170830 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 14 10:40:41.170830 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application self._flush(objects) Jul 14 10:40:41.170830 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 14 10:40:41.170830 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 14 10:40:41.170830 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 14 10:40:41.170830 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application compat.raise_( Jul 14 10:40:41.170830 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 14 10:40:41.170830 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application raise exception Jul 14 10:40:41.170830 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 14 10:40:41.170830 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application flush_context.execute() Jul 14 10:40:41.170830 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 14 10:40:41.170830 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application rec.execute(self) Jul 14 10:40:41.170830 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 14 10:40:41.170830 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 14 10:40:41.171723 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 14 10:40:41.171723 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 14 10:40:41.171723 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Jul 14 10:40:41.171723 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application result = connection._execute_20( Jul 14 10:40:41.171723 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 14 10:40:41.171723 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 14 10:40:41.171723 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 14 10:40:41.171723 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 14 10:40:41.171723 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 14 10:40:41.171723 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 14 10:40:41.171723 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 14 10:40:41.171723 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 14 10:40:41.171723 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 14 10:40:41.171723 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 14 10:40:41.171723 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 14 10:40:41.171723 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application raise exception Jul 14 10:40:41.172585 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 14 10:40:41.172585 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 14 10:40:41.172585 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 14 10:40:41.172585 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 14 10:40:41.172585 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 14 10:40:41.172585 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application result = self._query(query) Jul 14 10:40:41.172585 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 14 10:40:41.172585 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application conn.query(q) Jul 14 10:40:41.172585 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 14 10:40:41.172585 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 14 10:40:41.172585 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 14 10:40:41.172585 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application result.read() Jul 14 10:40:41.172585 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 14 10:40:41.172585 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 14 10:40:41.172585 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 14 10:40:41.172585 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 14 10:40:41.175204 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 14 10:40:41.175204 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 14 10:40:41.175204 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 14 10:40:41.175204 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 14 10:40:41.175204 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 14 10:40:41.175204 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jul 14 10:40:41.175204 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application [parameters: {'user_id': 'ec36ad2bf1ae41e6bbade3d472d6a19c', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jul 14 10:40:41.175204 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 14 10:40:41.175204 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application Jul 14 10:40:41.175204 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 10:40:41.175204 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application Jul 14 10:40:41.175204 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:40:41.175204 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:40:41.175204 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:40:41.175204 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:40:41.177112 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:40:41.177112 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:40:41.177112 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:40:41.177112 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:40:41.177112 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:40:41.177112 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:40:41.177112 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:40:41.177112 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Jul 14 10:40:41.177112 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Jul 14 10:40:41.177112 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:40:41.177112 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:40:41.177112 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 10:40:41.177112 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 10:40:41.177112 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 10:40:41.177112 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 10:40:41.177112 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Jul 14 10:40:41.177112 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Jul 14 10:40:41.179251 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Jul 14 10:40:41.179251 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Jul 14 10:40:41.179251 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 14 10:40:41.179251 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 14 10:40:41.179251 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jul 14 10:40:41.179251 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application Jul 14 10:40:41.181981 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 482/963] 10.222.0.16 () {60 vars in 1131 bytes} [Thu Jul 14 10:40:40 2022] POST /identity/v3/users => generated 160 bytes in 204 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:40:41.188864 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40fa8e9-552c-412b-95dc-4c838339405a None None] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:41.235534 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:41.291514 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40fa8e9-552c-412b-95dc-4c838339405a None None] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:41.326278 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b737c0-c0e6-4d70-aa0f-700f680361a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:41.327080 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b737c0-c0e6-4d70-aa0f-700f680361a6 None admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:41.327363 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b737c0-c0e6-4d70-aa0f-700f680361a6 None admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:41.327639 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b737c0-c0e6-4d70-aa0f-700f680361a6 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:41.335028 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b737c0-c0e6-4d70-aa0f-700f680361a6 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:41.336539 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b737c0-c0e6-4d70-aa0f-700f680361a6 None admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:41.351739 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application [None req-b2b737c0-c0e6-4d70-aa0f-700f680361a6 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 14 10:40:41.351739 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:40:41.351739 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:40:41.351739 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:40:41.351739 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:40:41.351739 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:40:41.351739 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:40:41.351739 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:40:41.351739 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:40:41.351739 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:40:41.351739 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:40:41.351739 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:40:41.351739 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 10:40:41.351739 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 10:40:41.351739 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 10:40:41.351739 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 10:40:41.352691 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:40:41.352691 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:40:41.352691 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 10:40:41.352691 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 10:40:41.352691 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 10:40:41.352691 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 10:40:41.352691 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:40:41.352691 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:40:41.352691 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:40:41.352691 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:40:41.352691 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:40:41.352691 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application with Lock( Jul 14 10:40:41.352691 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:40:41.352691 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:40:41.352691 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:40:41.352691 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:40:41.352691 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:40:41.352691 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:40:41.353670 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:40:41.353670 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:40:41.353670 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 10:40:41.353670 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 10:40:41.353670 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 10:40:41.353670 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 10:40:41.353670 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 10:40:41.353670 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 10:40:41.353670 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 14 10:40:41.353670 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application Jul 14 10:40:41.353670 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 482/964] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Jul 14 10:40:41 2022] GET /identity/v3/users/cinder => generated 84 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:40:41.359192 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a8a7eb-6ca1-4140-bbda-02559ee59fa1 None admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:41.465019 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a8a7eb-6ca1-4140-bbda-02559ee59fa1 None admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:41.510234 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d87ad72-5704-46b3-87b5-6d6cbb49ca9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:41.510913 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d87ad72-5704-46b3-87b5-6d6cbb49ca9c None admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:41.511197 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d87ad72-5704-46b3-87b5-6d6cbb49ca9c None admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:41.511472 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d87ad72-5704-46b3-87b5-6d6cbb49ca9c None admin] PATH_INFO: `/v3/users` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:41.512281 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d87ad72-5704-46b3-87b5-6d6cbb49ca9c None admin] RBAC: Adding query filter params (name=cinder) {{(pid=86655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:40:41.512588 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d87ad72-5704-46b3-87b5-6d6cbb49ca9c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:41.515046 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d87ad72-5704-46b3-87b5-6d6cbb49ca9c None admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:41.561367 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 483/965] 10.222.0.16 () {56 vars in 1101 bytes} [Thu Jul 14 10:40:41 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:40:41.722392 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00816d9-f889-4020-ac59-8e1ba7ef1ca3 None None] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:41.722583 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00816d9-f889-4020-ac59-8e1ba7ef1ca3 None None] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:41.722855 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00816d9-f889-4020-ac59-8e1ba7ef1ca3 None None] PATH_INFO: `/` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:41.724485 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 483/966] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jul 14 10:40:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:40:41.729833 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9c364f-5c5a-4c2f-bab3-9451c2c5895b None None] REQUEST_METHOD: `POST` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:41.730365 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9c364f-5c5a-4c2f-bab3-9451c2c5895b None None] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:41.730921 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9c364f-5c5a-4c2f-bab3-9451c2c5895b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:41.749378 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.auth.core [None req-4c9c364f-5c5a-4c2f-bab3-9451c2c5895b None None] MFA Rules not processed for user `ae4bcdd8106d4bebbdcae96be33505bc`. Rule list: `[]` (Enabled: `True`). {{(pid=86655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:40:41.751218 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-4c9c364f-5c5a-4c2f-bab3-9451c2c5895b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:40:41.794050 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:41.831764 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 484/967] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jul 14 10:40:41 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 10:40:41.854561 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00816d9-f889-4020-ac59-8e1ba7ef1ca3 None None] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:41.958862 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00816d9-f889-4020-ac59-8e1ba7ef1ca3 None None] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:41.961221 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=100 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:41.994430 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcd82cc-f393-4d90-8f11-edb13909ea43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:41.995028 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcd82cc-f393-4d90-8f11-edb13909ea43 None admin] REQUEST_METHOD: `POST` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:41.995309 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcd82cc-f393-4d90-8f11-edb13909ea43 None admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:41.995587 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcd82cc-f393-4d90-8f11-edb13909ea43 None admin] PATH_INFO: `/v3/services` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:41.996324 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbcd82cc-f393-4d90-8f11-edb13909ea43 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:41.997914 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbcd82cc-f393-4d90-8f11-edb13909ea43 None admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:42.020802 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 484/968] 10.222.0.16 () {60 vars in 1141 bytes} [Thu Jul 14 10:40:41 2022] POST /identity/v3/services => generated 242 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 10:40:42.409791 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fd7b20-f063-4fd7-8c93-b090660ff62a None None] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:42.410316 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fd7b20-f063-4fd7-8c93-b090660ff62a None None] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:42.410394 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fd7b20-f063-4fd7-8c93-b090660ff62a None None] PATH_INFO: `/` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:42.411852 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 485/969] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jul 14 10:40:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:40:42.416759 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7645db3-6665-4db5-aaed-c5848fe3c7cf None None] REQUEST_METHOD: `POST` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:42.417076 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7645db3-6665-4db5-aaed-c5848fe3c7cf None None] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:42.417361 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7645db3-6665-4db5-aaed-c5848fe3c7cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:42.434845 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.auth.core [None req-a7645db3-6665-4db5-aaed-c5848fe3c7cf None None] MFA Rules not processed for user `ae4bcdd8106d4bebbdcae96be33505bc`. Rule list: `[]` (Enabled: `True`). {{(pid=86656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:40:42.436446 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-a7645db3-6665-4db5-aaed-c5848fe3c7cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:40:42.528041 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 485/970] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jul 14 10:40:42 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 10:40:42.551200 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fd7b20-f063-4fd7-8c93-b090660ff62a None None] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:42.654838 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fd7b20-f063-4fd7-8c93-b090660ff62a None None] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:42.671424 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1cef24-1685-4507-9281-39c1a97b0690 None None] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:42.671714 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1cef24-1685-4507-9281-39c1a97b0690 None None] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:42.671924 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1cef24-1685-4507-9281-39c1a97b0690 None None] PATH_INFO: `/` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:42.673658 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 486/971] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jul 14 10:40:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 14 10:40:42.678502 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d979ce2-e687-4444-8f9d-c275029d7cd5 None None] REQUEST_METHOD: `POST` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:42.678798 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d979ce2-e687-4444-8f9d-c275029d7cd5 None None] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:42.679078 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d979ce2-e687-4444-8f9d-c275029d7cd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:42.691671 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77cf1991-969e-4ab2-a190-445b9eb8dec1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:42.692478 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cf1991-969e-4ab2-a190-445b9eb8dec1 None admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:42.692762 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cf1991-969e-4ab2-a190-445b9eb8dec1 None admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:42.693067 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cf1991-969e-4ab2-a190-445b9eb8dec1 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:42.693726 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77cf1991-969e-4ab2-a190-445b9eb8dec1 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:42.695089 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77cf1991-969e-4ab2-a190-445b9eb8dec1 None admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:42.696935 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.auth.core [None req-5d979ce2-e687-4444-8f9d-c275029d7cd5 None None] MFA Rules not processed for user `ae4bcdd8106d4bebbdcae96be33505bc`. Rule list: `[]` (Enabled: `True`). {{(pid=86656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:40:42.698133 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-5d979ce2-e687-4444-8f9d-c275029d7cd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:40:42.707150 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application [None req-77cf1991-969e-4ab2-a190-445b9eb8dec1 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 14 10:40:42.707150 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:40:42.707150 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 14 10:40:42.707150 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 14 10:40:42.707150 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 14 10:40:42.707150 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 14 10:40:42.707150 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 14 10:40:42.707150 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 10:40:42.707150 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 14 10:40:42.707150 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application Jul 14 10:40:42.707150 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 10:40:42.707150 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application Jul 14 10:40:42.707150 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:40:42.707150 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:40:42.707150 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:40:42.707150 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:40:42.707150 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:40:42.708258 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:40:42.708258 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:40:42.708258 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:40:42.708258 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:40:42.708258 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:40:42.708258 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:40:42.708258 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 14 10:40:42.708258 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 14 10:40:42.708258 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 14 10:40:42.708258 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 14 10:40:42.708258 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:40:42.708258 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:40:42.708258 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:40:42.708258 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:40:42.708258 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:40:42.708258 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:40:42.709132 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:40:42.709132 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application with Lock( Jul 14 10:40:42.709132 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:40:42.709132 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:40:42.709132 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:40:42.709132 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:40:42.709132 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:40:42.709132 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:40:42.709132 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:40:42.709132 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:40:42.709132 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 14 10:40:42.709132 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 10:40:42.709132 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 14 10:40:42.709132 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application Jul 14 10:40:42.709132 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 486/972] 10.222.0.16 () {56 vars in 1126 bytes} [Thu Jul 14 10:40:42 2022] GET /identity/v3/services/object-store => generated 93 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:40:42.714357 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77cf1991-969e-4ab2-a190-445b9eb8dec1 None admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:42.752962 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=100 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:42.771128 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 487/973] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jul 14 10:40:42 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 14 10:40:42.797503 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d979ce2-e687-4444-8f9d-c275029d7cd5 None None] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:42.821243 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:42.845828 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77cf1991-969e-4ab2-a190-445b9eb8dec1 None admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:42.881256 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea568a0-70e5-4ac1-8955-d43c828a2d42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:42.881927 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea568a0-70e5-4ac1-8955-d43c828a2d42 None admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:42.882218 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea568a0-70e5-4ac1-8955-d43c828a2d42 None admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:42.882900 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea568a0-70e5-4ac1-8955-d43c828a2d42 None admin] PATH_INFO: `/v3/services` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:42.883614 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea568a0-70e5-4ac1-8955-d43c828a2d42 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=86655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:40:42.883927 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea568a0-70e5-4ac1-8955-d43c828a2d42 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:42.886085 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea568a0-70e5-4ac1-8955-d43c828a2d42 None admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:42.891601 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 487/974] 10.222.0.16 () {56 vars in 1122 bytes} [Thu Jul 14 10:40:42 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 10:40:42.897051 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea568a0-70e5-4ac1-8955-d43c828a2d42 None admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:42.909795 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d979ce2-e687-4444-8f9d-c275029d7cd5 None None] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:42.948766 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5b13eb-4179-40f0-ab80-abd62d7bce9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:42.949590 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5b13eb-4179-40f0-ab80-abd62d7bce9f None admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:42.949875 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5b13eb-4179-40f0-ab80-abd62d7bce9f None admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:42.950155 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5b13eb-4179-40f0-ab80-abd62d7bce9f None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:42.960366 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5b13eb-4179-40f0-ab80-abd62d7bce9f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 10:40:42.969265 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application [None req-cd5b13eb-4179-40f0-ab80-abd62d7bce9f None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 14 10:40:42.969265 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:40:42.969265 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:40:42.969265 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:40:42.969265 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:40:42.969265 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:40:42.969265 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:40:42.969265 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:40:42.969265 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:40:42.969265 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:40:42.969265 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:40:42.969265 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:40:42.969265 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 10:40:42.969265 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 10:40:42.969265 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 10:40:42.969265 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 10:40:42.970193 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 10:40:42.970193 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 10:40:42.970193 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 10:40:42.970193 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 10:40:42.970193 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:40:42.970193 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:40:42.970193 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:40:42.970193 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:40:42.970193 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:40:42.970193 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:40:42.970193 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:40:42.970193 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application with Lock( Jul 14 10:40:42.970193 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:40:42.970193 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:40:42.970193 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:40:42.970193 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:40:42.971032 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:40:42.971032 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:40:42.971032 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:40:42.971032 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:40:42.971032 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 10:40:42.971032 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 10:40:42.971032 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 10:40:42.971032 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 10:40:42.971032 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 10:40:42.971032 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 10:40:42.971032 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 14 10:40:42.971032 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application Jul 14 10:40:42.971032 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 488/975] 10.222.0.16 () {56 vars in 1120 bytes} [Thu Jul 14 10:40:42 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:40:42.976107 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5b13eb-4179-40f0-ab80-abd62d7bce9f None admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:43.001050 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=100 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:43.005756 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea568a0-70e5-4ac1-8955-d43c828a2d42 None admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:43.040179 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668e944f-6dbb-4ae7-823f-6ec804ee7edb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:43.040877 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668e944f-6dbb-4ae7-823f-6ec804ee7edb None admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:43.041167 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668e944f-6dbb-4ae7-823f-6ec804ee7edb None admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:43.041445 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668e944f-6dbb-4ae7-823f-6ec804ee7edb None admin] PATH_INFO: `/v3/services` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:43.042155 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668e944f-6dbb-4ae7-823f-6ec804ee7edb None admin] RBAC: Adding query filter params (type=object-store) {{(pid=86655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:40:43.042464 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668e944f-6dbb-4ae7-823f-6ec804ee7edb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:43.043820 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668e944f-6dbb-4ae7-823f-6ec804ee7edb None admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:43.052814 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 488/976] 10.222.0.16 () {56 vars in 1122 bytes} [Thu Jul 14 10:40:42 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 10:40:43.054576 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668e944f-6dbb-4ae7-823f-6ec804ee7edb None admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:43.065293 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=100 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:43.084347 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5b13eb-4179-40f0-ab80-abd62d7bce9f None admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:43.120164 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5deef4-efb9-46fd-852f-1bab19e9e8bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:43.120870 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5deef4-efb9-46fd-852f-1bab19e9e8bf None admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:43.121207 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5deef4-efb9-46fd-852f-1bab19e9e8bf None admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:43.121433 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5deef4-efb9-46fd-852f-1bab19e9e8bf None admin] PATH_INFO: `/v3/roles` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:43.122201 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5deef4-efb9-46fd-852f-1bab19e9e8bf None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=86656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:40:43.123202 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5deef4-efb9-46fd-852f-1bab19e9e8bf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:43.124622 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5deef4-efb9-46fd-852f-1bab19e9e8bf None admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:43.140812 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 489/977] 10.222.0.16 () {56 vars in 1115 bytes} [Thu Jul 14 10:40:42 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 10:40:43.141804 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5deef4-efb9-46fd-852f-1bab19e9e8bf None admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:43.167675 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668e944f-6dbb-4ae7-823f-6ec804ee7edb None admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:43.202985 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ab723d-51d7-46c1-a0d3-145c31d85421 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:43.203570 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ab723d-51d7-46c1-a0d3-145c31d85421 None admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:43.203856 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ab723d-51d7-46c1-a0d3-145c31d85421 None admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:43.204136 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ab723d-51d7-46c1-a0d3-145c31d85421 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:43.204984 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ab723d-51d7-46c1-a0d3-145c31d85421 None admin] RBAC: Adding query filter params (interface=admin, service_id=7bd97e2fede342b39829d345bca0d7bb, region_id=RegionOne) {{(pid=86655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:40:43.205306 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ab723d-51d7-46c1-a0d3-145c31d85421 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:43.206663 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ab723d-51d7-46c1-a0d3-145c31d85421 None admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:43.211895 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 489/978] 10.222.0.16 () {56 vars in 1249 bytes} [Thu Jul 14 10:40:43 2022] GET /identity/v3/endpoints?service_id=7bd97e2fede342b39829d345bca0d7bb&interface=admin®ion_id=RegionOne => generated 193 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 10:40:43.217495 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ab723d-51d7-46c1-a0d3-145c31d85421 None admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:43.246156 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=100 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:43.256055 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5deef4-efb9-46fd-852f-1bab19e9e8bf None admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:43.292200 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4be104-5c24-4deb-996f-2817b9ecbe9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:43.293015 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4be104-5c24-4deb-996f-2817b9ecbe9c None admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:43.293302 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4be104-5c24-4deb-996f-2817b9ecbe9c None admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:43.293578 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4be104-5c24-4deb-996f-2817b9ecbe9c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:43.305501 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4be104-5c24-4deb-996f-2817b9ecbe9c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:43.306945 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4be104-5c24-4deb-996f-2817b9ecbe9c None admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:43.308659 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=100 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:43.324894 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application [None req-cb4be104-5c24-4deb-996f-2817b9ecbe9c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 10:40:43.324894 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:40:43.324894 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:40:43.324894 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:40:43.324894 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:40:43.324894 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:40:43.324894 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:40:43.324894 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:40:43.324894 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:40:43.324894 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:40:43.324894 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:40:43.324894 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:40:43.324894 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 10:40:43.324894 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 10:40:43.324894 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 10:40:43.325861 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 10:40:43.325861 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:40:43.325861 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:40:43.325861 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:40:43.325861 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:40:43.325861 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:40:43.325861 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:40:43.325861 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:40:43.325861 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application with Lock( Jul 14 10:40:43.325861 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:40:43.325861 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:40:43.325861 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:40:43.325861 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:40:43.325861 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:40:43.325861 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:40:43.325861 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:40:43.325861 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:40:43.331683 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 10:40:43.331683 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 10:40:43.331683 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 10:40:43.331683 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application Jul 14 10:40:43.331902 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ab723d-51d7-46c1-a0d3-145c31d85421 None admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:43.331987 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 490/979] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Jul 14 10:40:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 10:40:43.331987 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4be104-5c24-4deb-996f-2817b9ecbe9c None admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:43.365388 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff38cabc-ac1a-4eef-be6c-87a65f1358cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:43.366056 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff38cabc-ac1a-4eef-be6c-87a65f1358cb None admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:43.366343 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff38cabc-ac1a-4eef-be6c-87a65f1358cb None admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:43.366622 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff38cabc-ac1a-4eef-be6c-87a65f1358cb None admin] PATH_INFO: `/v3/services` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:43.367306 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff38cabc-ac1a-4eef-be6c-87a65f1358cb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:43.368672 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff38cabc-ac1a-4eef-be6c-87a65f1358cb None admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:43.375214 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 490/980] 10.222.0.16 () {56 vars in 1087 bytes} [Thu Jul 14 10:40:43 2022] GET /identity/v3/services => generated 1727 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 10:40:43.440161 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4be104-5c24-4deb-996f-2817b9ecbe9c None admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:43.476801 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2eedf29-39f5-424d-ae18-098c0460f9dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:43.477426 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2eedf29-39f5-424d-ae18-098c0460f9dd None admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:43.477717 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2eedf29-39f5-424d-ae18-098c0460f9dd None admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:43.477998 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2eedf29-39f5-424d-ae18-098c0460f9dd None admin] PATH_INFO: `/v3/domains` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:43.478740 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2eedf29-39f5-424d-ae18-098c0460f9dd None admin] RBAC: Adding query filter params (name=Default) {{(pid=86656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:40:43.479052 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2eedf29-39f5-424d-ae18-098c0460f9dd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:43.480460 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2eedf29-39f5-424d-ae18-098c0460f9dd None admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:43.501383 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 491/981] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Jul 14 10:40:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:40:43.502685 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff38cabc-ac1a-4eef-be6c-87a65f1358cb None admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:43.601006 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=100 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:43.612094 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff38cabc-ac1a-4eef-be6c-87a65f1358cb None admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:43.646606 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc83a98-3679-4f01-bcdd-63b3c4023f6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:43.647421 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc83a98-3679-4f01-bcdd-63b3c4023f6e None admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:43.647704 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc83a98-3679-4f01-bcdd-63b3c4023f6e None admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:43.647974 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc83a98-3679-4f01-bcdd-63b3c4023f6e None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:43.656351 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc83a98-3679-4f01-bcdd-63b3c4023f6e None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:43.657824 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc83a98-3679-4f01-bcdd-63b3c4023f6e None admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:43.673020 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application [None req-4fc83a98-3679-4f01-bcdd-63b3c4023f6e None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 14 10:40:43.673020 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:40:43.673020 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:40:43.673020 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:40:43.673020 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:40:43.673020 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:40:43.673020 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:40:43.673020 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:40:43.673020 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:40:43.673020 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:40:43.673020 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:40:43.673020 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:40:43.673020 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 10:40:43.673020 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 10:40:43.673020 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 10:40:43.673020 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 10:40:43.673992 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:40:43.673992 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:40:43.673992 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 10:40:43.673992 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 10:40:43.673992 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 10:40:43.673992 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 10:40:43.673992 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:40:43.673992 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:40:43.673992 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:40:43.673992 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:40:43.673992 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:40:43.673992 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application with Lock( Jul 14 10:40:43.673992 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:40:43.673992 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:40:43.673992 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:40:43.673992 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:40:43.673992 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:40:43.673992 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:40:43.674967 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:40:43.674967 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:40:43.674967 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 10:40:43.674967 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 10:40:43.674967 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 10:40:43.674967 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 10:40:43.674967 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 10:40:43.674967 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 10:40:43.674967 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 14 10:40:43.674967 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application Jul 14 10:40:43.674967 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 491/982] 10.222.0.16 () {56 vars in 1117 bytes} [Thu Jul 14 10:40:43 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:40:43.679843 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2eedf29-39f5-424d-ae18-098c0460f9dd None admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:43.738620 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=100 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:43.787698 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2eedf29-39f5-424d-ae18-098c0460f9dd None admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:43.823489 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d53b15b-e3c0-4828-89fd-a2a36ef86c03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:43.824160 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d53b15b-e3c0-4828-89fd-a2a36ef86c03 None admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:43.824442 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d53b15b-e3c0-4828-89fd-a2a36ef86c03 None admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:43.824716 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d53b15b-e3c0-4828-89fd-a2a36ef86c03 None admin] PATH_INFO: `/v3/users` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:43.825706 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d53b15b-e3c0-4828-89fd-a2a36ef86c03 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=86656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:40:43.826016 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d53b15b-e3c0-4828-89fd-a2a36ef86c03 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:43.827446 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d53b15b-e3c0-4828-89fd-a2a36ef86c03 None admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:43.846383 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 492/983] 10.222.0.16 () {56 vars in 1149 bytes} [Thu Jul 14 10:40:43 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 10:40:43.852186 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc83a98-3679-4f01-bcdd-63b3c4023f6e None admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:43.958369 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc83a98-3679-4f01-bcdd-63b3c4023f6e None admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:43.991937 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5791b958-e955-4d05-8691-da0fce76186a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:43.992572 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5791b958-e955-4d05-8691-da0fce76186a None admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:43.992887 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5791b958-e955-4d05-8691-da0fce76186a None admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:43.993170 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5791b958-e955-4d05-8691-da0fce76186a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:44.011879 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=100 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:44.062984 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5791b958-e955-4d05-8691-da0fce76186a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:44.064440 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5791b958-e955-4d05-8691-da0fce76186a None admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:44.076018 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba378686-ed6f-43f4-850e-7aba79f95935 None None] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:44.076712 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba378686-ed6f-43f4-850e-7aba79f95935 None None] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:44.076712 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba378686-ed6f-43f4-850e-7aba79f95935 None None] PATH_INFO: `/` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:44.078225 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 493/984] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jul 14 10:40:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:40:44.082850 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea79e6c-9e76-460f-a5ca-55fcc744387f None None] REQUEST_METHOD: `POST` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:44.083142 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea79e6c-9e76-460f-a5ca-55fcc744387f None None] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:44.083437 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea79e6c-9e76-460f-a5ca-55fcc744387f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:44.100424 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.auth.core [None req-1ea79e6c-9e76-460f-a5ca-55fcc744387f None None] MFA Rules not processed for user `ae4bcdd8106d4bebbdcae96be33505bc`. Rule list: `[]` (Enabled: `True`). {{(pid=86656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:40:44.101633 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-1ea79e6c-9e76-460f-a5ca-55fcc744387f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:40:44.172158 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 494/985] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jul 14 10:40:44 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 14 10:40:44.176874 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 492/986] 10.222.0.16 () {58 vars in 1282 bytes} [Thu Jul 14 10:40:43 2022] GET /identity/v3/auth/tokens => generated 1560 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 14 10:40:44.178064 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea79e6c-9e76-460f-a5ca-55fcc744387f None None] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:44.197688 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5791b958-e955-4d05-8691-da0fce76186a None admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:44.224784 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=100 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:44.250269 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=100 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:44.291330 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea79e6c-9e76-460f-a5ca-55fcc744387f None None] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:44.305159 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5791b958-e955-4d05-8691-da0fce76186a None admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:44.331369 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac367c0-400f-4681-b466-23d071edf0c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:44.332433 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac367c0-400f-4681-b466-23d071edf0c6 None admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:44.332905 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac367c0-400f-4681-b466-23d071edf0c6 None admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:44.333198 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac367c0-400f-4681-b466-23d071edf0c6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:44.341579 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f47904-31a4-403b-ba11-b951b3a63cf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:44.342388 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f47904-31a4-403b-ba11-b951b3a63cf1 None admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:44.342730 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f47904-31a4-403b-ba11-b951b3a63cf1 None admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:44.343015 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f47904-31a4-403b-ba11-b951b3a63cf1 None admin] PATH_INFO: `/v3/services/compute` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:44.343672 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f47904-31a4-403b-ba11-b951b3a63cf1 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:44.344595 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac367c0-400f-4681-b466-23d071edf0c6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:44.345068 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f47904-31a4-403b-ba11-b951b3a63cf1 None admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:44.346076 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac367c0-400f-4681-b466-23d071edf0c6 None admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:44.357573 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application [None req-c2f47904-31a4-403b-ba11-b951b3a63cf1 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 14 10:40:44.357573 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:40:44.357573 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 14 10:40:44.357573 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 14 10:40:44.357573 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 14 10:40:44.357573 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 14 10:40:44.357573 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 14 10:40:44.357573 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 10:40:44.357573 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 14 10:40:44.357573 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application Jul 14 10:40:44.357573 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 10:40:44.357573 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application Jul 14 10:40:44.357573 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:40:44.357573 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:40:44.357573 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:40:44.357573 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:40:44.357573 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:40:44.358562 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:40:44.358562 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:40:44.358562 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:40:44.358562 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:40:44.358562 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:40:44.358562 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:40:44.358562 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 14 10:40:44.358562 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 14 10:40:44.358562 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 14 10:40:44.358562 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 14 10:40:44.358562 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:40:44.358562 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:40:44.358562 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:40:44.358562 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:40:44.358562 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:40:44.358562 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:40:44.359383 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:40:44.359383 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application with Lock( Jul 14 10:40:44.359383 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:40:44.359383 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:40:44.359383 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:40:44.359383 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:40:44.359383 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:40:44.359383 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:40:44.359383 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:40:44.359383 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:40:44.359383 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 14 10:40:44.359383 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 10:40:44.359383 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 14 10:40:44.359383 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application Jul 14 10:40:44.359383 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 493/987] 10.222.0.16 () {56 vars in 1111 bytes} [Thu Jul 14 10:40:44 2022] GET /identity/v3/services/compute => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 10:40:44.364411 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f47904-31a4-403b-ba11-b951b3a63cf1 None admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:44.366702 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application [None req-6ac367c0-400f-4681-b466-23d071edf0c6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 10:40:44.366702 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:40:44.366702 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:40:44.366702 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:40:44.366702 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:40:44.366702 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:40:44.366702 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:40:44.366702 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:40:44.366702 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:40:44.366702 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:40:44.366702 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:40:44.366702 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:40:44.366702 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 10:40:44.366702 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 10:40:44.366702 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 10:40:44.367568 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 10:40:44.367568 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:40:44.367568 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:40:44.367568 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:40:44.367568 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:40:44.367568 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:40:44.367568 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:40:44.367568 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:40:44.367568 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application with Lock( Jul 14 10:40:44.367568 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:40:44.367568 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:40:44.367568 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:40:44.367568 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:40:44.367568 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:40:44.367568 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:40:44.367568 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:40:44.367568 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:40:44.368456 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 10:40:44.368456 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 10:40:44.368456 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 10:40:44.368456 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application Jul 14 10:40:44.369386 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 495/988] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Jul 14 10:40:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:40:44.374777 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac367c0-400f-4681-b466-23d071edf0c6 None admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:44.471182 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f47904-31a4-403b-ba11-b951b3a63cf1 None admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:44.477351 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=100 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:44.486366 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac367c0-400f-4681-b466-23d071edf0c6 None admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:44.487890 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=100 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:44.511173 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18ab3b9-5e05-4189-9cd0-7f8ebe8adfdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:44.511785 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18ab3b9-5e05-4189-9cd0-7f8ebe8adfdf None admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:44.512024 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18ab3b9-5e05-4189-9cd0-7f8ebe8adfdf None admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:44.512303 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18ab3b9-5e05-4189-9cd0-7f8ebe8adfdf None admin] PATH_INFO: `/v3/services` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:44.513072 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18ab3b9-5e05-4189-9cd0-7f8ebe8adfdf None admin] RBAC: Adding query filter params (name=compute) {{(pid=86655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:40:44.513380 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18ab3b9-5e05-4189-9cd0-7f8ebe8adfdf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:44.514822 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18ab3b9-5e05-4189-9cd0-7f8ebe8adfdf None admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:44.519712 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 494/989] 10.222.0.16 () {56 vars in 1112 bytes} [Thu Jul 14 10:40:44 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 10:40:44.522558 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67902cef-e517-4116-8e8e-813a003af61d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:44.523226 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67902cef-e517-4116-8e8e-813a003af61d None admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:44.523507 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67902cef-e517-4116-8e8e-813a003af61d None admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:44.523780 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67902cef-e517-4116-8e8e-813a003af61d None admin] PATH_INFO: `/v3/domains` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:44.524504 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67902cef-e517-4116-8e8e-813a003af61d None admin] RBAC: Adding query filter params (name=Default) {{(pid=86656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:40:44.524832 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67902cef-e517-4116-8e8e-813a003af61d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:44.525125 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18ab3b9-5e05-4189-9cd0-7f8ebe8adfdf None admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:44.526187 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67902cef-e517-4116-8e8e-813a003af61d None admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:44.546368 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 496/990] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Jul 14 10:40:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 10:40:44.547624 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67902cef-e517-4116-8e8e-813a003af61d None admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:44.652493 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18ab3b9-5e05-4189-9cd0-7f8ebe8adfdf None admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:44.655961 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67902cef-e517-4116-8e8e-813a003af61d None admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:44.688986 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d54b3b-67e6-40a5-a93a-8778499365f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:44.689648 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d54b3b-67e6-40a5-a93a-8778499365f3 None admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:44.689931 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d54b3b-67e6-40a5-a93a-8778499365f3 None admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:44.690203 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d54b3b-67e6-40a5-a93a-8778499365f3 None admin] PATH_INFO: `/v3/services` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:44.690913 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d54b3b-67e6-40a5-a93a-8778499365f3 None admin] RBAC: Adding query filter params (type=compute) {{(pid=86655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:40:44.691249 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d54b3b-67e6-40a5-a93a-8778499365f3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:44.691350 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd7c9f5-e3de-4eca-aae4-59dcfa5c4480 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:44.692104 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd7c9f5-e3de-4eca-aae4-59dcfa5c4480 None admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:44.692387 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd7c9f5-e3de-4eca-aae4-59dcfa5c4480 None admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:44.692595 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d54b3b-67e6-40a5-a93a-8778499365f3 None admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:44.692692 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd7c9f5-e3de-4eca-aae4-59dcfa5c4480 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:44.697914 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 495/991] 10.222.0.16 () {56 vars in 1112 bytes} [Thu Jul 14 10:40:44 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 10:40:44.702603 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd7c9f5-e3de-4eca-aae4-59dcfa5c4480 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:44.704001 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d54b3b-67e6-40a5-a93a-8778499365f3 None admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:44.704149 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd7c9f5-e3de-4eca-aae4-59dcfa5c4480 None admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:44.719172 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application [None req-dbd7c9f5-e3de-4eca-aae4-59dcfa5c4480 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 10:40:44.719172 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:40:44.719172 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:40:44.719172 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:40:44.719172 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:40:44.719172 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:40:44.719172 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:40:44.719172 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:40:44.719172 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:40:44.719172 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:40:44.719172 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:40:44.719172 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:40:44.719172 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 10:40:44.719172 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 10:40:44.719172 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 10:40:44.720091 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 10:40:44.720091 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:40:44.720091 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:40:44.720091 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:40:44.720091 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:40:44.720091 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:40:44.720091 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:40:44.720091 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:40:44.720091 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application with Lock( Jul 14 10:40:44.720091 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:40:44.720091 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:40:44.720091 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:40:44.720091 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:40:44.720091 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:40:44.720091 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:40:44.720091 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:40:44.720091 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:40:44.721000 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 10:40:44.721000 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 10:40:44.721000 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 10:40:44.721000 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 10:40:44.721000 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 10:40:44.721000 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 10:40:44.721000 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 10:40:44.721000 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application Jul 14 10:40:44.721000 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 497/992] 10.222.0.16 () {56 vars in 1111 bytes} [Thu Jul 14 10:40:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:40:44.725833 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd7c9f5-e3de-4eca-aae4-59dcfa5c4480 None admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:44.741210 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=100 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:44.753615 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=100 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:44.822523 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d54b3b-67e6-40a5-a93a-8778499365f3 None admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:44.840404 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd7c9f5-e3de-4eca-aae4-59dcfa5c4480 None admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:44.859034 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a56541-ed64-48f8-9ac3-da8762038aec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:44.859696 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a56541-ed64-48f8-9ac3-da8762038aec None admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:44.859981 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a56541-ed64-48f8-9ac3-da8762038aec None admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:44.860541 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a56541-ed64-48f8-9ac3-da8762038aec None admin] PATH_INFO: `/v3/endpoints` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:44.861363 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a56541-ed64-48f8-9ac3-da8762038aec None admin] RBAC: Adding query filter params (interface=public, service_id=6ecad459ad0c4d1c9d7fc155f8be57dc, region_id=RegionOne) {{(pid=86655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:40:44.861675 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a56541-ed64-48f8-9ac3-da8762038aec None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:44.863041 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a56541-ed64-48f8-9ac3-da8762038aec None admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:44.868163 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 496/993] 10.222.0.16 () {56 vars in 1251 bytes} [Thu Jul 14 10:40:44 2022] GET /identity/v3/endpoints?service_id=6ecad459ad0c4d1c9d7fc155f8be57dc&interface=public®ion_id=RegionOne => generated 194 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 10:40:44.873502 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a56541-ed64-48f8-9ac3-da8762038aec None admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:44.885166 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84db2f85-2ff5-454f-b6c6-7d5049e98061 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:44.886400 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84db2f85-2ff5-454f-b6c6-7d5049e98061 None admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:44.887033 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84db2f85-2ff5-454f-b6c6-7d5049e98061 None admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:44.887553 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84db2f85-2ff5-454f-b6c6-7d5049e98061 None admin] PATH_INFO: `/v3/projects` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:44.889434 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84db2f85-2ff5-454f-b6c6-7d5049e98061 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:40:44.889895 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84db2f85-2ff5-454f-b6c6-7d5049e98061 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:44.892114 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84db2f85-2ff5-454f-b6c6-7d5049e98061 None admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:44.912828 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 498/994] 10.222.0.16 () {56 vars in 1148 bytes} [Thu Jul 14 10:40:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 10:40:44.914261 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84db2f85-2ff5-454f-b6c6-7d5049e98061 None admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:44.981624 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a56541-ed64-48f8-9ac3-da8762038aec None admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:44.988719 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=100 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:44.994203 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=100 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:45.018960 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90766496-c2e8-48b0-ad77-451dcd984b99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:45.019636 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90766496-c2e8-48b0-ad77-451dcd984b99 None admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:45.019924 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90766496-c2e8-48b0-ad77-451dcd984b99 None admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:45.020199 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90766496-c2e8-48b0-ad77-451dcd984b99 None admin] PATH_INFO: `/v3/services` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:45.020921 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90766496-c2e8-48b0-ad77-451dcd984b99 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:45.022312 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90766496-c2e8-48b0-ad77-451dcd984b99 None admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:45.029766 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 497/995] 10.222.0.16 () {56 vars in 1087 bytes} [Thu Jul 14 10:40:44 2022] GET /identity/v3/services => generated 1727 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 10:40:45.029999 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84db2f85-2ff5-454f-b6c6-7d5049e98061 None admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:45.068233 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d03a492-244e-4a53-ab62-70129e5e00a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:45.068937 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d03a492-244e-4a53-ab62-70129e5e00a6 None admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:45.069222 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d03a492-244e-4a53-ab62-70129e5e00a6 None admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:45.069498 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d03a492-244e-4a53-ab62-70129e5e00a6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:45.070347 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d03a492-244e-4a53-ab62-70129e5e00a6 None admin] RBAC: Adding query filter params (role.id=ced8748f90594f3b81cabd4051d44e91, scope.project.id=59391272ecbe48b0aa736cb43807be1d, user.id=0dfc7cd9c05e4f268d2ce316d531c4bd) {{(pid=86656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:40:45.070661 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d03a492-244e-4a53-ab62-70129e5e00a6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:45.072113 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d03a492-244e-4a53-ab62-70129e5e00a6 None admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:45.089075 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 499/996] 10.222.0.16 () {56 vars in 1374 bytes} [Thu Jul 14 10:40:44 2022] GET /identity/v3/role_assignments?user.id=0dfc7cd9c05e4f268d2ce316d531c4bd&scope.project.id=59391272ecbe48b0aa736cb43807be1d&role.id=ced8748f90594f3b81cabd4051d44e91 => generated 608 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 10:40:45.440066 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d20472f-1f8a-4f83-86b3-a4e488e86ae1 None None] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:45.440413 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d20472f-1f8a-4f83-86b3-a4e488e86ae1 None None] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:45.440542 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d20472f-1f8a-4f83-86b3-a4e488e86ae1 None None] PATH_INFO: `/` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:45.442090 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 498/997] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jul 14 10:40:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:40:45.447199 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3aa083b-643c-4e45-81f2-036caa422b31 None None] REQUEST_METHOD: `POST` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:45.447491 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3aa083b-643c-4e45-81f2-036caa422b31 None None] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:45.447771 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3aa083b-643c-4e45-81f2-036caa422b31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:45.465473 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.auth.core [None req-f3aa083b-643c-4e45-81f2-036caa422b31 None None] MFA Rules not processed for user `ae4bcdd8106d4bebbdcae96be33505bc`. Rule list: `[]` (Enabled: `True`). {{(pid=86656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:40:45.466955 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-f3aa083b-643c-4e45-81f2-036caa422b31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:40:45.538437 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 500/998] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jul 14 10:40:45 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 10:40:45.562573 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d20472f-1f8a-4f83-86b3-a4e488e86ae1 None None] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:45.666265 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d20472f-1f8a-4f83-86b3-a4e488e86ae1 None None] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:45.700919 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e21863-ba91-4e20-96c1-f8d10768d35c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:45.701730 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e21863-ba91-4e20-96c1-f8d10768d35c None admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:45.702017 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e21863-ba91-4e20-96c1-f8d10768d35c None admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:45.702295 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e21863-ba91-4e20-96c1-f8d10768d35c None admin] PATH_INFO: `/v3/services/object-store` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:45.702944 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e21863-ba91-4e20-96c1-f8d10768d35c None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:45.704307 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e21863-ba91-4e20-96c1-f8d10768d35c None admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:45.716433 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application [None req-44e21863-ba91-4e20-96c1-f8d10768d35c None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 14 10:40:45.716433 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:40:45.716433 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 14 10:40:45.716433 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 14 10:40:45.716433 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 14 10:40:45.716433 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 14 10:40:45.716433 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 14 10:40:45.716433 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 10:40:45.716433 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 14 10:40:45.716433 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application Jul 14 10:40:45.716433 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 10:40:45.716433 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application Jul 14 10:40:45.716433 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:40:45.716433 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:40:45.716433 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:40:45.716433 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:40:45.716433 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:40:45.717606 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:40:45.717606 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:40:45.717606 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:40:45.717606 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:40:45.717606 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:40:45.717606 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:40:45.717606 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 14 10:40:45.717606 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 14 10:40:45.717606 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 14 10:40:45.717606 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 14 10:40:45.717606 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:40:45.717606 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:40:45.717606 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:40:45.717606 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:40:45.717606 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:40:45.717606 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:40:45.723753 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:40:45.723753 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application with Lock( Jul 14 10:40:45.723753 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:40:45.723753 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:40:45.723753 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:40:45.723753 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:40:45.723753 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:40:45.723753 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:40:45.723753 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:40:45.723753 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:40:45.723753 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 14 10:40:45.723753 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 10:40:45.723753 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 14 10:40:45.723753 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application Jul 14 10:40:45.723753 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 499/999] 10.222.0.16 () {56 vars in 1126 bytes} [Thu Jul 14 10:40:45 2022] GET /identity/v3/services/object-store => generated 93 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 10:40:45.724539 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3aa083b-643c-4e45-81f2-036caa422b31 None None] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:45.799856 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=100 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:45.834253 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3aa083b-643c-4e45-81f2-036caa422b31 None None] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:45.869388 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee0bf8a-1cc0-4e10-afa3-6bbe7d09001d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:45.870106 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee0bf8a-1cc0-4e10-afa3-6bbe7d09001d None admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:45.870392 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee0bf8a-1cc0-4e10-afa3-6bbe7d09001d None admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:45.870671 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee0bf8a-1cc0-4e10-afa3-6bbe7d09001d None admin] PATH_INFO: `/v3/services` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:45.871427 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee0bf8a-1cc0-4e10-afa3-6bbe7d09001d None admin] RBAC: Adding query filter params (name=object-store) {{(pid=86656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:40:45.871742 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee0bf8a-1cc0-4e10-afa3-6bbe7d09001d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:45.873177 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee0bf8a-1cc0-4e10-afa3-6bbe7d09001d None admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:45.882815 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 501/1000] 10.222.0.16 () {56 vars in 1122 bytes} [Thu Jul 14 10:40:45 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 10:40:45.883613 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e21863-ba91-4e20-96c1-f8d10768d35c None admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:45.918156 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=100 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:45.985509 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e21863-ba91-4e20-96c1-f8d10768d35c None admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:46.018224 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068eb424-b710-4094-9864-e021261cbd4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:46.018894 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068eb424-b710-4094-9864-e021261cbd4b None admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:46.019183 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068eb424-b710-4094-9864-e021261cbd4b None admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:46.019462 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068eb424-b710-4094-9864-e021261cbd4b None admin] PATH_INFO: `/v3/services` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:46.020171 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068eb424-b710-4094-9864-e021261cbd4b None admin] RBAC: Adding query filter params (type=object-store) {{(pid=86655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:40:46.020481 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068eb424-b710-4094-9864-e021261cbd4b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:46.021869 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068eb424-b710-4094-9864-e021261cbd4b None admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:46.026877 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 500/1001] 10.222.0.16 () {56 vars in 1122 bytes} [Thu Jul 14 10:40:45 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 10:40:46.032936 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee0bf8a-1cc0-4e10-afa3-6bbe7d09001d None admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:46.133398 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee0bf8a-1cc0-4e10-afa3-6bbe7d09001d None admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:46.165511 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=100 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:46.172863 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd98a41e-8d02-4171-a788-a4d93bbf64a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:46.173544 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd98a41e-8d02-4171-a788-a4d93bbf64a8 None admin] REQUEST_METHOD: `POST` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:46.173828 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd98a41e-8d02-4171-a788-a4d93bbf64a8 None admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:46.174109 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd98a41e-8d02-4171-a788-a4d93bbf64a8 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:46.174870 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd98a41e-8d02-4171-a788-a4d93bbf64a8 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:46.176236 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd98a41e-8d02-4171-a788-a4d93bbf64a8 None admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:46.200819 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 502/1002] 10.222.0.16 () {60 vars in 1144 bytes} [Thu Jul 14 10:40:46 2022] POST /identity/v3/endpoints => generated 325 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:40:47.077502 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3899fdb0-2705-4599-b232-4f524653c7eb None None] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:47.078018 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3899fdb0-2705-4599-b232-4f524653c7eb None None] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:47.078096 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3899fdb0-2705-4599-b232-4f524653c7eb None None] PATH_INFO: `/` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:47.079579 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 501/1003] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jul 14 10:40:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:40:47.085025 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdab119-df06-48c0-844b-5a021b961c6b None None] REQUEST_METHOD: `POST` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:47.085319 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdab119-df06-48c0-844b-5a021b961c6b None None] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:47.085600 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdab119-df06-48c0-844b-5a021b961c6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:47.102008 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.auth.core [None req-dbdab119-df06-48c0-844b-5a021b961c6b None None] MFA Rules not processed for user `ae4bcdd8106d4bebbdcae96be33505bc`. Rule list: `[]` (Enabled: `True`). {{(pid=86656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:40:47.103189 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-dbdab119-df06-48c0-844b-5a021b961c6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:40:47.178146 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 503/1004] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jul 14 10:40:47 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 10:40:47.180942 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbbab7b-90f7-489f-8238-b4dfb0d67116 None None] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:47.181239 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbbab7b-90f7-489f-8238-b4dfb0d67116 None None] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:47.181521 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbbab7b-90f7-489f-8238-b4dfb0d67116 None None] PATH_INFO: `/` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:47.182980 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 502/1005] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jul 14 10:40:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:40:47.188434 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6b53e9-5b4a-49a8-8eaa-55f1daab0994 None None] REQUEST_METHOD: `POST` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:47.188728 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6b53e9-5b4a-49a8-8eaa-55f1daab0994 None None] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:47.189043 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6b53e9-5b4a-49a8-8eaa-55f1daab0994 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:47.202105 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbbab7b-90f7-489f-8238-b4dfb0d67116 None None] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:47.205342 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.auth.core [None req-6b6b53e9-5b4a-49a8-8eaa-55f1daab0994 None None] MFA Rules not processed for user `ae4bcdd8106d4bebbdcae96be33505bc`. Rule list: `[]` (Enabled: `True`). {{(pid=86656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:40:47.206511 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-6b6b53e9-5b4a-49a8-8eaa-55f1daab0994 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:40:47.281325 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 504/1006] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jul 14 10:40:47 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 10:40:47.304087 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6b53e9-5b4a-49a8-8eaa-55f1daab0994 None None] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:47.309410 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=100 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:47.314573 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbbab7b-90f7-489f-8238-b4dfb0d67116 None None] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:47.352092 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4898305d-695b-4b2c-9fe1-82760d160e0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:47.352847 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4898305d-695b-4b2c-9fe1-82760d160e0b None admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:47.353131 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4898305d-695b-4b2c-9fe1-82760d160e0b None admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:47.353413 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4898305d-695b-4b2c-9fe1-82760d160e0b None admin] PATH_INFO: `/v3/services/compute` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:47.354214 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4898305d-695b-4b2c-9fe1-82760d160e0b None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:47.355678 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4898305d-695b-4b2c-9fe1-82760d160e0b None admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:47.358058 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:47.370580 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application [None req-4898305d-695b-4b2c-9fe1-82760d160e0b None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 14 10:40:47.370580 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:40:47.370580 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 14 10:40:47.370580 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 14 10:40:47.370580 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 14 10:40:47.370580 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 14 10:40:47.370580 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 14 10:40:47.370580 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 10:40:47.370580 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 14 10:40:47.370580 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application Jul 14 10:40:47.370580 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 10:40:47.370580 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application Jul 14 10:40:47.370580 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:40:47.370580 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:40:47.370580 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:40:47.370580 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:40:47.370580 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:40:47.371617 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:40:47.371617 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:40:47.371617 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:40:47.371617 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:40:47.371617 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:40:47.371617 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:40:47.371617 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 14 10:40:47.371617 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 14 10:40:47.371617 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 14 10:40:47.371617 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 14 10:40:47.371617 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:40:47.371617 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:40:47.371617 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:40:47.371617 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:40:47.371617 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:40:47.371617 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:40:47.372504 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:40:47.372504 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application with Lock( Jul 14 10:40:47.372504 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:40:47.372504 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:40:47.372504 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:40:47.372504 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:40:47.372504 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:40:47.372504 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:40:47.372504 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:40:47.372504 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:40:47.372504 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 14 10:40:47.372504 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 10:40:47.372504 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 14 10:40:47.372504 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application Jul 14 10:40:47.372504 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 503/1007] 10.222.0.16 () {56 vars in 1111 bytes} [Thu Jul 14 10:40:47 2022] GET /identity/v3/services/compute => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 10:40:47.378592 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4898305d-695b-4b2c-9fe1-82760d160e0b None admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:47.417245 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6b53e9-5b4a-49a8-8eaa-55f1daab0994 None None] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:47.453787 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208a69ae-de51-4067-b75b-988847de160f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:47.454584 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208a69ae-de51-4067-b75b-988847de160f None admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:47.454874 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208a69ae-de51-4067-b75b-988847de160f None admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:47.455155 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208a69ae-de51-4067-b75b-988847de160f None admin] PATH_INFO: `/v3/services/image` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:47.455813 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208a69ae-de51-4067-b75b-988847de160f None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:47.457394 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208a69ae-de51-4067-b75b-988847de160f None admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:47.471084 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application [None req-208a69ae-de51-4067-b75b-988847de160f None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 14 10:40:47.471084 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:40:47.471084 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 14 10:40:47.471084 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 14 10:40:47.471084 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 14 10:40:47.471084 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 14 10:40:47.471084 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 14 10:40:47.471084 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 10:40:47.471084 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 14 10:40:47.471084 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application Jul 14 10:40:47.471084 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 10:40:47.471084 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application Jul 14 10:40:47.471084 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:40:47.471084 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:40:47.471084 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:40:47.471084 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:40:47.471084 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:40:47.472290 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:40:47.472290 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:40:47.472290 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:40:47.472290 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:40:47.472290 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:40:47.472290 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:40:47.472290 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 14 10:40:47.472290 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 14 10:40:47.472290 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 14 10:40:47.472290 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 14 10:40:47.472290 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:40:47.472290 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:40:47.472290 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:40:47.472290 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:40:47.472290 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:40:47.472290 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:40:47.473534 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:40:47.473534 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application with Lock( Jul 14 10:40:47.473534 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:40:47.473534 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:40:47.473534 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:40:47.473534 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:40:47.473534 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:40:47.473534 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:40:47.473534 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:40:47.473534 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:40:47.473534 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 14 10:40:47.473534 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 10:40:47.473534 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 14 10:40:47.473534 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application Jul 14 10:40:47.473534 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 505/1008] 10.222.0.16 () {56 vars in 1105 bytes} [Thu Jul 14 10:40:47 2022] GET /identity/v3/services/image => generated 86 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 10:40:47.478097 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208a69ae-de51-4067-b75b-988847de160f None admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:47.490444 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4898305d-695b-4b2c-9fe1-82760d160e0b None admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:47.528150 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491003d5-97fd-4676-9a7e-d3ef9626b341 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:47.529346 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491003d5-97fd-4676-9a7e-d3ef9626b341 None admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:47.529634 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491003d5-97fd-4676-9a7e-d3ef9626b341 None admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:47.529914 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491003d5-97fd-4676-9a7e-d3ef9626b341 None admin] PATH_INFO: `/v3/services` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:47.530623 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491003d5-97fd-4676-9a7e-d3ef9626b341 None admin] RBAC: Adding query filter params (name=compute) {{(pid=86655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:40:47.530936 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491003d5-97fd-4676-9a7e-d3ef9626b341 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:47.532306 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491003d5-97fd-4676-9a7e-d3ef9626b341 None admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:47.537125 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 504/1009] 10.222.0.16 () {56 vars in 1112 bytes} [Thu Jul 14 10:40:47 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 10:40:47.542606 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491003d5-97fd-4676-9a7e-d3ef9626b341 None admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:47.570845 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=100 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:47.589914 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208a69ae-de51-4067-b75b-988847de160f None admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:47.604731 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=100 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:47.628191 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f603cd-9a24-4974-9e62-ad7d1cce2af6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:47.628889 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f603cd-9a24-4974-9e62-ad7d1cce2af6 None admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:47.629296 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f603cd-9a24-4974-9e62-ad7d1cce2af6 None admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:47.629584 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f603cd-9a24-4974-9e62-ad7d1cce2af6 None admin] PATH_INFO: `/v3/services` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:47.630411 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f603cd-9a24-4974-9e62-ad7d1cce2af6 None admin] RBAC: Adding query filter params (name=image) {{(pid=86656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:40:47.630727 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f603cd-9a24-4974-9e62-ad7d1cce2af6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:47.632105 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f603cd-9a24-4974-9e62-ad7d1cce2af6 None admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:47.642216 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 506/1010] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Jul 14 10:40:47 2022] GET /identity/v3/services?name=image => generated 122 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:40:47.643380 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f603cd-9a24-4974-9e62-ad7d1cce2af6 None admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:47.653757 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491003d5-97fd-4676-9a7e-d3ef9626b341 None admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:47.692794 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0358c01-5dc4-47bd-8aaa-95b2ed5e38c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:47.693486 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0358c01-5dc4-47bd-8aaa-95b2ed5e38c3 None admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:47.694132 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0358c01-5dc4-47bd-8aaa-95b2ed5e38c3 None admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:47.694421 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0358c01-5dc4-47bd-8aaa-95b2ed5e38c3 None admin] PATH_INFO: `/v3/services` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:47.695452 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0358c01-5dc4-47bd-8aaa-95b2ed5e38c3 None admin] RBAC: Adding query filter params (type=compute) {{(pid=86655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:40:47.695768 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0358c01-5dc4-47bd-8aaa-95b2ed5e38c3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:47.697322 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0358c01-5dc4-47bd-8aaa-95b2ed5e38c3 None admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:47.702413 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 505/1011] 10.222.0.16 () {56 vars in 1112 bytes} [Thu Jul 14 10:40:47 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 10:40:47.707923 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0358c01-5dc4-47bd-8aaa-95b2ed5e38c3 None admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:47.756583 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f603cd-9a24-4974-9e62-ad7d1cce2af6 None admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:47.800997 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cff996d-48bf-49c5-bfe6-e9e3da30424d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:47.801694 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cff996d-48bf-49c5-bfe6-e9e3da30424d None admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:47.801983 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cff996d-48bf-49c5-bfe6-e9e3da30424d None admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:47.802260 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cff996d-48bf-49c5-bfe6-e9e3da30424d None admin] PATH_INFO: `/v3/services` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:47.802974 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cff996d-48bf-49c5-bfe6-e9e3da30424d None admin] RBAC: Adding query filter params (type=image) {{(pid=86656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:40:47.803284 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cff996d-48bf-49c5-bfe6-e9e3da30424d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:47.804648 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cff996d-48bf-49c5-bfe6-e9e3da30424d None admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:47.809734 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 507/1012] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Jul 14 10:40:47 2022] GET /identity/v3/services?type=image => generated 122 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 10:40:47.816591 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=100 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:47.829961 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0358c01-5dc4-47bd-8aaa-95b2ed5e38c3 None admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:47.868976 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44d7f09-afc4-471e-b688-c4e417bd885b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:47.869613 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44d7f09-afc4-471e-b688-c4e417bd885b None admin] REQUEST_METHOD: `POST` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:47.869897 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44d7f09-afc4-471e-b688-c4e417bd885b None admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:47.870171 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44d7f09-afc4-471e-b688-c4e417bd885b None admin] PATH_INFO: `/v3/endpoints` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:47.870930 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44d7f09-afc4-471e-b688-c4e417bd885b None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:47.872975 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44d7f09-afc4-471e-b688-c4e417bd885b None admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:47.904823 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 506/1013] 10.222.0.16 () {60 vars in 1144 bytes} [Thu Jul 14 10:40:47 2022] POST /identity/v3/endpoints => generated 334 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:40:48.236731 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65967fd-fb34-4b08-952b-5d795bb80e2a None None] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:48.237257 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65967fd-fb34-4b08-952b-5d795bb80e2a None None] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:48.237257 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65967fd-fb34-4b08-952b-5d795bb80e2a None None] PATH_INFO: `/` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:48.238745 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 508/1014] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jul 14 10:40:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 14 10:40:48.244597 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf295b9-e38f-4c24-8345-0470989b3528 None None] REQUEST_METHOD: `POST` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:48.245083 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf295b9-e38f-4c24-8345-0470989b3528 None None] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:48.245260 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf295b9-e38f-4c24-8345-0470989b3528 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:48.262260 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.auth.core [None req-6bf295b9-e38f-4c24-8345-0470989b3528 None None] MFA Rules not processed for user `ae4bcdd8106d4bebbdcae96be33505bc`. Rule list: `[]` (Enabled: `True`). {{(pid=86655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:40:48.263659 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-6bf295b9-e38f-4c24-8345-0470989b3528 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:40:48.341269 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 507/1015] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jul 14 10:40:48 2022] POST /identity/v3/auth/tokens => generated 1863 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 10:40:48.360733 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65967fd-fb34-4b08-952b-5d795bb80e2a None None] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:48.404691 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=100 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:48.469032 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65967fd-fb34-4b08-952b-5d795bb80e2a None None] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:48.505353 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde8ede2-4fa4-4fb9-b033-c7e2912aec6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:48.506067 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde8ede2-4fa4-4fb9-b033-c7e2912aec6d None admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:48.506354 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde8ede2-4fa4-4fb9-b033-c7e2912aec6d None admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:48.506632 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde8ede2-4fa4-4fb9-b033-c7e2912aec6d None admin] PATH_INFO: `/v3/domains/default` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:48.507814 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde8ede2-4fa4-4fb9-b033-c7e2912aec6d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:48.509277 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde8ede2-4fa4-4fb9-b033-c7e2912aec6d None admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:48.515649 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 509/1016] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Jul 14 10:40:48 2022] GET /identity/v3/domains/default => generated 199 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:40:48.517225 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf295b9-e38f-4c24-8345-0470989b3528 None None] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:48.591595 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:48.623898 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf295b9-e38f-4c24-8345-0470989b3528 None None] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:48.657093 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db2e767-ab8b-4dc7-a4f2-89bfd14818a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:48.657764 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db2e767-ab8b-4dc7-a4f2-89bfd14818a9 None admin] REQUEST_METHOD: `POST` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:48.658054 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db2e767-ab8b-4dc7-a4f2-89bfd14818a9 None admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:48.658332 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db2e767-ab8b-4dc7-a4f2-89bfd14818a9 None admin] PATH_INFO: `/v3/projects` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:48.659044 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db2e767-ab8b-4dc7-a4f2-89bfd14818a9 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:48.660464 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db2e767-ab8b-4dc7-a4f2-89bfd14818a9 None admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:48.686519 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 508/1017] 10.222.0.16 () {60 vars in 1141 bytes} [Thu Jul 14 10:40:48 2022] POST /identity/v3/projects => generated 311 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:40:49.851015 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84b3da2-4ef5-4c5d-b247-fb26bd3fc968 None None] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:49.851525 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84b3da2-4ef5-4c5d-b247-fb26bd3fc968 None None] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:49.851601 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84b3da2-4ef5-4c5d-b247-fb26bd3fc968 None None] PATH_INFO: `/` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:49.853149 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 510/1018] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jul 14 10:40:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:40:49.858661 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c904a7b-8c49-494a-95f2-1da3f5a724ce None None] REQUEST_METHOD: `POST` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:49.859046 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c904a7b-8c49-494a-95f2-1da3f5a724ce None None] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:49.859235 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c904a7b-8c49-494a-95f2-1da3f5a724ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:49.876478 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.auth.core [None req-4c904a7b-8c49-494a-95f2-1da3f5a724ce None None] MFA Rules not processed for user `ae4bcdd8106d4bebbdcae96be33505bc`. Rule list: `[]` (Enabled: `True`). {{(pid=86655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:40:49.877708 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-4c904a7b-8c49-494a-95f2-1da3f5a724ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:40:49.945721 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 509/1019] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jul 14 10:40:49 2022] POST /identity/v3/auth/tokens => generated 1863 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 10:40:49.968023 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84b3da2-4ef5-4c5d-b247-fb26bd3fc968 None None] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:50.054305 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ea722e-511a-495b-9303-8b0932364ba2 None None] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:50.054623 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ea722e-511a-495b-9303-8b0932364ba2 None None] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:50.054881 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ea722e-511a-495b-9303-8b0932364ba2 None None] PATH_INFO: `/` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:50.056479 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 510/1020] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jul 14 10:40:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:40:50.061561 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0594bd37-9540-42f8-a8de-2c05a25b5616 None None] REQUEST_METHOD: `POST` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:50.061855 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0594bd37-9540-42f8-a8de-2c05a25b5616 None None] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:50.062132 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0594bd37-9540-42f8-a8de-2c05a25b5616 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:50.072178 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84b3da2-4ef5-4c5d-b247-fb26bd3fc968 None None] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:50.078427 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.auth.core [None req-0594bd37-9540-42f8-a8de-2c05a25b5616 None None] MFA Rules not processed for user `ae4bcdd8106d4bebbdcae96be33505bc`. Rule list: `[]` (Enabled: `True`). {{(pid=86655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:40:50.079618 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-0594bd37-9540-42f8-a8de-2c05a25b5616 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:40:50.082011 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=100 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:50.110311 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d852161-2122-4ff3-b6fd-c99e73fa9a4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:50.110979 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d852161-2122-4ff3-b6fd-c99e73fa9a4b None admin] REQUEST_METHOD: `POST` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:50.111268 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d852161-2122-4ff3-b6fd-c99e73fa9a4b None admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:50.111547 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d852161-2122-4ff3-b6fd-c99e73fa9a4b None admin] PATH_INFO: `/v3/services` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:50.112330 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d852161-2122-4ff3-b6fd-c99e73fa9a4b None admin] RBAC: Authorizing `identity:create_service()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:50.113725 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d852161-2122-4ff3-b6fd-c99e73fa9a4b None admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:50.136818 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 511/1021] 10.222.0.16 () {60 vars in 1141 bytes} [Thu Jul 14 10:40:49 2022] POST /identity/v3/services => generated 242 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:40:50.142161 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:50.177008 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 511/1022] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jul 14 10:40:50 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 14 10:40:50.203811 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d852161-2122-4ff3-b6fd-c99e73fa9a4b None admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:50.317485 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d852161-2122-4ff3-b6fd-c99e73fa9a4b None admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:50.354166 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04030ba7-32e2-47ae-a8e9-96c604e9601c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:50.354984 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04030ba7-32e2-47ae-a8e9-96c604e9601c None admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:50.355269 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04030ba7-32e2-47ae-a8e9-96c604e9601c None admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:50.355543 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04030ba7-32e2-47ae-a8e9-96c604e9601c None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:50.365859 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04030ba7-32e2-47ae-a8e9-96c604e9601c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 10:40:50.374757 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application [None req-04030ba7-32e2-47ae-a8e9-96c604e9601c None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 14 10:40:50.374757 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:40:50.374757 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:40:50.374757 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:40:50.374757 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:40:50.374757 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:40:50.374757 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:40:50.374757 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:40:50.374757 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:40:50.374757 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:40:50.374757 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:40:50.374757 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:40:50.374757 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 10:40:50.374757 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 10:40:50.374757 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 10:40:50.374757 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 10:40:50.375841 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 10:40:50.375841 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 10:40:50.375841 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 10:40:50.375841 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 10:40:50.375841 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:40:50.375841 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:40:50.375841 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:40:50.375841 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:40:50.375841 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:40:50.375841 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:40:50.375841 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:40:50.375841 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application with Lock( Jul 14 10:40:50.375841 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:40:50.375841 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:40:50.375841 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:40:50.375841 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:40:50.376681 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:40:50.376681 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:40:50.376681 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:40:50.376681 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:40:50.376681 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 10:40:50.376681 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 10:40:50.376681 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 10:40:50.376681 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 10:40:50.376681 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 10:40:50.376681 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 10:40:50.376681 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 14 10:40:50.376681 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application Jul 14 10:40:50.376681 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 512/1023] 10.222.0.16 () {56 vars in 1120 bytes} [Thu Jul 14 10:40:50 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:40:50.382086 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0594bd37-9540-42f8-a8de-2c05a25b5616 None None] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:50.489938 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0594bd37-9540-42f8-a8de-2c05a25b5616 None None] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:50.526215 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52d225b-ee4a-4d4e-b8bd-c29028e3f17c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:50.526892 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52d225b-ee4a-4d4e-b8bd-c29028e3f17c None admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:50.527173 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52d225b-ee4a-4d4e-b8bd-c29028e3f17c None admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:50.527448 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52d225b-ee4a-4d4e-b8bd-c29028e3f17c None admin] PATH_INFO: `/v3/roles` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:50.528346 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52d225b-ee4a-4d4e-b8bd-c29028e3f17c None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=86655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:40:50.528694 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52d225b-ee4a-4d4e-b8bd-c29028e3f17c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:50.530094 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52d225b-ee4a-4d4e-b8bd-c29028e3f17c None admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:50.543992 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 512/1024] 10.222.0.16 () {56 vars in 1115 bytes} [Thu Jul 14 10:40:50 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:40:50.545954 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04030ba7-32e2-47ae-a8e9-96c604e9601c None admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:50.577523 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:50.654946 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04030ba7-32e2-47ae-a8e9-96c604e9601c None admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:50.690978 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e2c829-a909-4f4f-be8e-1f8fb0245c05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:50.691772 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e2c829-a909-4f4f-be8e-1f8fb0245c05 None admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:50.692059 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e2c829-a909-4f4f-be8e-1f8fb0245c05 None admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:50.692334 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e2c829-a909-4f4f-be8e-1f8fb0245c05 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:50.703320 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e2c829-a909-4f4f-be8e-1f8fb0245c05 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:50.704804 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e2c829-a909-4f4f-be8e-1f8fb0245c05 None admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:50.722569 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application [None req-b1e2c829-a909-4f4f-be8e-1f8fb0245c05 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 10:40:50.722569 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:40:50.722569 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:40:50.722569 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:40:50.722569 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:40:50.722569 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:40:50.722569 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:40:50.722569 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:40:50.722569 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:40:50.722569 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:40:50.722569 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:40:50.722569 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:40:50.722569 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 10:40:50.722569 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 10:40:50.722569 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 10:40:50.723496 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 10:40:50.723496 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:40:50.723496 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:40:50.723496 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:40:50.723496 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:40:50.723496 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:40:50.723496 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:40:50.723496 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:40:50.723496 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application with Lock( Jul 14 10:40:50.723496 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:40:50.723496 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:40:50.723496 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:40:50.723496 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:40:50.723496 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:40:50.723496 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:40:50.723496 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:40:50.723496 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:40:50.724409 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 10:40:50.724409 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 10:40:50.724409 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 10:40:50.724409 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application Jul 14 10:40:50.725212 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 513/1025] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Jul 14 10:40:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 10:40:50.729459 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52d225b-ee4a-4d4e-b8bd-c29028e3f17c None admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:50.757281 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f280e68e-0b56-47a9-a6c8-285f0e895d29 None None] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:50.758195 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f280e68e-0b56-47a9-a6c8-285f0e895d29 None None] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:50.758538 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f280e68e-0b56-47a9-a6c8-285f0e895d29 None None] PATH_INFO: `/` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:50.760084 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 514/1026] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jul 14 10:40:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 14 10:40:50.765128 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a80ad8-33b8-4dbf-a856-273cecb5aa4e None None] REQUEST_METHOD: `POST` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:50.765433 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a80ad8-33b8-4dbf-a856-273cecb5aa4e None None] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:50.765707 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a80ad8-33b8-4dbf-a856-273cecb5aa4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:50.782331 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.auth.core [None req-92a80ad8-33b8-4dbf-a856-273cecb5aa4e None None] MFA Rules not processed for user `ae4bcdd8106d4bebbdcae96be33505bc`. Rule list: `[]` (Enabled: `True`). {{(pid=86656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:40:50.783512 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-92a80ad8-33b8-4dbf-a856-273cecb5aa4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:40:50.785249 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=100 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:50.847674 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52d225b-ee4a-4d4e-b8bd-c29028e3f17c None admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:50.858876 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 515/1027] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jul 14 10:40:50 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 14 10:40:50.884495 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a80ad8-33b8-4dbf-a856-273cecb5aa4e None None] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:50.884944 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cb00bd-ce1e-42ba-9893-a6a18e66e102 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:50.886150 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cb00bd-ce1e-42ba-9893-a6a18e66e102 None admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:50.886843 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cb00bd-ce1e-42ba-9893-a6a18e66e102 None admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:50.887266 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cb00bd-ce1e-42ba-9893-a6a18e66e102 None admin] PATH_INFO: `/v3/domains` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:50.888231 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8cb00bd-ce1e-42ba-9893-a6a18e66e102 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:40:50.888701 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8cb00bd-ce1e-42ba-9893-a6a18e66e102 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:50.890291 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8cb00bd-ce1e-42ba-9893-a6a18e66e102 None admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:50.896286 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=100 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:50.909740 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 513/1028] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Jul 14 10:40:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 10:40:50.911175 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cb00bd-ce1e-42ba-9893-a6a18e66e102 None admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:50.993749 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a80ad8-33b8-4dbf-a856-273cecb5aa4e None None] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:51.023136 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cb00bd-ce1e-42ba-9893-a6a18e66e102 None admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:51.024945 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=100 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:51.028645 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b5c3fb-d702-45ff-bc59-983de57bf7c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:51.029475 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b5c3fb-d702-45ff-bc59-983de57bf7c5 None admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:51.029761 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b5c3fb-d702-45ff-bc59-983de57bf7c5 None admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:51.030037 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b5c3fb-d702-45ff-bc59-983de57bf7c5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:51.031223 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b5c3fb-d702-45ff-bc59-983de57bf7c5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:51.032711 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b5c3fb-d702-45ff-bc59-983de57bf7c5 None admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:51.034373 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 516/1029] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Jul 14 10:40:50 2022] GET /identity/v3/domains/default => generated 199 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 10:40:51.039734 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b5c3fb-d702-45ff-bc59-983de57bf7c5 None admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:51.065284 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8c6ef4-b113-4a6c-8a14-c548b63c0976 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:51.066077 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8c6ef4-b113-4a6c-8a14-c548b63c0976 None admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:51.066364 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8c6ef4-b113-4a6c-8a14-c548b63c0976 None admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:51.066642 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8c6ef4-b113-4a6c-8a14-c548b63c0976 None admin] PATH_INFO: `/v3/users/nova` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:51.074278 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8c6ef4-b113-4a6c-8a14-c548b63c0976 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:51.075828 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8c6ef4-b113-4a6c-8a14-c548b63c0976 None admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:51.091864 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application [None req-1f8c6ef4-b113-4a6c-8a14-c548b63c0976 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 14 10:40:51.091864 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:40:51.091864 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:40:51.091864 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:40:51.091864 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:40:51.091864 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:40:51.091864 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:40:51.091864 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:40:51.091864 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:40:51.091864 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:40:51.091864 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:40:51.091864 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:40:51.091864 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 10:40:51.091864 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 10:40:51.091864 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 10:40:51.091864 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 10:40:51.093104 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:40:51.093104 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:40:51.093104 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 10:40:51.093104 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 10:40:51.093104 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 10:40:51.093104 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 10:40:51.093104 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:40:51.093104 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:40:51.093104 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:40:51.093104 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:40:51.093104 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:40:51.093104 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application with Lock( Jul 14 10:40:51.093104 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:40:51.093104 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:40:51.093104 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:40:51.093104 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:40:51.093104 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:40:51.093104 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:40:51.094063 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:40:51.094063 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:40:51.094063 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 10:40:51.094063 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 10:40:51.094063 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 10:40:51.094063 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 10:40:51.094063 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 10:40:51.094063 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 10:40:51.094063 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 14 10:40:51.094063 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application Jul 14 10:40:51.094063 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 514/1030] 10.222.0.16 () {56 vars in 1093 bytes} [Thu Jul 14 10:40:50 2022] GET /identity/v3/users/nova => generated 82 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:40:51.098870 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8c6ef4-b113-4a6c-8a14-c548b63c0976 None admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:51.119642 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=100 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:51.143084 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b5c3fb-d702-45ff-bc59-983de57bf7c5 None admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:51.178293 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767ae667-8332-4533-a370-99fe642154d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:51.178970 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767ae667-8332-4533-a370-99fe642154d8 None admin] REQUEST_METHOD: `POST` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:51.179257 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767ae667-8332-4533-a370-99fe642154d8 None admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:51.179536 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767ae667-8332-4533-a370-99fe642154d8 None admin] PATH_INFO: `/v3/users` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:51.180259 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767ae667-8332-4533-a370-99fe642154d8 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:51.181728 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767ae667-8332-4533-a370-99fe642154d8 None admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:51.202901 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 517/1031] 10.222.0.16 () {60 vars in 1132 bytes} [Thu Jul 14 10:40:51 2022] POST /identity/v3/users => generated 285 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 10:40:51.204125 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8c6ef4-b113-4a6c-8a14-c548b63c0976 None admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:51.253067 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcf07aa-db73-4f40-9f84-7610d6181834 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:51.253769 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcf07aa-db73-4f40-9f84-7610d6181834 None admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:51.254051 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcf07aa-db73-4f40-9f84-7610d6181834 None admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:51.254384 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcf07aa-db73-4f40-9f84-7610d6181834 None admin] PATH_INFO: `/v3/users` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:51.255197 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dcf07aa-db73-4f40-9f84-7610d6181834 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:40:51.255509 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dcf07aa-db73-4f40-9f84-7610d6181834 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:51.257024 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dcf07aa-db73-4f40-9f84-7610d6181834 None admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:51.286866 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 515/1032] 10.222.0.16 () {56 vars in 1133 bytes} [Thu Jul 14 10:40:51 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 10:40:51.288693 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767ae667-8332-4533-a370-99fe642154d8 None admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:51.400683 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767ae667-8332-4533-a370-99fe642154d8 None admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:51.438723 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4037f75-59d9-4895-8c09-5535864896c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:51.439650 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4037f75-59d9-4895-8c09-5535864896c0 None admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:51.439935 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4037f75-59d9-4895-8c09-5535864896c0 None admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:51.440208 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4037f75-59d9-4895-8c09-5535864896c0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:51.443795 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:51.514063 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4037f75-59d9-4895-8c09-5535864896c0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:51.515523 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4037f75-59d9-4895-8c09-5535864896c0 None admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:51.621467 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 518/1033] 10.222.0.16 () {58 vars in 1282 bytes} [Thu Jul 14 10:40:51 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 14 10:40:51.623707 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcf07aa-db73-4f40-9f84-7610d6181834 None admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:51.647242 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=100 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:51.728045 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcf07aa-db73-4f40-9f84-7610d6181834 None admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:51.764412 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274cd921-d9c0-4f47-affe-b3ca80342f8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:51.765251 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274cd921-d9c0-4f47-affe-b3ca80342f8b None admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:51.765536 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274cd921-d9c0-4f47-affe-b3ca80342f8b None admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:51.765811 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274cd921-d9c0-4f47-affe-b3ca80342f8b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:51.775956 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274cd921-d9c0-4f47-affe-b3ca80342f8b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:51.779875 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274cd921-d9c0-4f47-affe-b3ca80342f8b None admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:51.799812 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application [None req-274cd921-d9c0-4f47-affe-b3ca80342f8b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 10:40:51.799812 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:40:51.799812 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:40:51.799812 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:40:51.799812 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:40:51.799812 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:40:51.799812 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:40:51.799812 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:40:51.799812 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:40:51.799812 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:40:51.799812 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:40:51.799812 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:40:51.799812 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 10:40:51.799812 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 10:40:51.799812 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 10:40:51.800741 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 10:40:51.800741 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:40:51.800741 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:40:51.800741 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:40:51.800741 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:40:51.800741 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:40:51.800741 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:40:51.800741 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:40:51.800741 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application with Lock( Jul 14 10:40:51.800741 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:40:51.800741 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:40:51.800741 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:40:51.800741 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:40:51.800741 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:40:51.800741 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:40:51.800741 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:40:51.800741 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:40:51.801672 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 10:40:51.801672 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 10:40:51.801672 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 10:40:51.801672 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application Jul 14 10:40:51.807020 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 516/1034] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Jul 14 10:40:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:40:51.808494 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4037f75-59d9-4895-8c09-5535864896c0 None admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:51.845097 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=100 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:51.915387 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4037f75-59d9-4895-8c09-5535864896c0 None admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:51.950558 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c166b560-1a2c-4f5d-b80b-e1ed9704d5b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:51.951262 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c166b560-1a2c-4f5d-b80b-e1ed9704d5b2 None admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:51.951551 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c166b560-1a2c-4f5d-b80b-e1ed9704d5b2 None admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:51.951830 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c166b560-1a2c-4f5d-b80b-e1ed9704d5b2 None admin] PATH_INFO: `/v3/domains` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:51.952554 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c166b560-1a2c-4f5d-b80b-e1ed9704d5b2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:40:51.952893 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c166b560-1a2c-4f5d-b80b-e1ed9704d5b2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:51.954270 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c166b560-1a2c-4f5d-b80b-e1ed9704d5b2 None admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:51.970790 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 519/1035] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Jul 14 10:40:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:40:51.972385 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274cd921-d9c0-4f47-affe-b3ca80342f8b None admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:52.044584 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=100 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:52.074618 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274cd921-d9c0-4f47-affe-b3ca80342f8b None admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:52.108451 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfbb4b5-0b6d-4fa1-b356-31926cbceeb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:52.109275 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfbb4b5-0b6d-4fa1-b356-31926cbceeb8 None admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:52.109563 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfbb4b5-0b6d-4fa1-b356-31926cbceeb8 None admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:52.109842 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfbb4b5-0b6d-4fa1-b356-31926cbceeb8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:52.116447 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dfbb4b5-0b6d-4fa1-b356-31926cbceeb8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:52.117935 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dfbb4b5-0b6d-4fa1-b356-31926cbceeb8 None admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:52.132223 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application [None req-6dfbb4b5-0b6d-4fa1-b356-31926cbceeb8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 10:40:52.132223 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:40:52.132223 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:40:52.132223 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:40:52.132223 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:40:52.132223 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:40:52.132223 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:40:52.132223 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:40:52.132223 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:40:52.132223 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:40:52.132223 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:40:52.132223 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:40:52.132223 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 10:40:52.132223 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 10:40:52.132223 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 10:40:52.133338 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 10:40:52.133338 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:40:52.133338 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:40:52.133338 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:40:52.133338 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:40:52.133338 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:40:52.133338 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:40:52.133338 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:40:52.133338 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application with Lock( Jul 14 10:40:52.133338 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:40:52.133338 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:40:52.133338 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:40:52.133338 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:40:52.133338 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:40:52.133338 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:40:52.133338 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:40:52.133338 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:40:52.139444 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 10:40:52.139444 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 10:40:52.139444 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 10:40:52.139444 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 10:40:52.139444 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 10:40:52.139444 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 10:40:52.139444 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 10:40:52.139444 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application Jul 14 10:40:52.139444 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 517/1036] 10.222.0.16 () {56 vars in 1111 bytes} [Thu Jul 14 10:40:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:40:52.141636 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c166b560-1a2c-4f5d-b80b-e1ed9704d5b2 None admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:52.215032 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d108e7-8065-44ad-afb1-c77ba1bfda0b None None] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:52.215329 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d108e7-8065-44ad-afb1-c77ba1bfda0b None None] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:52.215680 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d108e7-8065-44ad-afb1-c77ba1bfda0b None None] PATH_INFO: `/` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:52.217696 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 518/1037] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jul 14 10:40:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:40:52.222804 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba78d01e-e11f-449e-b18e-1bb93a621e50 None None] REQUEST_METHOD: `POST` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:52.223094 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba78d01e-e11f-449e-b18e-1bb93a621e50 None None] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:52.223374 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba78d01e-e11f-449e-b18e-1bb93a621e50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:52.240484 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.auth.core [None req-ba78d01e-e11f-449e-b18e-1bb93a621e50 None None] MFA Rules not processed for user `ae4bcdd8106d4bebbdcae96be33505bc`. Rule list: `[]` (Enabled: `True`). {{(pid=86655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:40:52.241487 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=100 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:52.241697 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-ba78d01e-e11f-449e-b18e-1bb93a621e50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:40:52.249637 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c166b560-1a2c-4f5d-b80b-e1ed9704d5b2 None admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:52.285126 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e7a0f2-ba2a-4870-beb9-06cfcb9104de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:52.286473 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e7a0f2-ba2a-4870-beb9-06cfcb9104de None admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:52.286473 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e7a0f2-ba2a-4870-beb9-06cfcb9104de None admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:52.286473 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e7a0f2-ba2a-4870-beb9-06cfcb9104de None admin] PATH_INFO: `/v3/projects` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:52.287133 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e7a0f2-ba2a-4870-beb9-06cfcb9104de None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:40:52.287446 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e7a0f2-ba2a-4870-beb9-06cfcb9104de None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:52.288994 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e7a0f2-ba2a-4870-beb9-06cfcb9104de None admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:52.302196 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 520/1038] 10.222.0.16 () {56 vars in 1148 bytes} [Thu Jul 14 10:40:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 10:40:52.307871 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e7a0f2-ba2a-4870-beb9-06cfcb9104de None admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:52.320168 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 519/1039] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jul 14 10:40:52 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 10:40:52.345851 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba78d01e-e11f-449e-b18e-1bb93a621e50 None None] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:52.413484 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=100 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:52.424218 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e7a0f2-ba2a-4870-beb9-06cfcb9104de None admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:52.455208 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba78d01e-e11f-449e-b18e-1bb93a621e50 None None] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:52.462952 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8ef3ec-9943-47ed-a2e3-1be67ddaf329 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:52.463698 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8ef3ec-9943-47ed-a2e3-1be67ddaf329 None admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:52.463988 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8ef3ec-9943-47ed-a2e3-1be67ddaf329 None admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:52.464389 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8ef3ec-9943-47ed-a2e3-1be67ddaf329 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:52.465252 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8ef3ec-9943-47ed-a2e3-1be67ddaf329 None admin] RBAC: Adding query filter params (role.id=ced8748f90594f3b81cabd4051d44e91, scope.project.id=59391272ecbe48b0aa736cb43807be1d, user.id=26aa294c913c408499a913ec25bb677d) {{(pid=86656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:40:52.465656 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8ef3ec-9943-47ed-a2e3-1be67ddaf329 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:52.467285 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8ef3ec-9943-47ed-a2e3-1be67ddaf329 None admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:52.484800 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 521/1040] 10.222.0.16 () {56 vars in 1374 bytes} [Thu Jul 14 10:40:52 2022] GET /identity/v3/role_assignments?user.id=26aa294c913c408499a913ec25bb677d&scope.project.id=59391272ecbe48b0aa736cb43807be1d&role.id=ced8748f90594f3b81cabd4051d44e91 => generated 259 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 10:40:52.504232 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d92e63f-c5c5-4181-9d1c-fab4a6f0a5c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:52.505138 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d92e63f-c5c5-4181-9d1c-fab4a6f0a5c7 None admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:52.505430 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d92e63f-c5c5-4181-9d1c-fab4a6f0a5c7 None admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:52.505711 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d92e63f-c5c5-4181-9d1c-fab4a6f0a5c7 None admin] PATH_INFO: `/v3/services/image` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:52.506390 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d92e63f-c5c5-4181-9d1c-fab4a6f0a5c7 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:52.507803 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d92e63f-c5c5-4181-9d1c-fab4a6f0a5c7 None admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:52.521902 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application [None req-7d92e63f-c5c5-4181-9d1c-fab4a6f0a5c7 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 14 10:40:52.521902 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:40:52.521902 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 14 10:40:52.521902 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 14 10:40:52.521902 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 14 10:40:52.521902 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 14 10:40:52.521902 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 14 10:40:52.521902 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 10:40:52.521902 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 14 10:40:52.521902 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application Jul 14 10:40:52.521902 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 10:40:52.521902 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application Jul 14 10:40:52.521902 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:40:52.521902 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:40:52.521902 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:40:52.521902 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:40:52.521902 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:40:52.522995 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:40:52.522995 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:40:52.522995 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:40:52.522995 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:40:52.522995 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:40:52.522995 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:40:52.522995 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 14 10:40:52.522995 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 14 10:40:52.522995 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 14 10:40:52.522995 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 14 10:40:52.522995 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:40:52.522995 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:40:52.522995 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:40:52.522995 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:40:52.522995 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:40:52.522995 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:40:52.523830 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:40:52.523830 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application with Lock( Jul 14 10:40:52.523830 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:40:52.523830 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:40:52.523830 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:40:52.523830 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:40:52.523830 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:40:52.523830 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:40:52.523830 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:40:52.523830 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:40:52.523830 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 14 10:40:52.523830 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 10:40:52.523830 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 14 10:40:52.523830 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application Jul 14 10:40:52.523830 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 520/1041] 10.222.0.16 () {56 vars in 1105 bytes} [Thu Jul 14 10:40:52 2022] GET /identity/v3/services/image => generated 86 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 10:40:52.532518 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8ef3ec-9943-47ed-a2e3-1be67ddaf329 None admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:52.554972 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=100 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:52.651490 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8ef3ec-9943-47ed-a2e3-1be67ddaf329 None admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:52.686966 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5576a611-8401-42f5-8fb9-b524ea384f86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:52.687793 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5576a611-8401-42f5-8fb9-b524ea384f86 None admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:52.688078 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5576a611-8401-42f5-8fb9-b524ea384f86 None admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:52.688366 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5576a611-8401-42f5-8fb9-b524ea384f86 None admin] PATH_INFO: `/v3/services` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:52.689097 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5576a611-8401-42f5-8fb9-b524ea384f86 None admin] RBAC: Adding query filter params (name=image) {{(pid=86656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:40:52.689411 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5576a611-8401-42f5-8fb9-b524ea384f86 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:52.690779 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5576a611-8401-42f5-8fb9-b524ea384f86 None admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:52.696099 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 522/1042] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Jul 14 10:40:52 2022] GET /identity/v3/services?name=image => generated 122 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:40:52.702869 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d92e63f-c5c5-4181-9d1c-fab4a6f0a5c7 None admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:52.817507 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d92e63f-c5c5-4181-9d1c-fab4a6f0a5c7 None admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:52.844340 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=100 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:52.853861 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c122af-603d-4545-9781-b2c8c8039102 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:52.854540 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c122af-603d-4545-9781-b2c8c8039102 None admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:52.854828 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c122af-603d-4545-9781-b2c8c8039102 None admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:52.855107 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c122af-603d-4545-9781-b2c8c8039102 None admin] PATH_INFO: `/v3/services` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:52.855827 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c122af-603d-4545-9781-b2c8c8039102 None admin] RBAC: Adding query filter params (type=image) {{(pid=86655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:40:52.856294 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c122af-603d-4545-9781-b2c8c8039102 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:52.858260 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c122af-603d-4545-9781-b2c8c8039102 None admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:52.867982 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 521/1043] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Jul 14 10:40:52 2022] GET /identity/v3/services?type=image => generated 350 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:40:52.869289 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5576a611-8401-42f5-8fb9-b524ea384f86 None admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:52.958897 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=100 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:52.979303 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5576a611-8401-42f5-8fb9-b524ea384f86 None admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:53.015865 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7dfdf4-2352-454f-a276-0b8d2df52f6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:53.016892 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7dfdf4-2352-454f-a276-0b8d2df52f6b None admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:53.017366 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7dfdf4-2352-454f-a276-0b8d2df52f6b None admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:53.017847 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7dfdf4-2352-454f-a276-0b8d2df52f6b None admin] PATH_INFO: `/v3/endpoints` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:53.018823 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7dfdf4-2352-454f-a276-0b8d2df52f6b None admin] RBAC: Adding query filter params (interface=public, service_id=01f40ca73cd3432ea8dc10c3b67d5a6f, region_id=RegionOne) {{(pid=86656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:40:53.019321 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7dfdf4-2352-454f-a276-0b8d2df52f6b None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:53.020899 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7dfdf4-2352-454f-a276-0b8d2df52f6b None admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:53.026632 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 523/1044] 10.222.0.16 () {56 vars in 1251 bytes} [Thu Jul 14 10:40:52 2022] GET /identity/v3/endpoints?service_id=01f40ca73cd3432ea8dc10c3b67d5a6f&interface=public®ion_id=RegionOne => generated 194 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:40:53.031792 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c122af-603d-4545-9781-b2c8c8039102 None admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:53.132933 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c122af-603d-4545-9781-b2c8c8039102 None admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:53.166091 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20ec47d-5a54-4485-817a-0923f9ee5859 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:53.166783 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20ec47d-5a54-4485-817a-0923f9ee5859 None admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:53.167070 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20ec47d-5a54-4485-817a-0923f9ee5859 None admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:53.167349 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20ec47d-5a54-4485-817a-0923f9ee5859 None admin] PATH_INFO: `/v3/services` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:53.168038 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20ec47d-5a54-4485-817a-0923f9ee5859 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:53.170131 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20ec47d-5a54-4485-817a-0923f9ee5859 None admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:53.185166 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 522/1045] 10.222.0.16 () {56 vars in 1087 bytes} [Thu Jul 14 10:40:53 2022] GET /identity/v3/services => generated 1957 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:40:53.320667 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff108ba-8563-4116-b51c-2adf1901dab8 None None] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:53.321076 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff108ba-8563-4116-b51c-2adf1901dab8 None None] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:53.321269 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff108ba-8563-4116-b51c-2adf1901dab8 None None] PATH_INFO: `/` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:53.322809 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 524/1046] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jul 14 10:40:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:40:53.327993 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8069707d-d5c3-4bb9-ac71-976d177441c9 None None] REQUEST_METHOD: `POST` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:53.328285 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8069707d-d5c3-4bb9-ac71-976d177441c9 None None] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:53.328567 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8069707d-d5c3-4bb9-ac71-976d177441c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:53.346119 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.auth.core [None req-8069707d-d5c3-4bb9-ac71-976d177441c9 None None] MFA Rules not processed for user `ae4bcdd8106d4bebbdcae96be33505bc`. Rule list: `[]` (Enabled: `True`). {{(pid=86655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:40:53.347236 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-8069707d-d5c3-4bb9-ac71-976d177441c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:40:53.399350 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=100 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:53.424793 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 523/1047] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jul 14 10:40:53 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 10:40:53.442722 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff108ba-8563-4116-b51c-2adf1901dab8 None None] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:53.548602 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff108ba-8563-4116-b51c-2adf1901dab8 None None] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:53.585208 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfc7aed-a02f-4633-9533-1d87f13a7dea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:53.586009 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfc7aed-a02f-4633-9533-1d87f13a7dea None admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:53.586292 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfc7aed-a02f-4633-9533-1d87f13a7dea None admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:53.586567 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfc7aed-a02f-4633-9533-1d87f13a7dea None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:53.597244 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dfc7aed-a02f-4633-9533-1d87f13a7dea None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 10:40:53.604857 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application [None req-1dfc7aed-a02f-4633-9533-1d87f13a7dea None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 10:40:53.604857 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:40:53.604857 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:40:53.604857 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:40:53.604857 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:40:53.604857 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:40:53.604857 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:40:53.604857 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:40:53.604857 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:40:53.604857 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:40:53.604857 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:40:53.604857 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:40:53.604857 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 10:40:53.604857 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 10:40:53.604857 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 10:40:53.604857 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 10:40:53.605763 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 10:40:53.605763 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 10:40:53.605763 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 10:40:53.605763 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 10:40:53.605763 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:40:53.605763 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:40:53.605763 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:40:53.605763 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:40:53.605763 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:40:53.605763 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:40:53.605763 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:40:53.605763 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application with Lock( Jul 14 10:40:53.605763 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:40:53.605763 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:40:53.605763 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:40:53.605763 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:40:53.606926 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:40:53.606926 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:40:53.606926 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:40:53.606926 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:40:53.606926 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 10:40:53.606926 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 10:40:53.606926 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 10:40:53.606926 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 10:40:53.606926 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 10:40:53.606926 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 10:40:53.606926 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 10:40:53.606926 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application Jul 14 10:40:53.606926 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 525/1048] 10.222.0.16 () {56 vars in 1096 bytes} [Thu Jul 14 10:40:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:40:53.613650 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8069707d-d5c3-4bb9-ac71-976d177441c9 None None] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:53.716793 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8069707d-d5c3-4bb9-ac71-976d177441c9 None None] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:53.751856 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f9ecce-e106-43db-9883-bfcbb8209d2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:53.752520 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f9ecce-e106-43db-9883-bfcbb8209d2e None admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:53.752823 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f9ecce-e106-43db-9883-bfcbb8209d2e None admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:53.753101 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f9ecce-e106-43db-9883-bfcbb8209d2e None admin] PATH_INFO: `/v3/roles` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:53.753854 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f9ecce-e106-43db-9883-bfcbb8209d2e None admin] RBAC: Adding query filter params (name=admin) {{(pid=86655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:40:53.754160 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f9ecce-e106-43db-9883-bfcbb8209d2e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:53.755513 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f9ecce-e106-43db-9883-bfcbb8209d2e None admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:53.768131 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 524/1049] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Jul 14 10:40:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 10:40:53.769689 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfc7aed-a02f-4633-9533-1d87f13a7dea None admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:53.782227 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=100 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:53.876025 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfc7aed-a02f-4633-9533-1d87f13a7dea None admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:53.908934 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef0a55b-de12-4598-ac00-369b1c653521 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:53.910258 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef0a55b-de12-4598-ac00-369b1c653521 None admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:53.910546 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef0a55b-de12-4598-ac00-369b1c653521 None admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:53.910825 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef0a55b-de12-4598-ac00-369b1c653521 None admin] PATH_INFO: `/v3/users/1d7f8b4e5f7a43c4a87691fb8c3ce0a5` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:53.928857 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef0a55b-de12-4598-ac00-369b1c653521 None admin] RBAC: Authorizing `identity:get_user(user_id=1d7f8b4e5f7a43c4a87691fb8c3ce0a5)` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:53.930310 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef0a55b-de12-4598-ac00-369b1c653521 None admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:53.937059 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 526/1050] 10.222.0.16 () {56 vars in 1177 bytes} [Thu Jul 14 10:40:53 2022] GET /identity/v3/users/1d7f8b4e5f7a43c4a87691fb8c3ce0a5 => generated 285 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 10:40:53.938328 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f9ecce-e106-43db-9883-bfcbb8209d2e None admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:53.991068 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=100 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:54.046819 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f9ecce-e106-43db-9883-bfcbb8209d2e None admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:54.081282 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a17590a-6690-44e2-8f49-dbde48732c06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:54.081935 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a17590a-6690-44e2-8f49-dbde48732c06 None admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:54.082219 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a17590a-6690-44e2-8f49-dbde48732c06 None admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:54.082497 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a17590a-6690-44e2-8f49-dbde48732c06 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:54.149109 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a17590a-6690-44e2-8f49-dbde48732c06 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:54.150554 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a17590a-6690-44e2-8f49-dbde48732c06 None admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:54.196515 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=100 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:54.257028 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 525/1051] 10.222.0.16 () {58 vars in 1282 bytes} [Thu Jul 14 10:40:53 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 14 10:40:54.258765 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef0a55b-de12-4598-ac00-369b1c653521 None admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:54.329082 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=100 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:54.368763 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef0a55b-de12-4598-ac00-369b1c653521 None admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:54.405242 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612321bb-eba7-43a8-9654-b1afa40d3556 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:54.406113 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612321bb-eba7-43a8-9654-b1afa40d3556 None admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:54.406403 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612321bb-eba7-43a8-9654-b1afa40d3556 None admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:54.406686 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612321bb-eba7-43a8-9654-b1afa40d3556 None admin] PATH_INFO: `/v3/projects/a58b4d2a9d4a4acea0a9befaf8473e11` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:54.407881 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612321bb-eba7-43a8-9654-b1afa40d3556 None admin] RBAC: Authorizing `identity:get_project(project_id=a58b4d2a9d4a4acea0a9befaf8473e11)` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:54.409364 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612321bb-eba7-43a8-9654-b1afa40d3556 None admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:54.415955 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 527/1052] 10.222.0.16 () {56 vars in 1186 bytes} [Thu Jul 14 10:40:54 2022] GET /identity/v3/projects/a58b4d2a9d4a4acea0a9befaf8473e11 => generated 311 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:40:54.417067 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a17590a-6690-44e2-8f49-dbde48732c06 None admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:54.517927 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7951402b-65e2-4517-8eb3-462d67064cdd None None] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:54.518206 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7951402b-65e2-4517-8eb3-462d67064cdd None None] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:54.518414 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7951402b-65e2-4517-8eb3-462d67064cdd None None] PATH_INFO: `/` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:54.519912 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 528/1053] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jul 14 10:40:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 14 10:40:54.521160 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a17590a-6690-44e2-8f49-dbde48732c06 None admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:54.524552 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e743687f-3811-44b3-825a-a7c68b39f75e None None] REQUEST_METHOD: `POST` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:54.524877 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e743687f-3811-44b3-825a-a7c68b39f75e None None] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:54.525164 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e743687f-3811-44b3-825a-a7c68b39f75e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:54.546586 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.auth.core [None req-e743687f-3811-44b3-825a-a7c68b39f75e None None] MFA Rules not processed for user `ae4bcdd8106d4bebbdcae96be33505bc`. Rule list: `[]` (Enabled: `True`). {{(pid=86656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:40:54.547790 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-e743687f-3811-44b3-825a-a7c68b39f75e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:40:54.560573 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0c9e7b-2dcf-4bc0-996c-62599be118da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:54.561264 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0c9e7b-2dcf-4bc0-996c-62599be118da None admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:54.561548 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0c9e7b-2dcf-4bc0-996c-62599be118da None admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:54.561822 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0c9e7b-2dcf-4bc0-996c-62599be118da None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:54.562660 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0c9e7b-2dcf-4bc0-996c-62599be118da None admin] RBAC: Adding query filter params (role.id=153539819e5542df99269d2913bbecfb, scope.project.id=a58b4d2a9d4a4acea0a9befaf8473e11, user.id=1d7f8b4e5f7a43c4a87691fb8c3ce0a5) {{(pid=86655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:40:54.562971 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0c9e7b-2dcf-4bc0-996c-62599be118da None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:54.564392 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0c9e7b-2dcf-4bc0-996c-62599be118da None admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:54.576808 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 526/1054] 10.222.0.16 () {56 vars in 1374 bytes} [Thu Jul 14 10:40:54 2022] GET /identity/v3/role_assignments?user.id=1d7f8b4e5f7a43c4a87691fb8c3ce0a5&scope.project.id=a58b4d2a9d4a4acea0a9befaf8473e11&role.id=153539819e5542df99269d2913bbecfb => generated 259 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:40:54.631797 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 529/1055] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jul 14 10:40:54 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 14 10:40:54.655918 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0c9e7b-2dcf-4bc0-996c-62599be118da None admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:54.669028 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=100 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:54.763866 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0c9e7b-2dcf-4bc0-996c-62599be118da None admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:54.806302 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b738d046-bdb1-44a6-a589-e82d9369642c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:54.807413 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b738d046-bdb1-44a6-a589-e82d9369642c None admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:54.807907 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b738d046-bdb1-44a6-a589-e82d9369642c None admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:54.808370 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b738d046-bdb1-44a6-a589-e82d9369642c None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:54.820123 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b738d046-bdb1-44a6-a589-e82d9369642c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 10:40:54.828816 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application [None req-b738d046-bdb1-44a6-a589-e82d9369642c None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 14 10:40:54.828816 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:40:54.828816 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:40:54.828816 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:40:54.828816 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:40:54.828816 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:40:54.828816 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:40:54.828816 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:40:54.828816 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:40:54.828816 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:40:54.828816 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:40:54.828816 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:40:54.828816 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 10:40:54.828816 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 10:40:54.828816 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 10:40:54.828816 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 10:40:54.829748 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 10:40:54.829748 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 10:40:54.829748 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 10:40:54.829748 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 10:40:54.829748 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:40:54.829748 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:40:54.829748 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:40:54.829748 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:40:54.829748 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:40:54.829748 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:40:54.829748 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:40:54.829748 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application with Lock( Jul 14 10:40:54.829748 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:40:54.829748 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:40:54.829748 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:40:54.829748 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:40:54.830563 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:40:54.830563 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:40:54.830563 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:40:54.830563 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:40:54.830563 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 10:40:54.830563 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 10:40:54.830563 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 10:40:54.830563 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 10:40:54.830563 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 10:40:54.830563 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 10:40:54.830563 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 14 10:40:54.830563 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application Jul 14 10:40:54.832517 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 527/1056] 10.222.0.16 () {56 vars in 1120 bytes} [Thu Jul 14 10:40:54 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:40:54.838606 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e743687f-3811-44b3-825a-a7c68b39f75e None None] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:54.901684 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=100 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:54.942355 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e743687f-3811-44b3-825a-a7c68b39f75e None None] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:54.976719 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4a663c-0b75-4821-b0a7-07beac1d93d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:54.977426 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4a663c-0b75-4821-b0a7-07beac1d93d8 None admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:54.977711 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4a663c-0b75-4821-b0a7-07beac1d93d8 None admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:54.977985 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4a663c-0b75-4821-b0a7-07beac1d93d8 None admin] PATH_INFO: `/v3/roles` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:54.978732 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4a663c-0b75-4821-b0a7-07beac1d93d8 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=86656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:40:54.979041 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4a663c-0b75-4821-b0a7-07beac1d93d8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:54.980399 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4a663c-0b75-4821-b0a7-07beac1d93d8 None admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:54.993446 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 530/1057] 10.222.0.16 () {56 vars in 1115 bytes} [Thu Jul 14 10:40:54 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:40:54.995300 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b738d046-bdb1-44a6-a589-e82d9369642c None admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:55.069006 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=100 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:55.102915 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b738d046-bdb1-44a6-a589-e82d9369642c None admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:55.137237 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd2dd8e-5694-4eb2-b2d0-750780cbe756 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:55.138849 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd2dd8e-5694-4eb2-b2d0-750780cbe756 None admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:55.139145 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd2dd8e-5694-4eb2-b2d0-750780cbe756 None admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:55.139427 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd2dd8e-5694-4eb2-b2d0-750780cbe756 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:55.151073 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd2dd8e-5694-4eb2-b2d0-750780cbe756 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:55.152752 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd2dd8e-5694-4eb2-b2d0-750780cbe756 None admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:55.170139 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application [None req-2bd2dd8e-5694-4eb2-b2d0-750780cbe756 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 10:40:55.170139 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:40:55.170139 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:40:55.170139 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:40:55.170139 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:40:55.170139 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:40:55.170139 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:40:55.170139 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:40:55.170139 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:40:55.170139 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:40:55.170139 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:40:55.170139 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:40:55.170139 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 10:40:55.170139 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 10:40:55.170139 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 10:40:55.171027 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 10:40:55.171027 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:40:55.171027 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:40:55.171027 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:40:55.171027 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:40:55.171027 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:40:55.171027 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:40:55.171027 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:40:55.171027 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application with Lock( Jul 14 10:40:55.171027 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:40:55.171027 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:40:55.171027 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:40:55.171027 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:40:55.171027 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:40:55.171027 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:40:55.171027 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:40:55.171027 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:40:55.171904 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 10:40:55.171904 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 10:40:55.171904 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 10:40:55.171904 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application Jul 14 10:40:55.177071 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 528/1058] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Jul 14 10:40:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:40:55.179654 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4a663c-0b75-4821-b0a7-07beac1d93d8 None admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:55.249586 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3171dd-5ae4-4fb9-b19d-85829c6d4dca None None] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:55.249876 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3171dd-5ae4-4fb9-b19d-85829c6d4dca None None] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:55.250199 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3171dd-5ae4-4fb9-b19d-85829c6d4dca None None] PATH_INFO: `/` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:55.251654 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 529/1059] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jul 14 10:40:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 14 10:40:55.256545 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f747da01-61c2-481c-9f2e-94b89c8e1f5b None None] REQUEST_METHOD: `POST` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:55.256870 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f747da01-61c2-481c-9f2e-94b89c8e1f5b None None] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:55.257161 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f747da01-61c2-481c-9f2e-94b89c8e1f5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:55.276391 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.auth.core [None req-f747da01-61c2-481c-9f2e-94b89c8e1f5b None None] MFA Rules not processed for user `ae4bcdd8106d4bebbdcae96be33505bc`. Rule list: `[]` (Enabled: `True`). {{(pid=86655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:40:55.277626 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-f747da01-61c2-481c-9f2e-94b89c8e1f5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:40:55.286892 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4a663c-0b75-4821-b0a7-07beac1d93d8 None admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:55.313302 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=100 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:55.326336 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b41de1-cc29-463f-b688-191d33cad56d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:55.326945 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b41de1-cc29-463f-b688-191d33cad56d None admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:55.327239 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b41de1-cc29-463f-b688-191d33cad56d None admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:55.327534 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b41de1-cc29-463f-b688-191d33cad56d None admin] PATH_INFO: `/v3/domains` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:55.328232 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b41de1-cc29-463f-b688-191d33cad56d None admin] RBAC: Adding query filter params (name=Default) {{(pid=86656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:40:55.328718 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b41de1-cc29-463f-b688-191d33cad56d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:55.329992 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b41de1-cc29-463f-b688-191d33cad56d None admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:55.342125 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 531/1060] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Jul 14 10:40:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:40:55.347685 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b41de1-cc29-463f-b688-191d33cad56d None admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:55.352667 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 530/1061] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jul 14 10:40:55 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 14 10:40:55.376472 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f747da01-61c2-481c-9f2e-94b89c8e1f5b None None] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:55.431116 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=100 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:55.456514 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b41de1-cc29-463f-b688-191d33cad56d None admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:55.479921 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f747da01-61c2-481c-9f2e-94b89c8e1f5b None None] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:55.490787 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbe7f41-d7e2-4143-89bc-a7703de4fff3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:55.491622 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbe7f41-d7e2-4143-89bc-a7703de4fff3 None admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:55.491916 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbe7f41-d7e2-4143-89bc-a7703de4fff3 None admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:55.492199 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbe7f41-d7e2-4143-89bc-a7703de4fff3 None admin] PATH_INFO: `/v3/users/nova` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:55.499644 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fbe7f41-d7e2-4143-89bc-a7703de4fff3 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:55.501107 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fbe7f41-d7e2-4143-89bc-a7703de4fff3 None admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:55.515941 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application [None req-4fbe7f41-d7e2-4143-89bc-a7703de4fff3 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 14 10:40:55.515941 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:40:55.515941 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:40:55.515941 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:40:55.515941 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:40:55.515941 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:40:55.515941 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:40:55.515941 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:40:55.515941 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:40:55.515941 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:40:55.515941 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:40:55.515941 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:40:55.515941 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 10:40:55.515941 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 10:40:55.515941 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 10:40:55.515941 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 10:40:55.517103 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:40:55.517103 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:40:55.517103 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 10:40:55.517103 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 10:40:55.517103 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 10:40:55.517103 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 10:40:55.517103 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:40:55.517103 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:40:55.517103 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:40:55.517103 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:40:55.517103 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:40:55.517103 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application with Lock( Jul 14 10:40:55.517103 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:40:55.517103 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:40:55.517103 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:40:55.517103 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:40:55.517103 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:40:55.517103 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:40:55.518085 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:40:55.518085 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:40:55.518085 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 10:40:55.518085 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 10:40:55.518085 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 10:40:55.518085 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 10:40:55.518085 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 10:40:55.518085 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 10:40:55.518085 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 14 10:40:55.518085 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application Jul 14 10:40:55.518085 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 532/1062] 10.222.0.16 () {56 vars in 1093 bytes} [Thu Jul 14 10:40:55 2022] GET /identity/v3/users/nova => generated 82 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 10:40:55.522644 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68867209-554e-4065-beec-413c42781d0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:55.523635 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68867209-554e-4065-beec-413c42781d0e None admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:55.523770 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbe7f41-d7e2-4143-89bc-a7703de4fff3 None admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:55.523944 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68867209-554e-4065-beec-413c42781d0e None admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:55.524208 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68867209-554e-4065-beec-413c42781d0e None admin] PATH_INFO: `/v3/services/image` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:55.524891 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68867209-554e-4065-beec-413c42781d0e None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:55.526280 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68867209-554e-4065-beec-413c42781d0e None admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:55.538533 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application [None req-68867209-554e-4065-beec-413c42781d0e None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 14 10:40:55.538533 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:40:55.538533 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 14 10:40:55.538533 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 14 10:40:55.538533 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 14 10:40:55.538533 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 14 10:40:55.538533 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 14 10:40:55.538533 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 10:40:55.538533 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 14 10:40:55.538533 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application Jul 14 10:40:55.538533 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 10:40:55.538533 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application Jul 14 10:40:55.538533 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:40:55.538533 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:40:55.538533 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:40:55.538533 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:40:55.538533 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:40:55.539504 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:40:55.539504 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:40:55.539504 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:40:55.539504 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:40:55.539504 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:40:55.539504 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:40:55.539504 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 14 10:40:55.539504 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 14 10:40:55.539504 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 14 10:40:55.539504 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 14 10:40:55.539504 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:40:55.539504 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:40:55.539504 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:40:55.539504 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:40:55.539504 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:40:55.539504 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:40:55.540343 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:40:55.540343 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application with Lock( Jul 14 10:40:55.540343 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:40:55.540343 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:40:55.540343 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:40:55.540343 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:40:55.540343 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:40:55.540343 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:40:55.540343 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:40:55.540343 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:40:55.540343 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 14 10:40:55.540343 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 10:40:55.540343 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 14 10:40:55.540343 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application Jul 14 10:40:55.545113 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 531/1063] 10.222.0.16 () {56 vars in 1105 bytes} [Thu Jul 14 10:40:55 2022] GET /identity/v3/services/image => generated 86 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 10:40:55.546159 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68867209-554e-4065-beec-413c42781d0e None admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:55.577052 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=100 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:55.637700 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbe7f41-d7e2-4143-89bc-a7703de4fff3 None admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:55.658756 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68867209-554e-4065-beec-413c42781d0e None admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:55.676666 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=100 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:55.677615 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758ae1d5-6153-4467-a540-9146fd8b75fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:55.678368 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758ae1d5-6153-4467-a540-9146fd8b75fe None admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:55.678682 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758ae1d5-6153-4467-a540-9146fd8b75fe None admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:55.678946 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758ae1d5-6153-4467-a540-9146fd8b75fe None admin] PATH_INFO: `/v3/users` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:55.679836 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758ae1d5-6153-4467-a540-9146fd8b75fe None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:40:55.680150 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758ae1d5-6153-4467-a540-9146fd8b75fe None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:55.681599 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758ae1d5-6153-4467-a540-9146fd8b75fe None admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:55.697770 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd202bbc-7892-4856-9f0e-c69b2ed1618a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:55.698442 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd202bbc-7892-4856-9f0e-c69b2ed1618a None admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:55.698726 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd202bbc-7892-4856-9f0e-c69b2ed1618a None admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:55.698999 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd202bbc-7892-4856-9f0e-c69b2ed1618a None admin] PATH_INFO: `/v3/services` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:55.699462 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 533/1064] 10.222.0.16 () {56 vars in 1133 bytes} [Thu Jul 14 10:40:55 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 10:40:55.699738 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd202bbc-7892-4856-9f0e-c69b2ed1618a None admin] RBAC: Adding query filter params (name=image) {{(pid=86655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:40:55.700051 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd202bbc-7892-4856-9f0e-c69b2ed1618a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:55.701512 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd202bbc-7892-4856-9f0e-c69b2ed1618a None admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:55.705256 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758ae1d5-6153-4467-a540-9146fd8b75fe None admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:55.711510 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 532/1065] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Jul 14 10:40:55 2022] GET /identity/v3/services?name=image => generated 122 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:40:55.712152 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd202bbc-7892-4856-9f0e-c69b2ed1618a None admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:55.819841 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd202bbc-7892-4856-9f0e-c69b2ed1618a None admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:55.820032 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758ae1d5-6153-4467-a540-9146fd8b75fe None admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:55.821726 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=100 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:55.854728 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ff7a8f-c045-4787-a2bd-fc4a99f0ceae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:55.855316 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ff7a8f-c045-4787-a2bd-fc4a99f0ceae None admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:55.855601 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ff7a8f-c045-4787-a2bd-fc4a99f0ceae None admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:55.855880 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ff7a8f-c045-4787-a2bd-fc4a99f0ceae None admin] PATH_INFO: `/v3/services` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:55.856701 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ff7a8f-c045-4787-a2bd-fc4a99f0ceae None admin] RBAC: Adding query filter params (type=image) {{(pid=86655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:40:55.857085 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ff7a8f-c045-4787-a2bd-fc4a99f0ceae None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:55.858391 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ff7a8f-c045-4787-a2bd-fc4a99f0ceae None admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:55.858575 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c357a4-395f-46a8-9e3b-ca004e1bf76c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:55.859468 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c357a4-395f-46a8-9e3b-ca004e1bf76c None admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:55.859758 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c357a4-395f-46a8-9e3b-ca004e1bf76c None admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:55.860036 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c357a4-395f-46a8-9e3b-ca004e1bf76c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:55.863542 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 533/1066] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Jul 14 10:40:55 2022] GET /identity/v3/services?type=image => generated 350 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 10:40:55.868863 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ff7a8f-c045-4787-a2bd-fc4a99f0ceae None admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:55.870767 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c357a4-395f-46a8-9e3b-ca004e1bf76c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:55.873350 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c357a4-395f-46a8-9e3b-ca004e1bf76c None admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:55.893176 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application [None req-08c357a4-395f-46a8-9e3b-ca004e1bf76c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 10:40:55.893176 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:40:55.893176 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:40:55.893176 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:40:55.893176 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:40:55.893176 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:40:55.893176 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:40:55.893176 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:40:55.893176 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:40:55.893176 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:40:55.893176 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:40:55.893176 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:40:55.893176 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 10:40:55.893176 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 10:40:55.893176 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 10:40:55.894104 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 10:40:55.894104 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:40:55.894104 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:40:55.894104 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:40:55.894104 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:40:55.894104 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:40:55.894104 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:40:55.894104 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:40:55.894104 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application with Lock( Jul 14 10:40:55.894104 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:40:55.894104 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:40:55.894104 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:40:55.894104 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:40:55.894104 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:40:55.894104 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:40:55.894104 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:40:55.894104 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:40:55.895273 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 10:40:55.895273 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 10:40:55.895273 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 10:40:55.895273 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application Jul 14 10:40:55.895273 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 534/1067] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Jul 14 10:40:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 10:40:55.899951 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c357a4-395f-46a8-9e3b-ca004e1bf76c None admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:55.922296 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=100 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:55.985077 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ff7a8f-c045-4787-a2bd-fc4a99f0ceae None admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:56.007190 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c357a4-395f-46a8-9e3b-ca004e1bf76c None admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:56.019987 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5960e91-7ff4-41b8-986f-c40bdc270586 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:56.020754 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5960e91-7ff4-41b8-986f-c40bdc270586 None admin] REQUEST_METHOD: `POST` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:56.021407 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5960e91-7ff4-41b8-986f-c40bdc270586 None admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:56.021543 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5960e91-7ff4-41b8-986f-c40bdc270586 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:56.022181 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5960e91-7ff4-41b8-986f-c40bdc270586 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:56.023657 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5960e91-7ff4-41b8-986f-c40bdc270586 None admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:56.041388 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6612f1-48d4-47b9-844c-c86a2faed686 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:56.042056 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6612f1-48d4-47b9-844c-c86a2faed686 None admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:56.042344 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6612f1-48d4-47b9-844c-c86a2faed686 None admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:56.042623 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6612f1-48d4-47b9-844c-c86a2faed686 None admin] PATH_INFO: `/v3/domains` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:56.043277 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 534/1068] 10.222.0.16 () {60 vars in 1144 bytes} [Thu Jul 14 10:40:55 2022] POST /identity/v3/endpoints => generated 327 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 10:40:56.045063 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6612f1-48d4-47b9-844c-c86a2faed686 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:40:56.045396 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6612f1-48d4-47b9-844c-c86a2faed686 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:56.046789 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6612f1-48d4-47b9-844c-c86a2faed686 None admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:56.060512 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 535/1069] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Jul 14 10:40:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 10:40:56.066263 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5960e91-7ff4-41b8-986f-c40bdc270586 None admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:56.173663 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:56.187462 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5960e91-7ff4-41b8-986f-c40bdc270586 None admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:56.224733 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6c9b2f-7a74-49e9-b21c-39485d907b84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:56.225585 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6c9b2f-7a74-49e9-b21c-39485d907b84 None admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:56.225869 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6c9b2f-7a74-49e9-b21c-39485d907b84 None admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:56.226143 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6c9b2f-7a74-49e9-b21c-39485d907b84 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:56.233994 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6c9b2f-7a74-49e9-b21c-39485d907b84 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:56.235441 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6c9b2f-7a74-49e9-b21c-39485d907b84 None admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:56.250556 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application [None req-0a6c9b2f-7a74-49e9-b21c-39485d907b84 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 10:40:56.250556 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:40:56.250556 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:40:56.250556 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:40:56.250556 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:40:56.250556 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:40:56.250556 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:40:56.250556 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:40:56.250556 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:40:56.250556 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:40:56.250556 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:40:56.250556 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:40:56.250556 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 10:40:56.250556 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 10:40:56.250556 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 10:40:56.251493 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 10:40:56.251493 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:40:56.251493 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:40:56.251493 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:40:56.251493 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:40:56.251493 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:40:56.251493 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:40:56.251493 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:40:56.251493 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application with Lock( Jul 14 10:40:56.251493 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:40:56.251493 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:40:56.251493 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:40:56.251493 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:40:56.251493 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:40:56.251493 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:40:56.251493 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:40:56.251493 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:40:56.252403 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 10:40:56.252403 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 10:40:56.252403 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 10:40:56.252403 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 10:40:56.252403 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 10:40:56.252403 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 10:40:56.252403 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 10:40:56.252403 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application Jul 14 10:40:56.252403 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 535/1070] 10.222.0.16 () {56 vars in 1111 bytes} [Thu Jul 14 10:40:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:40:56.258966 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6612f1-48d4-47b9-844c-c86a2faed686 None admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:56.276054 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=100 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:56.361161 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6612f1-48d4-47b9-844c-c86a2faed686 None admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:56.393939 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98383f07-c791-45d1-8047-3faa91d8c2dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:56.394609 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98383f07-c791-45d1-8047-3faa91d8c2dd None admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:56.394890 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98383f07-c791-45d1-8047-3faa91d8c2dd None admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:56.395163 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98383f07-c791-45d1-8047-3faa91d8c2dd None admin] PATH_INFO: `/v3/projects` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:56.395947 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98383f07-c791-45d1-8047-3faa91d8c2dd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:40:56.396256 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98383f07-c791-45d1-8047-3faa91d8c2dd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:56.397704 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98383f07-c791-45d1-8047-3faa91d8c2dd None admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:56.410286 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 536/1071] 10.222.0.16 () {56 vars in 1148 bytes} [Thu Jul 14 10:40:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:40:56.416053 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6c9b2f-7a74-49e9-b21c-39485d907b84 None admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:56.518033 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6c9b2f-7a74-49e9-b21c-39485d907b84 None admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:56.555106 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58529174-11c8-401e-9896-b375be87afbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:56.555998 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58529174-11c8-401e-9896-b375be87afbe None admin] REQUEST_METHOD: `PUT` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:56.556280 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58529174-11c8-401e-9896-b375be87afbe None admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:56.556554 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58529174-11c8-401e-9896-b375be87afbe None admin] PATH_INFO: `/v3/projects/59391272ecbe48b0aa736cb43807be1d/users/26aa294c913c408499a913ec25bb677d/roles/ced8748f90594f3b81cabd4051d44e91` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:56.558778 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58529174-11c8-401e-9896-b375be87afbe None admin] RBAC: Authorizing `identity:create_grant(project_id=59391272ecbe48b0aa736cb43807be1d, user_id=26aa294c913c408499a913ec25bb677d, role_id=ced8748f90594f3b81cabd4051d44e91)` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:56.561025 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58529174-11c8-401e-9896-b375be87afbe None admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:56.574013 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 536/1072] 10.222.0.16 () {58 vars in 1439 bytes} [Thu Jul 14 10:40:56 2022] PUT /identity/v3/projects/59391272ecbe48b0aa736cb43807be1d/users/26aa294c913c408499a913ec25bb677d/roles/ced8748f90594f3b81cabd4051d44e91 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:40:56.594226 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e065a314-754e-4bb6-b5ac-22ecddd13868 None None] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:56.594654 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e065a314-754e-4bb6-b5ac-22ecddd13868 None None] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:56.595006 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e065a314-754e-4bb6-b5ac-22ecddd13868 None None] PATH_INFO: `/` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:56.596672 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 537/1073] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jul 14 10:40:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:40:56.602594 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ea3d75-e959-49ee-91c8-f3d781b04b98 None None] REQUEST_METHOD: `POST` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:56.602914 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ea3d75-e959-49ee-91c8-f3d781b04b98 None None] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:56.603169 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ea3d75-e959-49ee-91c8-f3d781b04b98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:56.622471 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.auth.core [None req-51ea3d75-e959-49ee-91c8-f3d781b04b98 None None] MFA Rules not processed for user `ae4bcdd8106d4bebbdcae96be33505bc`. Rule list: `[]` (Enabled: `True`). {{(pid=86655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:40:56.624083 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-51ea3d75-e959-49ee-91c8-f3d781b04b98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:40:56.637031 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:56.734418 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 537/1074] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jul 14 10:40:56 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 10:40:56.757244 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e065a314-754e-4bb6-b5ac-22ecddd13868 None None] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:56.840910 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=100 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:56.869510 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e065a314-754e-4bb6-b5ac-22ecddd13868 None None] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:56.904431 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbf162e-9a16-4590-a15d-3494b14aa5ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:56.905253 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbf162e-9a16-4590-a15d-3494b14aa5ae None admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:56.905535 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbf162e-9a16-4590-a15d-3494b14aa5ae None admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:56.905811 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbf162e-9a16-4590-a15d-3494b14aa5ae None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:56.916237 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cbf162e-9a16-4590-a15d-3494b14aa5ae None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 10:40:56.924535 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application [None req-4cbf162e-9a16-4590-a15d-3494b14aa5ae None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 10:40:56.924535 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:40:56.924535 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:40:56.924535 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:40:56.924535 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:40:56.924535 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:40:56.924535 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:40:56.924535 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:40:56.924535 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:40:56.924535 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:40:56.924535 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:40:56.924535 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:40:56.924535 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 10:40:56.924535 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 10:40:56.924535 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 10:40:56.924535 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 10:40:56.925497 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 10:40:56.925497 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 10:40:56.925497 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 10:40:56.925497 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 10:40:56.925497 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:40:56.925497 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:40:56.925497 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:40:56.925497 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:40:56.925497 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:40:56.925497 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:40:56.925497 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:40:56.925497 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application with Lock( Jul 14 10:40:56.925497 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:40:56.925497 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:40:56.925497 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:40:56.925497 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:40:56.926506 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:40:56.926506 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:40:56.926506 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:40:56.926506 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:40:56.926506 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 10:40:56.926506 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 10:40:56.926506 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 10:40:56.926506 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 10:40:56.926506 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 10:40:56.926506 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 10:40:56.926506 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 10:40:56.926506 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application Jul 14 10:40:56.926506 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 538/1075] 10.222.0.16 () {56 vars in 1096 bytes} [Thu Jul 14 10:40:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:40:56.931936 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ea3d75-e959-49ee-91c8-f3d781b04b98 None None] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:57.052104 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ea3d75-e959-49ee-91c8-f3d781b04b98 None None] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:57.091248 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fbc221-bc9c-4f4a-b59f-5ce3ec92c5be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:57.091982 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fbc221-bc9c-4f4a-b59f-5ce3ec92c5be None admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:57.092270 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fbc221-bc9c-4f4a-b59f-5ce3ec92c5be None admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:57.092545 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fbc221-bc9c-4f4a-b59f-5ce3ec92c5be None admin] PATH_INFO: `/v3/roles` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:57.093450 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30fbc221-bc9c-4f4a-b59f-5ce3ec92c5be None admin] RBAC: Adding query filter params (name=admin) {{(pid=86655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:40:57.093765 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30fbc221-bc9c-4f4a-b59f-5ce3ec92c5be None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:57.095137 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30fbc221-bc9c-4f4a-b59f-5ce3ec92c5be None admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:57.108294 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 538/1076] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Jul 14 10:40:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:40:57.109718 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbf162e-9a16-4590-a15d-3494b14aa5ae None admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:57.214562 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbf162e-9a16-4590-a15d-3494b14aa5ae None admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:57.248059 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ef3f06-4d34-4044-829e-f56d8127bf6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:57.248959 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ef3f06-4d34-4044-829e-f56d8127bf6c None admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:57.249248 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ef3f06-4d34-4044-829e-f56d8127bf6c None admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:57.249519 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ef3f06-4d34-4044-829e-f56d8127bf6c None admin] PATH_INFO: `/v3/users/1d7f8b4e5f7a43c4a87691fb8c3ce0a5` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:57.250709 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ef3f06-4d34-4044-829e-f56d8127bf6c None admin] RBAC: Authorizing `identity:get_user(user_id=1d7f8b4e5f7a43c4a87691fb8c3ce0a5)` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:57.252135 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ef3f06-4d34-4044-829e-f56d8127bf6c None admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:57.258494 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 539/1077] 10.222.0.16 () {56 vars in 1177 bytes} [Thu Jul 14 10:40:57 2022] GET /identity/v3/users/1d7f8b4e5f7a43c4a87691fb8c3ce0a5 => generated 285 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:40:57.259594 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fbc221-bc9c-4f4a-b59f-5ce3ec92c5be None admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:57.273737 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=100 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:57.367931 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fbc221-bc9c-4f4a-b59f-5ce3ec92c5be None admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:57.401280 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386fc96c-ec65-4d39-812d-7aef637efd33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:57.402147 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386fc96c-ec65-4d39-812d-7aef637efd33 None admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:57.402432 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386fc96c-ec65-4d39-812d-7aef637efd33 None admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:57.403225 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386fc96c-ec65-4d39-812d-7aef637efd33 None admin] PATH_INFO: `/v3/projects/a58b4d2a9d4a4acea0a9befaf8473e11` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:57.404449 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386fc96c-ec65-4d39-812d-7aef637efd33 None admin] RBAC: Authorizing `identity:get_project(project_id=a58b4d2a9d4a4acea0a9befaf8473e11)` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:57.406038 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386fc96c-ec65-4d39-812d-7aef637efd33 None admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:57.412747 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 539/1078] 10.222.0.16 () {56 vars in 1186 bytes} [Thu Jul 14 10:40:57 2022] GET /identity/v3/projects/a58b4d2a9d4a4acea0a9befaf8473e11 => generated 311 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 10:40:57.413814 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ef3f06-4d34-4044-829e-f56d8127bf6c None admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:57.416962 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=100 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:57.519443 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ef3f06-4d34-4044-829e-f56d8127bf6c None admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:57.552522 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca715426-3c89-4375-994b-541a3f3c8f3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:57.553434 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca715426-3c89-4375-994b-541a3f3c8f3c None admin] REQUEST_METHOD: `PUT` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:57.553719 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca715426-3c89-4375-994b-541a3f3c8f3c None admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:57.553995 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca715426-3c89-4375-994b-541a3f3c8f3c None admin] PATH_INFO: `/v3/projects/a58b4d2a9d4a4acea0a9befaf8473e11/users/1d7f8b4e5f7a43c4a87691fb8c3ce0a5/roles/153539819e5542df99269d2913bbecfb` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:57.555924 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca715426-3c89-4375-994b-541a3f3c8f3c None admin] RBAC: Authorizing `identity:create_grant(project_id=a58b4d2a9d4a4acea0a9befaf8473e11, user_id=1d7f8b4e5f7a43c4a87691fb8c3ce0a5, role_id=153539819e5542df99269d2913bbecfb)` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:57.557385 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca715426-3c89-4375-994b-541a3f3c8f3c None admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:57.570929 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 540/1079] 10.222.0.16 () {58 vars in 1439 bytes} [Thu Jul 14 10:40:57 2022] PUT /identity/v3/projects/a58b4d2a9d4a4acea0a9befaf8473e11/users/1d7f8b4e5f7a43c4a87691fb8c3ce0a5/roles/153539819e5542df99269d2913bbecfb => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:40:58.119862 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a474a681-94cd-4cf4-886e-555592fa9e52 None None] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:58.120238 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a474a681-94cd-4cf4-886e-555592fa9e52 None None] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:58.120427 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a474a681-94cd-4cf4-886e-555592fa9e52 None None] PATH_INFO: `/` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:58.122586 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 540/1080] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jul 14 10:40:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:40:58.127824 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdec7f7-ba3e-4bf3-b8b3-0a9168862e2a None None] REQUEST_METHOD: `POST` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:58.128140 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdec7f7-ba3e-4bf3-b8b3-0a9168862e2a None None] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:58.128404 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdec7f7-ba3e-4bf3-b8b3-0a9168862e2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:58.145160 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.auth.core [None req-4cdec7f7-ba3e-4bf3-b8b3-0a9168862e2a None None] MFA Rules not processed for user `ae4bcdd8106d4bebbdcae96be33505bc`. Rule list: `[]` (Enabled: `True`). {{(pid=86656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:40:58.146328 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-4cdec7f7-ba3e-4bf3-b8b3-0a9168862e2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:40:58.202626 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:58.214507 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 541/1081] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jul 14 10:40:58 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 10:40:58.237446 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a474a681-94cd-4cf4-886e-555592fa9e52 None None] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:58.317331 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=100 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:58.343491 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a474a681-94cd-4cf4-886e-555592fa9e52 None None] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:58.377359 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f19217a-decf-4fce-9bd2-5de9cd9e27d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:58.377942 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f19217a-decf-4fce-9bd2-5de9cd9e27d3 None admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:58.378226 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f19217a-decf-4fce-9bd2-5de9cd9e27d3 None admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:58.378503 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f19217a-decf-4fce-9bd2-5de9cd9e27d3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:58.445696 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f19217a-decf-4fce-9bd2-5de9cd9e27d3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:58.447148 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f19217a-decf-4fce-9bd2-5de9cd9e27d3 None admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:58.522669 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=100 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:58.550581 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 541/1082] 10.222.0.16 () {58 vars in 1282 bytes} [Thu Jul 14 10:40:58 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 14 10:40:58.556239 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdec7f7-ba3e-4bf3-b8b3-0a9168862e2a None None] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:58.650437 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ae0a1c-b845-47d8-8066-1f6ab3165801 None None] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:58.650630 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ae0a1c-b845-47d8-8066-1f6ab3165801 None None] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:58.650905 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ae0a1c-b845-47d8-8066-1f6ab3165801 None None] PATH_INFO: `/` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:58.652453 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 542/1083] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jul 14 10:40:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:40:58.656883 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdec7f7-ba3e-4bf3-b8b3-0a9168862e2a None None] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:58.657706 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049408f3-754b-483b-86e0-52b0630e5587 None None] REQUEST_METHOD: `POST` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:58.657996 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049408f3-754b-483b-86e0-52b0630e5587 None None] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:58.658282 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049408f3-754b-483b-86e0-52b0630e5587 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:58.676458 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.auth.core [None req-049408f3-754b-483b-86e0-52b0630e5587 None None] MFA Rules not processed for user `ae4bcdd8106d4bebbdcae96be33505bc`. Rule list: `[]` (Enabled: `True`). {{(pid=86655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:40:58.677735 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-049408f3-754b-483b-86e0-52b0630e5587 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:40:58.694654 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7609b589-2caf-4ce3-b4dc-92067fcd1743 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:58.695448 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7609b589-2caf-4ce3-b4dc-92067fcd1743 None admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:58.695735 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7609b589-2caf-4ce3-b4dc-92067fcd1743 None admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:58.696015 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7609b589-2caf-4ce3-b4dc-92067fcd1743 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:58.706159 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7609b589-2caf-4ce3-b4dc-92067fcd1743 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:58.707599 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7609b589-2caf-4ce3-b4dc-92067fcd1743 None admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:58.725762 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application [None req-7609b589-2caf-4ce3-b4dc-92067fcd1743 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 10:40:58.725762 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:40:58.725762 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:40:58.725762 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:40:58.725762 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:40:58.725762 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:40:58.725762 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:40:58.725762 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:40:58.725762 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:40:58.725762 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:40:58.725762 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:40:58.725762 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:40:58.725762 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 10:40:58.725762 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 10:40:58.725762 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 10:40:58.726864 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 10:40:58.726864 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:40:58.726864 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:40:58.726864 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:40:58.726864 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:40:58.726864 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:40:58.726864 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:40:58.726864 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:40:58.726864 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application with Lock( Jul 14 10:40:58.726864 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:40:58.726864 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:40:58.726864 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:40:58.726864 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:40:58.726864 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:40:58.726864 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:40:58.726864 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:40:58.726864 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:40:58.727759 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 10:40:58.727759 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 10:40:58.727759 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 10:40:58.727759 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application Jul 14 10:40:58.727759 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 542/1084] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Jul 14 10:40:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 10:40:58.732813 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7609b589-2caf-4ce3-b4dc-92067fcd1743 None admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:58.754516 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 543/1085] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jul 14 10:40:58 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 14 10:40:58.778205 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049408f3-754b-483b-86e0-52b0630e5587 None None] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:58.780564 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=100 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:58.842000 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7609b589-2caf-4ce3-b4dc-92067fcd1743 None admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:58.878556 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a70c811-b7ee-4574-a380-8181564fd052 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:58.879215 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a70c811-b7ee-4574-a380-8181564fd052 None admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:58.879504 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a70c811-b7ee-4574-a380-8181564fd052 None admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:58.879785 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a70c811-b7ee-4574-a380-8181564fd052 None admin] PATH_INFO: `/v3/domains` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:58.880488 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a70c811-b7ee-4574-a380-8181564fd052 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:40:58.880812 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a70c811-b7ee-4574-a380-8181564fd052 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:58.882179 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a70c811-b7ee-4574-a380-8181564fd052 None admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:58.890867 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049408f3-754b-483b-86e0-52b0630e5587 None None] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:58.893745 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 543/1086] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Jul 14 10:40:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:40:58.899336 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=100 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:58.931146 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ca6bcb-6357-4467-b709-4d4159ede66f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:58.931891 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ca6bcb-6357-4467-b709-4d4159ede66f None admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:58.932176 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ca6bcb-6357-4467-b709-4d4159ede66f None admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:58.932449 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ca6bcb-6357-4467-b709-4d4159ede66f None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:58.944991 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ca6bcb-6357-4467-b709-4d4159ede66f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 10:40:58.954346 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application [None req-a5ca6bcb-6357-4467-b709-4d4159ede66f None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 14 10:40:58.954346 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:40:58.954346 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:40:58.954346 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:40:58.954346 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:40:58.954346 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:40:58.954346 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:40:58.954346 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:40:58.954346 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:40:58.954346 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:40:58.954346 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:40:58.954346 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:40:58.954346 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 10:40:58.954346 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 10:40:58.954346 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 10:40:58.954346 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 10:40:58.955345 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 10:40:58.955345 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 10:40:58.955345 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 10:40:58.955345 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 10:40:58.955345 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:40:58.955345 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:40:58.955345 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:40:58.955345 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:40:58.955345 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:40:58.955345 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:40:58.955345 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:40:58.955345 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application with Lock( Jul 14 10:40:58.955345 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:40:58.955345 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:40:58.955345 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:40:58.955345 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:40:58.961939 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:40:58.961939 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:40:58.961939 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:40:58.961939 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:40:58.961939 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 10:40:58.961939 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 10:40:58.961939 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 10:40:58.961939 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 10:40:58.961939 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 10:40:58.961939 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 10:40:58.961939 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 14 10:40:58.961939 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application Jul 14 10:40:58.961939 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 544/1087] 10.222.0.16 () {56 vars in 1120 bytes} [Thu Jul 14 10:40:58 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 10:40:58.962631 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a70c811-b7ee-4574-a380-8181564fd052 None admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:59.071693 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a70c811-b7ee-4574-a380-8181564fd052 None admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:59.074140 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=100 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:59.110075 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e66b4c-9571-4ad5-b19b-ae67fbe043cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:59.110763 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e66b4c-9571-4ad5-b19b-ae67fbe043cf None admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:59.111052 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e66b4c-9571-4ad5-b19b-ae67fbe043cf None admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:59.111336 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e66b4c-9571-4ad5-b19b-ae67fbe043cf None admin] PATH_INFO: `/v3/roles` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:59.112098 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e66b4c-9571-4ad5-b19b-ae67fbe043cf None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=86656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:40:59.112435 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e66b4c-9571-4ad5-b19b-ae67fbe043cf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:59.113833 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e66b4c-9571-4ad5-b19b-ae67fbe043cf None admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:59.122584 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 544/1088] 10.222.0.16 () {56 vars in 1115 bytes} [Thu Jul 14 10:40:58 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:40:59.128504 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ca6bcb-6357-4467-b709-4d4159ede66f None admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:59.237420 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ca6bcb-6357-4467-b709-4d4159ede66f None admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:59.270205 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e670b4-44d7-4d0b-9c48-68d4c8278fcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:59.270993 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e670b4-44d7-4d0b-9c48-68d4c8278fcf None admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:59.271276 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e670b4-44d7-4d0b-9c48-68d4c8278fcf None admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:59.271549 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e670b4-44d7-4d0b-9c48-68d4c8278fcf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:59.282568 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e670b4-44d7-4d0b-9c48-68d4c8278fcf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:59.283994 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e670b4-44d7-4d0b-9c48-68d4c8278fcf None admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:59.300580 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application [None req-36e670b4-44d7-4d0b-9c48-68d4c8278fcf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 10:40:59.300580 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:40:59.300580 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:40:59.300580 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:40:59.300580 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:40:59.300580 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:40:59.300580 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:40:59.300580 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:40:59.300580 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:40:59.300580 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:40:59.300580 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:40:59.300580 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:40:59.300580 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 10:40:59.300580 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 10:40:59.300580 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 10:40:59.301538 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 10:40:59.301538 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:40:59.301538 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:40:59.301538 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:40:59.301538 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:40:59.301538 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:40:59.301538 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:40:59.301538 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:40:59.301538 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application with Lock( Jul 14 10:40:59.301538 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:40:59.301538 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:40:59.301538 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:40:59.301538 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:40:59.301538 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:40:59.301538 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:40:59.301538 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:40:59.301538 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:40:59.302422 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 10:40:59.302422 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 10:40:59.302422 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 10:40:59.302422 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application Jul 14 10:40:59.302422 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 545/1089] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Jul 14 10:40:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:40:59.307374 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e66b4c-9571-4ad5-b19b-ae67fbe043cf None admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:59.410796 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e66b4c-9571-4ad5-b19b-ae67fbe043cf None admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:59.443864 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c38283-767e-45e8-9796-fbba5a6dc95d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:59.444529 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c38283-767e-45e8-9796-fbba5a6dc95d None admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:59.444844 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c38283-767e-45e8-9796-fbba5a6dc95d None admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:59.445129 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c38283-767e-45e8-9796-fbba5a6dc95d None admin] PATH_INFO: `/v3/domains` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:59.445846 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c38283-767e-45e8-9796-fbba5a6dc95d None admin] RBAC: Adding query filter params (name=Default) {{(pid=86656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:40:59.446158 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c38283-767e-45e8-9796-fbba5a6dc95d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:59.447529 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c38283-767e-45e8-9796-fbba5a6dc95d None admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:59.460391 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 545/1090] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Jul 14 10:40:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:40:59.466104 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e670b4-44d7-4d0b-9c48-68d4c8278fcf None admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:59.485373 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=100 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:59.566047 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e670b4-44d7-4d0b-9c48-68d4c8278fcf None admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:59.599957 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b3292f-c2ed-4a5e-a9a2-5b925ecd6fa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:59.600746 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b3292f-c2ed-4a5e-a9a2-5b925ecd6fa2 None admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:59.601053 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b3292f-c2ed-4a5e-a9a2-5b925ecd6fa2 None admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:59.601329 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b3292f-c2ed-4a5e-a9a2-5b925ecd6fa2 None admin] PATH_INFO: `/v3/users/nova` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:59.608854 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b3292f-c2ed-4a5e-a9a2-5b925ecd6fa2 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:59.608989 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db62000f-5c92-447d-810b-aec51010248b None None] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:59.609411 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db62000f-5c92-447d-810b-aec51010248b None None] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:59.609516 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db62000f-5c92-447d-810b-aec51010248b None None] PATH_INFO: `/` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:59.610292 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b3292f-c2ed-4a5e-a9a2-5b925ecd6fa2 None admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:59.610895 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 546/1091] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jul 14 10:40:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 14 10:40:59.615729 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e2c39f-95d3-4661-ad84-140315bcb13c None None] REQUEST_METHOD: `POST` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:59.616134 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e2c39f-95d3-4661-ad84-140315bcb13c None None] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:59.616290 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e2c39f-95d3-4661-ad84-140315bcb13c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:59.625093 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application [None req-12b3292f-c2ed-4a5e-a9a2-5b925ecd6fa2 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 14 10:40:59.625093 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:40:59.625093 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:40:59.625093 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:40:59.625093 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:40:59.625093 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:40:59.625093 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:40:59.625093 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:40:59.625093 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:40:59.625093 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:40:59.625093 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:40:59.625093 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:40:59.625093 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 10:40:59.625093 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 10:40:59.625093 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 10:40:59.625093 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 10:40:59.626026 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:40:59.626026 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:40:59.626026 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 10:40:59.626026 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 10:40:59.626026 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 10:40:59.626026 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 10:40:59.626026 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:40:59.626026 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:40:59.626026 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:40:59.626026 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:40:59.626026 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:40:59.626026 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application with Lock( Jul 14 10:40:59.626026 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:40:59.626026 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:40:59.626026 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:40:59.626026 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:40:59.626026 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:40:59.626026 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:40:59.627014 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:40:59.627014 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:40:59.627014 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 10:40:59.627014 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 10:40:59.627014 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 10:40:59.627014 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 10:40:59.627014 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 10:40:59.627014 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 10:40:59.627014 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 14 10:40:59.627014 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application Jul 14 10:40:59.627014 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 546/1092] 10.222.0.16 () {56 vars in 1093 bytes} [Thu Jul 14 10:40:59 2022] GET /identity/v3/users/nova => generated 82 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 10:40:59.631706 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b3292f-c2ed-4a5e-a9a2-5b925ecd6fa2 None admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:59.638655 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.auth.core [None req-d4e2c39f-95d3-4661-ad84-140315bcb13c None None] MFA Rules not processed for user `ae4bcdd8106d4bebbdcae96be33505bc`. Rule list: `[]` (Enabled: `True`). {{(pid=86656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:40:59.639866 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-d4e2c39f-95d3-4661-ad84-140315bcb13c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:40:59.660231 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=100 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:59.712063 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 547/1093] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jul 14 10:40:59 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 14 10:40:59.713069 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=100 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:59.735123 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b3292f-c2ed-4a5e-a9a2-5b925ecd6fa2 None admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:59.735465 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e2c39f-95d3-4661-ad84-140315bcb13c None None] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:59.768700 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9666b529-2cdb-434c-873c-b0e74b425033 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:59.769408 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9666b529-2cdb-434c-873c-b0e74b425033 None admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:59.769691 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9666b529-2cdb-434c-873c-b0e74b425033 None admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:59.769992 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9666b529-2cdb-434c-873c-b0e74b425033 None admin] PATH_INFO: `/v3/users` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:59.770830 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9666b529-2cdb-434c-873c-b0e74b425033 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:40:59.771136 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9666b529-2cdb-434c-873c-b0e74b425033 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:59.772562 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9666b529-2cdb-434c-873c-b0e74b425033 None admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:40:59.790612 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 547/1094] 10.222.0.16 () {56 vars in 1133 bytes} [Thu Jul 14 10:40:59 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 10:40:59.796612 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9666b529-2cdb-434c-873c-b0e74b425033 None admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:59.840804 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e2c39f-95d3-4661-ad84-140315bcb13c None None] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:59.875423 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b45a64e-8272-4b1a-b26e-56eb66a89248 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:59.876214 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b45a64e-8272-4b1a-b26e-56eb66a89248 None admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:59.876499 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b45a64e-8272-4b1a-b26e-56eb66a89248 None admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:59.876803 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b45a64e-8272-4b1a-b26e-56eb66a89248 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:59.886763 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b45a64e-8272-4b1a-b26e-56eb66a89248 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 10:40:59.894232 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9666b529-2cdb-434c-873c-b0e74b425033 None admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:59.894557 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application [None req-4b45a64e-8272-4b1a-b26e-56eb66a89248 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 10:40:59.894557 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:40:59.894557 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:40:59.894557 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:40:59.894557 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:40:59.894557 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:40:59.894557 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:40:59.894557 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:40:59.894557 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:40:59.894557 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:40:59.894557 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:40:59.894557 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:40:59.894557 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 10:40:59.894557 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 10:40:59.894557 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 10:40:59.894557 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 10:40:59.895529 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 10:40:59.895529 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 10:40:59.895529 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 10:40:59.895529 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 10:40:59.895529 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:40:59.895529 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:40:59.895529 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:40:59.895529 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:40:59.895529 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:40:59.895529 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:40:59.895529 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:40:59.895529 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application with Lock( Jul 14 10:40:59.895529 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:40:59.895529 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:40:59.895529 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:40:59.895529 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:40:59.896364 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:40:59.896364 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:40:59.896364 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:40:59.896364 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:40:59.896364 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 10:40:59.896364 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 10:40:59.896364 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 10:40:59.896364 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 10:40:59.896364 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 10:40:59.896364 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 10:40:59.896364 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 10:40:59.896364 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application Jul 14 10:40:59.896364 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 548/1095] 10.222.0.16 () {56 vars in 1096 bytes} [Thu Jul 14 10:40:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 10:40:59.901673 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b45a64e-8272-4b1a-b26e-56eb66a89248 None admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:40:59.919619 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=100 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:59.929757 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef8bb46-d2f1-448b-b49c-566584ed8509 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:40:59.930406 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef8bb46-d2f1-448b-b49c-566584ed8509 None admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:40:59.930688 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef8bb46-d2f1-448b-b49c-566584ed8509 None admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:40:59.930964 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef8bb46-d2f1-448b-b49c-566584ed8509 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:40:59.935236 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=100 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:40:59.997942 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef8bb46-d2f1-448b-b49c-566584ed8509 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:40:59.999314 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b45a64e-8272-4b1a-b26e-56eb66a89248 None admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:40:59.999429 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef8bb46-d2f1-448b-b49c-566584ed8509 None admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:41:00.033529 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf6d878-fffc-4cd5-a53d-b12a49a28719 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:41:00.034195 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf6d878-fffc-4cd5-a53d-b12a49a28719 None admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:41:00.034485 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf6d878-fffc-4cd5-a53d-b12a49a28719 None admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:41:00.034768 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf6d878-fffc-4cd5-a53d-b12a49a28719 None admin] PATH_INFO: `/v3/roles` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:41:00.035517 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf6d878-fffc-4cd5-a53d-b12a49a28719 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:41:00.035829 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf6d878-fffc-4cd5-a53d-b12a49a28719 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:41:00.037236 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf6d878-fffc-4cd5-a53d-b12a49a28719 None admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:41:00.050548 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 549/1096] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Jul 14 10:40:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 10:41:00.051563 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf6d878-fffc-4cd5-a53d-b12a49a28719 None admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:41:00.099408 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 548/1097] 10.222.0.16 () {58 vars in 1282 bytes} [Thu Jul 14 10:40:59 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 14 10:41:00.104935 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef8bb46-d2f1-448b-b49c-566584ed8509 None admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:41:00.130403 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=100 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:41:00.139269 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=100 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:41:00.153059 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf6d878-fffc-4cd5-a53d-b12a49a28719 None admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:41:00.187140 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9e65d1-3bbc-45d9-82f9-e1dc001c33d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:41:00.188000 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9e65d1-3bbc-45d9-82f9-e1dc001c33d8 None admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:41:00.188276 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9e65d1-3bbc-45d9-82f9-e1dc001c33d8 None admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:41:00.188546 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9e65d1-3bbc-45d9-82f9-e1dc001c33d8 None admin] PATH_INFO: `/v3/users/1d7f8b4e5f7a43c4a87691fb8c3ce0a5` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:41:00.189770 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9e65d1-3bbc-45d9-82f9-e1dc001c33d8 None admin] RBAC: Authorizing `identity:get_user(user_id=1d7f8b4e5f7a43c4a87691fb8c3ce0a5)` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:41:00.191222 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9e65d1-3bbc-45d9-82f9-e1dc001c33d8 None admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:41:00.192908 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 550/1098] 10.222.0.16 () {56 vars in 1177 bytes} [Thu Jul 14 10:41:00 2022] GET /identity/v3/users/1d7f8b4e5f7a43c4a87691fb8c3ce0a5 => generated 285 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 10:41:00.198546 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9e65d1-3bbc-45d9-82f9-e1dc001c33d8 None admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:41:00.204458 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef8bb46-d2f1-448b-b49c-566584ed8509 None admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:41:00.238512 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf470cf-0396-4f02-aa62-863031fc7fd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:41:00.239302 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf470cf-0396-4f02-aa62-863031fc7fd0 None admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:41:00.239594 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf470cf-0396-4f02-aa62-863031fc7fd0 None admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:41:00.239875 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf470cf-0396-4f02-aa62-863031fc7fd0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:41:00.250482 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf470cf-0396-4f02-aa62-863031fc7fd0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:41:00.251922 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf470cf-0396-4f02-aa62-863031fc7fd0 None admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:41:00.269911 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application [None req-0bf470cf-0396-4f02-aa62-863031fc7fd0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 10:41:00.269911 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:41:00.269911 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:41:00.269911 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:41:00.269911 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:41:00.269911 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:41:00.269911 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:41:00.269911 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:41:00.269911 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:41:00.269911 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:41:00.269911 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:41:00.269911 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:41:00.269911 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 10:41:00.269911 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 10:41:00.269911 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 10:41:00.270993 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 10:41:00.270993 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:41:00.270993 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:41:00.270993 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:41:00.270993 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:41:00.270993 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:41:00.270993 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:41:00.270993 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:41:00.270993 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application with Lock( Jul 14 10:41:00.270993 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:41:00.270993 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:41:00.270993 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:41:00.270993 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:41:00.270993 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:41:00.270993 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:41:00.270993 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:41:00.270993 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:41:00.271913 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 10:41:00.271913 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 10:41:00.271913 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 10:41:00.271913 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application Jul 14 10:41:00.272922 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 549/1099] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Jul 14 10:41:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 10:41:00.276519 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf470cf-0396-4f02-aa62-863031fc7fd0 None admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:41:00.297621 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9e65d1-3bbc-45d9-82f9-e1dc001c33d8 None admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:41:00.330166 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8f90ee-58ef-4828-bbf4-368d0be01636 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:41:00.330814 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8f90ee-58ef-4828-bbf4-368d0be01636 None admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:41:00.331100 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8f90ee-58ef-4828-bbf4-368d0be01636 None admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:41:00.331382 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8f90ee-58ef-4828-bbf4-368d0be01636 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:41:00.346495 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=100 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:41:00.364095 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=100 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:41:00.376999 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf470cf-0396-4f02-aa62-863031fc7fd0 None admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:41:00.398738 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8f90ee-58ef-4828-bbf4-368d0be01636 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:41:00.400189 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8f90ee-58ef-4828-bbf4-368d0be01636 None admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:41:00.411086 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80af21e-f7e6-4c4f-be9c-fade434cc346 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:41:00.411745 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80af21e-f7e6-4c4f-be9c-fade434cc346 None admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:41:00.412030 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80af21e-f7e6-4c4f-be9c-fade434cc346 None admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:41:00.412299 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80af21e-f7e6-4c4f-be9c-fade434cc346 None admin] PATH_INFO: `/v3/domains` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:41:00.413061 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80af21e-f7e6-4c4f-be9c-fade434cc346 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:41:00.413367 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80af21e-f7e6-4c4f-be9c-fade434cc346 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:41:00.414707 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80af21e-f7e6-4c4f-be9c-fade434cc346 None admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:41:00.426091 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 550/1100] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Jul 14 10:41:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 10:41:00.431423 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80af21e-f7e6-4c4f-be9c-fade434cc346 None admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:41:00.500735 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 551/1101] 10.222.0.16 () {58 vars in 1282 bytes} [Thu Jul 14 10:41:00 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 14 10:41:00.506555 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8f90ee-58ef-4828-bbf4-368d0be01636 None admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:41:00.534149 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80af21e-f7e6-4c4f-be9c-fade434cc346 None admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:41:00.551196 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=100 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:41:00.571431 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a81e4b-2ae6-4857-9a00-e186d36ac5de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:41:00.572228 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a81e4b-2ae6-4857-9a00-e186d36ac5de None admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:41:00.572510 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a81e4b-2ae6-4857-9a00-e186d36ac5de None admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:41:00.572808 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a81e4b-2ae6-4857-9a00-e186d36ac5de None admin] PATH_INFO: `/v3/projects/service` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:41:00.579922 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a81e4b-2ae6-4857-9a00-e186d36ac5de None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:41:00.581397 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a81e4b-2ae6-4857-9a00-e186d36ac5de None admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:41:00.595593 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application [None req-67a81e4b-2ae6-4857-9a00-e186d36ac5de None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 10:41:00.595593 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:41:00.595593 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:41:00.595593 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:41:00.595593 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:41:00.595593 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:41:00.595593 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:41:00.595593 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:41:00.595593 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:41:00.595593 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:41:00.595593 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:41:00.595593 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:41:00.595593 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 10:41:00.595593 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 10:41:00.595593 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 10:41:00.596497 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 10:41:00.596497 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:41:00.596497 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:41:00.596497 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:41:00.596497 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:41:00.596497 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:41:00.596497 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:41:00.596497 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:41:00.596497 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application with Lock( Jul 14 10:41:00.596497 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:41:00.596497 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:41:00.596497 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:41:00.596497 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:41:00.596497 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:41:00.596497 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:41:00.596497 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:41:00.596497 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:41:00.597480 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 10:41:00.597480 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 10:41:00.597480 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 10:41:00.597480 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 10:41:00.597480 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 10:41:00.597480 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 10:41:00.597480 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 10:41:00.597480 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application Jul 14 10:41:00.597480 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 551/1102] 10.222.0.16 () {56 vars in 1111 bytes} [Thu Jul 14 10:41:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 10:41:00.602433 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a81e4b-2ae6-4857-9a00-e186d36ac5de None admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:41:00.608994 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8f90ee-58ef-4828-bbf4-368d0be01636 None admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:41:00.613324 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=100 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:41:00.645869 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48021862-78d1-43c6-89b9-5a49a9b909dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:41:00.646644 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48021862-78d1-43c6-89b9-5a49a9b909dc None admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:41:00.646929 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48021862-78d1-43c6-89b9-5a49a9b909dc None admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:41:00.647205 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48021862-78d1-43c6-89b9-5a49a9b909dc None admin] PATH_INFO: `/v3/projects/a58b4d2a9d4a4acea0a9befaf8473e11` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:41:00.648376 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48021862-78d1-43c6-89b9-5a49a9b909dc None admin] RBAC: Authorizing `identity:get_project(project_id=a58b4d2a9d4a4acea0a9befaf8473e11)` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:41:00.649874 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48021862-78d1-43c6-89b9-5a49a9b909dc None admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:41:00.651581 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 552/1103] 10.222.0.16 () {56 vars in 1186 bytes} [Thu Jul 14 10:41:00 2022] GET /identity/v3/projects/a58b4d2a9d4a4acea0a9befaf8473e11 => generated 311 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 10:41:00.657550 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48021862-78d1-43c6-89b9-5a49a9b909dc None admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:41:00.704699 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a81e4b-2ae6-4857-9a00-e186d36ac5de None admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:41:00.738121 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fa5fd6-d0b2-4148-a69a-19260f02673f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:41:00.738784 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fa5fd6-d0b2-4148-a69a-19260f02673f None admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:41:00.739065 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fa5fd6-d0b2-4148-a69a-19260f02673f None admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:41:00.739341 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fa5fd6-d0b2-4148-a69a-19260f02673f None admin] PATH_INFO: `/v3/projects` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:41:00.740209 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34fa5fd6-d0b2-4148-a69a-19260f02673f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:41:00.740520 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34fa5fd6-d0b2-4148-a69a-19260f02673f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:41:00.742043 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34fa5fd6-d0b2-4148-a69a-19260f02673f None admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:41:00.753959 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 552/1104] 10.222.0.16 () {56 vars in 1148 bytes} [Thu Jul 14 10:41:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 10:41:00.755384 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48021862-78d1-43c6-89b9-5a49a9b909dc None admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:41:00.759760 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fa5fd6-d0b2-4148-a69a-19260f02673f None admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:41:00.771697 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=100 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:41:00.792722 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50eccd9f-1b4c-4bae-af1c-13f99b2bb264 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:41:00.796813 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50eccd9f-1b4c-4bae-af1c-13f99b2bb264 None admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:41:00.796813 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50eccd9f-1b4c-4bae-af1c-13f99b2bb264 None admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:41:00.796813 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50eccd9f-1b4c-4bae-af1c-13f99b2bb264 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:41:00.796813 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50eccd9f-1b4c-4bae-af1c-13f99b2bb264 None admin] RBAC: Adding query filter params (role.id=153539819e5542df99269d2913bbecfb, scope.project.id=a58b4d2a9d4a4acea0a9befaf8473e11, user.id=1d7f8b4e5f7a43c4a87691fb8c3ce0a5) {{(pid=86656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:41:00.796813 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50eccd9f-1b4c-4bae-af1c-13f99b2bb264 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:41:00.797233 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50eccd9f-1b4c-4bae-af1c-13f99b2bb264 None admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:41:00.803122 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 553/1105] 10.222.0.16 () {56 vars in 1374 bytes} [Thu Jul 14 10:41:00 2022] GET /identity/v3/role_assignments?user.id=1d7f8b4e5f7a43c4a87691fb8c3ce0a5&scope.project.id=a58b4d2a9d4a4acea0a9befaf8473e11&role.id=153539819e5542df99269d2913bbecfb => generated 608 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 10:41:00.833459 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=100 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:41:00.871092 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fa5fd6-d0b2-4148-a69a-19260f02673f None admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:41:00.906561 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf4765a-b386-4c3e-97d3-e5557bf3d7f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:41:00.907151 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf4765a-b386-4c3e-97d3-e5557bf3d7f9 None admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:41:00.907437 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf4765a-b386-4c3e-97d3-e5557bf3d7f9 None admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:41:00.907717 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf4765a-b386-4c3e-97d3-e5557bf3d7f9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:41:00.908577 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf4765a-b386-4c3e-97d3-e5557bf3d7f9 None admin] RBAC: Adding query filter params (role.id=ced8748f90594f3b81cabd4051d44e91, scope.project.id=59391272ecbe48b0aa736cb43807be1d, user.id=26aa294c913c408499a913ec25bb677d) {{(pid=86655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:41:00.908924 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf4765a-b386-4c3e-97d3-e5557bf3d7f9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:41:00.910389 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf4765a-b386-4c3e-97d3-e5557bf3d7f9 None admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:41:00.917007 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 553/1106] 10.222.0.16 () {56 vars in 1374 bytes} [Thu Jul 14 10:41:00 2022] GET /identity/v3/role_assignments?user.id=26aa294c913c408499a913ec25bb677d&scope.project.id=59391272ecbe48b0aa736cb43807be1d&role.id=ced8748f90594f3b81cabd4051d44e91 => generated 608 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 10:41:02.867154 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937dd1fd-29b3-4b98-9759-4733b219fc91 None None] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:41:02.867697 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937dd1fd-29b3-4b98-9759-4733b219fc91 None None] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:41:02.867697 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937dd1fd-29b3-4b98-9759-4733b219fc91 None None] PATH_INFO: `/` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:41:02.869138 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 554/1107] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jul 14 10:41:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:41:02.875652 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ee0236-b9fb-4669-8006-b3337994c507 None None] REQUEST_METHOD: `POST` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:41:02.876059 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ee0236-b9fb-4669-8006-b3337994c507 None None] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:41:02.876215 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ee0236-b9fb-4669-8006-b3337994c507 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:41:02.892781 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.auth.core [None req-59ee0236-b9fb-4669-8006-b3337994c507 None None] MFA Rules not processed for user `ae4bcdd8106d4bebbdcae96be33505bc`. Rule list: `[]` (Enabled: `True`). {{(pid=86655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:41:02.893980 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-59ee0236-b9fb-4669-8006-b3337994c507 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:41:02.958231 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 554/1108] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jul 14 10:41:02 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 10:41:02.983647 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937dd1fd-29b3-4b98-9759-4733b219fc91 None None] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:41:03.084177 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937dd1fd-29b3-4b98-9759-4733b219fc91 None None] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:41:03.117308 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562a91d2-b462-4ca3-afe5-1c2b98d52eaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:41:03.118079 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562a91d2-b462-4ca3-afe5-1c2b98d52eaf None admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:41:03.118361 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562a91d2-b462-4ca3-afe5-1c2b98d52eaf None admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:41:03.118635 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562a91d2-b462-4ca3-afe5-1c2b98d52eaf None admin] PATH_INFO: `/v3/domains/default` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:41:03.119790 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562a91d2-b462-4ca3-afe5-1c2b98d52eaf None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:41:03.121370 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562a91d2-b462-4ca3-afe5-1c2b98d52eaf None admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:41:03.123041 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 555/1109] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Jul 14 10:41:02 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:41:03.128598 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ee0236-b9fb-4669-8006-b3337994c507 None None] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:41:03.188633 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=100 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:41:03.225887 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ee0236-b9fb-4669-8006-b3337994c507 None None] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:41:03.258138 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d153de-d3d2-439a-a8be-c5f8410f9812 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:41:03.258800 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d153de-d3d2-439a-a8be-c5f8410f9812 None admin] REQUEST_METHOD: `POST` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:41:03.259080 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d153de-d3d2-439a-a8be-c5f8410f9812 None admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:41:03.259351 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d153de-d3d2-439a-a8be-c5f8410f9812 None admin] PATH_INFO: `/v3/users` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:41:03.260048 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d153de-d3d2-439a-a8be-c5f8410f9812 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:41:03.261492 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d153de-d3d2-439a-a8be-c5f8410f9812 None admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:41:03.280746 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 555/1110] 10.222.0.16 () {60 vars in 1132 bytes} [Thu Jul 14 10:41:03 2022] POST /identity/v3/users => generated 286 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:41:05.316635 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929db837-21bc-4ed0-9f09-a7b5a101c018 None None] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:41:05.317268 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929db837-21bc-4ed0-9f09-a7b5a101c018 None None] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:41:05.317268 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929db837-21bc-4ed0-9f09-a7b5a101c018 None None] PATH_INFO: `/` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:41:05.318574 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 556/1111] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jul 14 10:41:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:41:05.323609 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7892c7-2174-408b-9683-4539fb6c5312 None None] REQUEST_METHOD: `POST` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:41:05.324049 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7892c7-2174-408b-9683-4539fb6c5312 None None] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:41:05.324189 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7892c7-2174-408b-9683-4539fb6c5312 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:41:05.340998 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.auth.core [None req-2d7892c7-2174-408b-9683-4539fb6c5312 None None] MFA Rules not processed for user `ae4bcdd8106d4bebbdcae96be33505bc`. Rule list: `[]` (Enabled: `True`). {{(pid=86655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:41:05.342172 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-2d7892c7-2174-408b-9683-4539fb6c5312 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:41:05.405853 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 556/1112] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jul 14 10:41:05 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 10:41:05.430202 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929db837-21bc-4ed0-9f09-a7b5a101c018 None None] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:41:05.476374 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=100 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:41:05.528736 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929db837-21bc-4ed0-9f09-a7b5a101c018 None None] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:41:05.561551 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be03704f-781a-4a21-8843-5b720c8ff3c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:41:05.562394 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be03704f-781a-4a21-8843-5b720c8ff3c9 None admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:41:05.562681 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be03704f-781a-4a21-8843-5b720c8ff3c9 None admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:41:05.562957 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be03704f-781a-4a21-8843-5b720c8ff3c9 None admin] PATH_INFO: `/v3/roles/64ec6989f4724a8ab1e32d37c186c8f8` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:41:05.564418 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be03704f-781a-4a21-8843-5b720c8ff3c9 None admin] RBAC: Authorizing `identity:get_role(role_id=64ec6989f4724a8ab1e32d37c186c8f8)` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:41:05.565819 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be03704f-781a-4a21-8843-5b720c8ff3c9 None admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:41:05.567228 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 557/1113] 10.222.0.16 () {56 vars in 1177 bytes} [Thu Jul 14 10:41:05 2022] GET /identity/v3/roles/64ec6989f4724a8ab1e32d37c186c8f8 => generated 223 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:41:05.572875 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7892c7-2174-408b-9683-4539fb6c5312 None None] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:41:05.618902 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:41:05.669865 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7892c7-2174-408b-9683-4539fb6c5312 None None] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:41:05.710117 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f984cdc1-1faf-4434-8256-4891ebdfab02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:41:05.711666 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f984cdc1-1faf-4434-8256-4891ebdfab02 None admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:41:05.712363 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f984cdc1-1faf-4434-8256-4891ebdfab02 None admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:41:05.712712 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f984cdc1-1faf-4434-8256-4891ebdfab02 None admin] PATH_INFO: `/v3/users/1cd10c533df648f3ba206646ab2dd30b` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:41:05.726062 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f984cdc1-1faf-4434-8256-4891ebdfab02 None admin] RBAC: Authorizing `identity:get_user(user_id=1cd10c533df648f3ba206646ab2dd30b)` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:41:05.727482 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f984cdc1-1faf-4434-8256-4891ebdfab02 None admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:41:05.729169 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 557/1114] 10.222.0.16 () {56 vars in 1177 bytes} [Thu Jul 14 10:41:05 2022] GET /identity/v3/users/1cd10c533df648f3ba206646ab2dd30b => generated 286 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:41:05.735367 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be03704f-781a-4a21-8843-5b720c8ff3c9 None admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:41:05.833332 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be03704f-781a-4a21-8843-5b720c8ff3c9 None admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:41:05.846234 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=100 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:41:05.866541 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd9e799-8b55-436a-93d2-32e4a8fa38cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:41:05.867194 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd9e799-8b55-436a-93d2-32e4a8fa38cb None admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:41:05.867481 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd9e799-8b55-436a-93d2-32e4a8fa38cb None admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:41:05.867761 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd9e799-8b55-436a-93d2-32e4a8fa38cb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:41:05.933997 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd9e799-8b55-436a-93d2-32e4a8fa38cb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:41:05.935698 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd9e799-8b55-436a-93d2-32e4a8fa38cb None admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:41:06.028009 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 558/1115] 10.222.0.16 () {58 vars in 1282 bytes} [Thu Jul 14 10:41:05 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 14 10:41:06.033826 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f984cdc1-1faf-4434-8256-4891ebdfab02 None admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:41:06.137562 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f984cdc1-1faf-4434-8256-4891ebdfab02 None admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:41:06.144388 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=100 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:41:06.171296 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4450401-c3ef-442a-a8ba-531b165fbeb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:41:06.172141 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4450401-c3ef-442a-a8ba-531b165fbeb3 None admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:41:06.172420 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4450401-c3ef-442a-a8ba-531b165fbeb3 None admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:41:06.172691 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4450401-c3ef-442a-a8ba-531b165fbeb3 None admin] PATH_INFO: `/v3/projects/a58b4d2a9d4a4acea0a9befaf8473e11` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:41:06.173898 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4450401-c3ef-442a-a8ba-531b165fbeb3 None admin] RBAC: Authorizing `identity:get_project(project_id=a58b4d2a9d4a4acea0a9befaf8473e11)` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:41:06.175309 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4450401-c3ef-442a-a8ba-531b165fbeb3 None admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:41:06.177024 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 558/1116] 10.222.0.16 () {56 vars in 1186 bytes} [Thu Jul 14 10:41:06 2022] GET /identity/v3/projects/a58b4d2a9d4a4acea0a9befaf8473e11 => generated 311 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:41:06.183043 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd9e799-8b55-436a-93d2-32e4a8fa38cb None admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:41:06.197984 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=100 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:41:06.280289 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd9e799-8b55-436a-93d2-32e4a8fa38cb None admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:41:06.313914 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69631ca4-f8dc-4273-9d58-b7777bcb8e8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:41:06.314559 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69631ca4-f8dc-4273-9d58-b7777bcb8e8a None admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:41:06.314848 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69631ca4-f8dc-4273-9d58-b7777bcb8e8a None admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:41:06.315133 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69631ca4-f8dc-4273-9d58-b7777bcb8e8a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:41:06.315960 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69631ca4-f8dc-4273-9d58-b7777bcb8e8a None admin] RBAC: Adding query filter params (role.id=64ec6989f4724a8ab1e32d37c186c8f8, scope.project.id=a58b4d2a9d4a4acea0a9befaf8473e11, user.id=1cd10c533df648f3ba206646ab2dd30b) {{(pid=86656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:41:06.316273 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69631ca4-f8dc-4273-9d58-b7777bcb8e8a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:41:06.317725 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69631ca4-f8dc-4273-9d58-b7777bcb8e8a None admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:41:06.323054 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 559/1117] 10.222.0.16 () {56 vars in 1374 bytes} [Thu Jul 14 10:41:06 2022] GET /identity/v3/role_assignments?user.id=1cd10c533df648f3ba206646ab2dd30b&scope.project.id=a58b4d2a9d4a4acea0a9befaf8473e11&role.id=64ec6989f4724a8ab1e32d37c186c8f8 => generated 259 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:41:08.304624 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ce196a-166a-4ba9-9bf6-98a2ada432ad None None] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:41:08.305250 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ce196a-166a-4ba9-9bf6-98a2ada432ad None None] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:41:08.305250 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ce196a-166a-4ba9-9bf6-98a2ada432ad None None] PATH_INFO: `/` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:41:08.306585 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 559/1118] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jul 14 10:41:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:41:08.312248 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227e40f3-3278-4b2d-ae9f-95521b982c72 None None] REQUEST_METHOD: `POST` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:41:08.312649 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227e40f3-3278-4b2d-ae9f-95521b982c72 None None] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:41:08.312834 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227e40f3-3278-4b2d-ae9f-95521b982c72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:41:08.329155 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.auth.core [None req-227e40f3-3278-4b2d-ae9f-95521b982c72 None None] MFA Rules not processed for user `ae4bcdd8106d4bebbdcae96be33505bc`. Rule list: `[]` (Enabled: `True`). {{(pid=86656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:41:08.330328 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-227e40f3-3278-4b2d-ae9f-95521b982c72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:41:08.393011 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 560/1119] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jul 14 10:41:08 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 10:41:08.415343 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ce196a-166a-4ba9-9bf6-98a2ada432ad None None] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:41:08.515858 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ce196a-166a-4ba9-9bf6-98a2ada432ad None None] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:41:08.548317 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f826948f-3c30-49fe-823e-c19518f098c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:41:08.549189 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f826948f-3c30-49fe-823e-c19518f098c4 None admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:41:08.549478 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f826948f-3c30-49fe-823e-c19518f098c4 None admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:41:08.549758 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f826948f-3c30-49fe-823e-c19518f098c4 None admin] PATH_INFO: `/v3/roles/64ec6989f4724a8ab1e32d37c186c8f8` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:41:08.551221 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f826948f-3c30-49fe-823e-c19518f098c4 None admin] RBAC: Authorizing `identity:get_role(role_id=64ec6989f4724a8ab1e32d37c186c8f8)` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:41:08.552581 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f826948f-3c30-49fe-823e-c19518f098c4 None admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:41:08.553966 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 560/1120] 10.222.0.16 () {56 vars in 1177 bytes} [Thu Jul 14 10:41:08 2022] GET /identity/v3/roles/64ec6989f4724a8ab1e32d37c186c8f8 => generated 223 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:41:08.560533 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227e40f3-3278-4b2d-ae9f-95521b982c72 None None] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:41:08.570351 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=100 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:41:08.657050 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227e40f3-3278-4b2d-ae9f-95521b982c72 None None] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:41:08.690067 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e61e14-abdd-4eae-9ead-fbf711891b23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:41:08.690928 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e61e14-abdd-4eae-9ead-fbf711891b23 None admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:41:08.691212 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e61e14-abdd-4eae-9ead-fbf711891b23 None admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:41:08.691485 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e61e14-abdd-4eae-9ead-fbf711891b23 None admin] PATH_INFO: `/v3/users/1cd10c533df648f3ba206646ab2dd30b` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:41:08.692657 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e61e14-abdd-4eae-9ead-fbf711891b23 None admin] RBAC: Authorizing `identity:get_user(user_id=1cd10c533df648f3ba206646ab2dd30b)` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:41:08.694112 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e61e14-abdd-4eae-9ead-fbf711891b23 None admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:41:08.695730 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 561/1121] 10.222.0.16 () {56 vars in 1177 bytes} [Thu Jul 14 10:41:08 2022] GET /identity/v3/users/1cd10c533df648f3ba206646ab2dd30b => generated 286 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:41:08.702239 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f826948f-3c30-49fe-823e-c19518f098c4 None admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:41:08.743947 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=100 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:41:08.799843 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f826948f-3c30-49fe-823e-c19518f098c4 None admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:41:08.835061 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e52c52e-e178-4530-be10-bfa1e0816f0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:41:08.835860 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e52c52e-e178-4530-be10-bfa1e0816f0e None admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:41:08.836149 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e52c52e-e178-4530-be10-bfa1e0816f0e None admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:41:08.836429 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e52c52e-e178-4530-be10-bfa1e0816f0e None admin] PATH_INFO: `/v3/projects/a58b4d2a9d4a4acea0a9befaf8473e11` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:41:08.837761 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e52c52e-e178-4530-be10-bfa1e0816f0e None admin] RBAC: Authorizing `identity:get_project(project_id=a58b4d2a9d4a4acea0a9befaf8473e11)` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:41:08.839195 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e52c52e-e178-4530-be10-bfa1e0816f0e None admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:41:08.841915 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 561/1122] 10.222.0.16 () {56 vars in 1186 bytes} [Thu Jul 14 10:41:08 2022] GET /identity/v3/projects/a58b4d2a9d4a4acea0a9befaf8473e11 => generated 311 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:41:08.847704 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e61e14-abdd-4eae-9ead-fbf711891b23 None admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:41:08.924313 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=100 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:41:08.946943 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e61e14-abdd-4eae-9ead-fbf711891b23 None admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:41:08.979281 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0854d4-ad93-4356-a7f0-2037121a0e0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:41:08.980155 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0854d4-ad93-4356-a7f0-2037121a0e0e None admin] REQUEST_METHOD: `PUT` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:41:08.980967 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0854d4-ad93-4356-a7f0-2037121a0e0e None admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:41:08.981262 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0854d4-ad93-4356-a7f0-2037121a0e0e None admin] PATH_INFO: `/v3/projects/a58b4d2a9d4a4acea0a9befaf8473e11/users/1cd10c533df648f3ba206646ab2dd30b/roles/64ec6989f4724a8ab1e32d37c186c8f8` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:41:08.983399 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0854d4-ad93-4356-a7f0-2037121a0e0e None admin] RBAC: Authorizing `identity:create_grant(project_id=a58b4d2a9d4a4acea0a9befaf8473e11, user_id=1cd10c533df648f3ba206646ab2dd30b, role_id=64ec6989f4724a8ab1e32d37c186c8f8)` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:41:08.984846 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0854d4-ad93-4356-a7f0-2037121a0e0e None admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:41:08.997453 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 562/1123] 10.222.0.16 () {58 vars in 1439 bytes} [Thu Jul 14 10:41:08 2022] PUT /identity/v3/projects/a58b4d2a9d4a4acea0a9befaf8473e11/users/1cd10c533df648f3ba206646ab2dd30b/roles/64ec6989f4724a8ab1e32d37c186c8f8 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:41:10.997133 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c60e7a2-06f0-4561-b030-d29d4ed713c6 None None] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:41:10.997679 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c60e7a2-06f0-4561-b030-d29d4ed713c6 None None] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:41:10.997679 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c60e7a2-06f0-4561-b030-d29d4ed713c6 None None] PATH_INFO: `/` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:41:10.999057 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 562/1124] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jul 14 10:41:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:41:11.004226 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3aeac0e-b053-48e2-a9ee-085ae4644839 None None] REQUEST_METHOD: `POST` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:41:11.004657 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3aeac0e-b053-48e2-a9ee-085ae4644839 None None] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:41:11.004797 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3aeac0e-b053-48e2-a9ee-085ae4644839 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:41:11.022001 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.auth.core [None req-c3aeac0e-b053-48e2-a9ee-085ae4644839 None None] MFA Rules not processed for user `ae4bcdd8106d4bebbdcae96be33505bc`. Rule list: `[]` (Enabled: `True`). {{(pid=86656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:41:11.023185 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-c3aeac0e-b053-48e2-a9ee-085ae4644839 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:41:11.094100 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 563/1125] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jul 14 10:41:11 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 10:41:11.116974 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c60e7a2-06f0-4561-b030-d29d4ed713c6 None None] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:41:11.214538 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c60e7a2-06f0-4561-b030-d29d4ed713c6 None None] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:41:11.224697 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=100 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:41:11.247703 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3893e7c6-4b20-4564-8d99-86b89804b215 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:41:11.248558 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3893e7c6-4b20-4564-8d99-86b89804b215 None admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:41:11.248873 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3893e7c6-4b20-4564-8d99-86b89804b215 None admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:41:11.249152 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3893e7c6-4b20-4564-8d99-86b89804b215 None admin] PATH_INFO: `/v3/roles/64ec6989f4724a8ab1e32d37c186c8f8` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:41:11.250610 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3893e7c6-4b20-4564-8d99-86b89804b215 None admin] RBAC: Authorizing `identity:get_role(role_id=64ec6989f4724a8ab1e32d37c186c8f8)` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:41:11.251967 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3893e7c6-4b20-4564-8d99-86b89804b215 None admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:41:11.253360 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 563/1126] 10.222.0.16 () {56 vars in 1177 bytes} [Thu Jul 14 10:41:11 2022] GET /identity/v3/roles/64ec6989f4724a8ab1e32d37c186c8f8 => generated 223 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:41:11.259073 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3aeac0e-b053-48e2-a9ee-085ae4644839 None None] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:41:11.321431 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:41:11.355611 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3aeac0e-b053-48e2-a9ee-085ae4644839 None None] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:41:11.388237 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2250bb9e-52d0-48a6-aa16-f09e09bf88ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:41:11.389109 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2250bb9e-52d0-48a6-aa16-f09e09bf88ea None admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:41:11.389393 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2250bb9e-52d0-48a6-aa16-f09e09bf88ea None admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:41:11.389663 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2250bb9e-52d0-48a6-aa16-f09e09bf88ea None admin] PATH_INFO: `/v3/users/1cd10c533df648f3ba206646ab2dd30b` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:41:11.390825 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2250bb9e-52d0-48a6-aa16-f09e09bf88ea None admin] RBAC: Authorizing `identity:get_user(user_id=1cd10c533df648f3ba206646ab2dd30b)` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:41:11.392251 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2250bb9e-52d0-48a6-aa16-f09e09bf88ea None admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:41:11.393872 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 564/1127] 10.222.0.16 () {56 vars in 1177 bytes} [Thu Jul 14 10:41:11 2022] GET /identity/v3/users/1cd10c533df648f3ba206646ab2dd30b => generated 286 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:41:11.399463 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3893e7c6-4b20-4564-8d99-86b89804b215 None admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:41:11.494956 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3893e7c6-4b20-4564-8d99-86b89804b215 None admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:41:11.527915 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66885fc8-2c8a-48c6-a27a-a1e57f7cde9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:41:11.528547 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66885fc8-2c8a-48c6-a27a-a1e57f7cde9b None admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:41:11.528860 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66885fc8-2c8a-48c6-a27a-a1e57f7cde9b None admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:41:11.529144 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66885fc8-2c8a-48c6-a27a-a1e57f7cde9b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:41:11.572577 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=100 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:41:11.594616 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66885fc8-2c8a-48c6-a27a-a1e57f7cde9b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:41:11.596048 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66885fc8-2c8a-48c6-a27a-a1e57f7cde9b None admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:41:11.691098 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 564/1128] 10.222.0.16 () {58 vars in 1282 bytes} [Thu Jul 14 10:41:11 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 14 10:41:11.696843 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2250bb9e-52d0-48a6-aa16-f09e09bf88ea None admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:41:11.792946 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2250bb9e-52d0-48a6-aa16-f09e09bf88ea None admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:41:11.826198 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346c01ce-420c-40de-920c-39e157dadbc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:41:11.827040 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346c01ce-420c-40de-920c-39e157dadbc7 None admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:41:11.827319 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346c01ce-420c-40de-920c-39e157dadbc7 None admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:41:11.827591 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346c01ce-420c-40de-920c-39e157dadbc7 None admin] PATH_INFO: `/v3/projects/a58b4d2a9d4a4acea0a9befaf8473e11` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:41:11.828746 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346c01ce-420c-40de-920c-39e157dadbc7 None admin] RBAC: Authorizing `identity:get_project(project_id=a58b4d2a9d4a4acea0a9befaf8473e11)` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:41:11.830193 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346c01ce-420c-40de-920c-39e157dadbc7 None admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:41:11.831875 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 565/1129] 10.222.0.16 () {56 vars in 1186 bytes} [Thu Jul 14 10:41:11 2022] GET /identity/v3/projects/a58b4d2a9d4a4acea0a9befaf8473e11 => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:41:11.837890 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66885fc8-2c8a-48c6-a27a-a1e57f7cde9b None admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:41:11.914510 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=100 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:41:11.935973 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66885fc8-2c8a-48c6-a27a-a1e57f7cde9b None admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:41:11.969607 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fef0a59-d177-43d3-87eb-3e192275adab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:41:11.970198 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fef0a59-d177-43d3-87eb-3e192275adab None admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:41:11.970489 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fef0a59-d177-43d3-87eb-3e192275adab None admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:41:11.970771 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fef0a59-d177-43d3-87eb-3e192275adab None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:41:11.971612 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fef0a59-d177-43d3-87eb-3e192275adab None admin] RBAC: Adding query filter params (role.id=64ec6989f4724a8ab1e32d37c186c8f8, scope.project.id=a58b4d2a9d4a4acea0a9befaf8473e11, user.id=1cd10c533df648f3ba206646ab2dd30b) {{(pid=86655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:41:11.971925 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fef0a59-d177-43d3-87eb-3e192275adab None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:41:11.973457 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fef0a59-d177-43d3-87eb-3e192275adab None admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:41:11.979151 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 565/1130] 10.222.0.16 () {56 vars in 1374 bytes} [Thu Jul 14 10:41:11 2022] GET /identity/v3/role_assignments?user.id=1cd10c533df648f3ba206646ab2dd30b&scope.project.id=a58b4d2a9d4a4acea0a9befaf8473e11&role.id=64ec6989f4724a8ab1e32d37c186c8f8 => generated 608 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:41:14.031713 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89c0abd-d46e-42d5-b249-461783d74ad1 None None] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:41:14.032305 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89c0abd-d46e-42d5-b249-461783d74ad1 None None] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:41:14.032305 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89c0abd-d46e-42d5-b249-461783d74ad1 None None] PATH_INFO: `/` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:41:14.033659 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 566/1131] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jul 14 10:41:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:41:14.038748 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7c60a0-e1bf-4207-ae82-cc024cb2acc1 None None] REQUEST_METHOD: `POST` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:41:14.039146 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7c60a0-e1bf-4207-ae82-cc024cb2acc1 None None] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:41:14.039318 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7c60a0-e1bf-4207-ae82-cc024cb2acc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:41:14.055758 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.auth.core [None req-0e7c60a0-e1bf-4207-ae82-cc024cb2acc1 None None] MFA Rules not processed for user `ae4bcdd8106d4bebbdcae96be33505bc`. Rule list: `[]` (Enabled: `True`). {{(pid=86655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:41:14.056979 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-0e7c60a0-e1bf-4207-ae82-cc024cb2acc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:41:14.121749 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 566/1132] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jul 14 10:41:14 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 10:41:14.144919 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89c0abd-d46e-42d5-b249-461783d74ad1 None None] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:41:14.147742 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=100 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:41:14.243839 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89c0abd-d46e-42d5-b249-461783d74ad1 None None] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:41:14.276279 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129d0772-9c6e-4c30-9d74-a41173bb5b23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:41:14.277148 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129d0772-9c6e-4c30-9d74-a41173bb5b23 None admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:41:14.277434 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129d0772-9c6e-4c30-9d74-a41173bb5b23 None admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:41:14.277708 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129d0772-9c6e-4c30-9d74-a41173bb5b23 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:41:14.278877 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129d0772-9c6e-4c30-9d74-a41173bb5b23 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:41:14.280673 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129d0772-9c6e-4c30-9d74-a41173bb5b23 None admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:41:14.282383 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 567/1133] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Jul 14 10:41:14 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:41:14.288249 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7c60a0-e1bf-4207-ae82-cc024cb2acc1 None None] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:41:14.357508 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=100 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:41:14.386031 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7c60a0-e1bf-4207-ae82-cc024cb2acc1 None None] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:41:14.418946 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70426602-775e-4d24-9376-838663902a28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:41:14.419603 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70426602-775e-4d24-9376-838663902a28 None admin] REQUEST_METHOD: `POST` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:41:14.419891 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70426602-775e-4d24-9376-838663902a28 None admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:41:14.420172 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70426602-775e-4d24-9376-838663902a28 None admin] PATH_INFO: `/v3/projects` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:41:14.420910 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70426602-775e-4d24-9376-838663902a28 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:41:14.422328 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70426602-775e-4d24-9376-838663902a28 None admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:41:14.447989 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 567/1134] 10.222.0.16 () {60 vars in 1141 bytes} [Thu Jul 14 10:41:14 2022] POST /identity/v3/projects => generated 311 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:41:16.515022 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3bfbb1-3444-406b-aee1-7ab46a0b795b None None] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:41:16.515566 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3bfbb1-3444-406b-aee1-7ab46a0b795b None None] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:41:16.515566 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3bfbb1-3444-406b-aee1-7ab46a0b795b None None] PATH_INFO: `/` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:41:16.517000 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 568/1135] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jul 14 10:41:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:41:16.522022 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f57949-5271-4393-b50c-04c9875088b7 None None] REQUEST_METHOD: `POST` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:41:16.522404 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f57949-5271-4393-b50c-04c9875088b7 None None] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:41:16.522591 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f57949-5271-4393-b50c-04c9875088b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:41:16.539548 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.auth.core [None req-f3f57949-5271-4393-b50c-04c9875088b7 None None] MFA Rules not processed for user `ae4bcdd8106d4bebbdcae96be33505bc`. Rule list: `[]` (Enabled: `True`). {{(pid=86655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:41:16.540731 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-f3f57949-5271-4393-b50c-04c9875088b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:41:16.604562 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 568/1136] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jul 14 10:41:16 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 10:41:16.629307 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3bfbb1-3444-406b-aee1-7ab46a0b795b None None] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:41:16.699226 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=100 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:41:16.737355 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3bfbb1-3444-406b-aee1-7ab46a0b795b None None] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:41:16.771606 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed84198-c1fa-4d89-8fba-3f11592cf2db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:41:16.772331 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed84198-c1fa-4d89-8fba-3f11592cf2db None admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:41:16.772619 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed84198-c1fa-4d89-8fba-3f11592cf2db None admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:41:16.772992 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed84198-c1fa-4d89-8fba-3f11592cf2db None admin] PATH_INFO: `/v3/domains/default` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:41:16.774170 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed84198-c1fa-4d89-8fba-3f11592cf2db None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:41:16.775613 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed84198-c1fa-4d89-8fba-3f11592cf2db None admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:41:16.777946 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 569/1137] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Jul 14 10:41:16 2022] GET /identity/v3/domains/default => generated 199 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:41:16.783489 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f57949-5271-4393-b50c-04c9875088b7 None None] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:41:16.836727 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:41:16.880633 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f57949-5271-4393-b50c-04c9875088b7 None None] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:41:16.913585 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac87b3f0-36d1-4332-8a53-55e384e15cb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:41:16.914250 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac87b3f0-36d1-4332-8a53-55e384e15cb7 None admin] REQUEST_METHOD: `POST` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:41:16.914536 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac87b3f0-36d1-4332-8a53-55e384e15cb7 None admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:41:16.914814 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac87b3f0-36d1-4332-8a53-55e384e15cb7 None admin] PATH_INFO: `/v3/users` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:41:16.915531 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac87b3f0-36d1-4332-8a53-55e384e15cb7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:41:16.916981 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac87b3f0-36d1-4332-8a53-55e384e15cb7 None admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:41:16.936271 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 569/1138] 10.222.0.16 () {60 vars in 1132 bytes} [Thu Jul 14 10:41:16 2022] POST /identity/v3/users => generated 286 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:41:18.970172 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b73104e-51a6-4154-bb2b-f3c8242ba01a None None] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:41:18.970721 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b73104e-51a6-4154-bb2b-f3c8242ba01a None None] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:41:18.970721 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b73104e-51a6-4154-bb2b-f3c8242ba01a None None] PATH_INFO: `/` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:41:18.972115 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 570/1139] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jul 14 10:41:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:41:18.977124 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e03296-cd72-485b-9b33-f2e3c0814ed9 None None] REQUEST_METHOD: `POST` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:41:18.977501 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e03296-cd72-485b-9b33-f2e3c0814ed9 None None] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:41:18.977682 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e03296-cd72-485b-9b33-f2e3c0814ed9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:41:18.994236 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.auth.core [None req-a4e03296-cd72-485b-9b33-f2e3c0814ed9 None None] MFA Rules not processed for user `ae4bcdd8106d4bebbdcae96be33505bc`. Rule list: `[]` (Enabled: `True`). {{(pid=86655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:41:18.995941 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-a4e03296-cd72-485b-9b33-f2e3c0814ed9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:41:19.060202 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 570/1140] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jul 14 10:41:18 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 10:41:19.083892 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b73104e-51a6-4154-bb2b-f3c8242ba01a None None] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:41:19.181573 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b73104e-51a6-4154-bb2b-f3c8242ba01a None None] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:41:19.214320 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4ce58e-6900-42ae-be47-103d27899987 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:41:19.215179 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4ce58e-6900-42ae-be47-103d27899987 None admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:41:19.215463 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4ce58e-6900-42ae-be47-103d27899987 None admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:41:19.215740 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4ce58e-6900-42ae-be47-103d27899987 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:41:19.222273 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=100 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:41:19.226149 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4ce58e-6900-42ae-be47-103d27899987 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 10:41:19.234497 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application [None req-9a4ce58e-6900-42ae-be47-103d27899987 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 10:41:19.234497 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:41:19.234497 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:41:19.234497 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:41:19.234497 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:41:19.234497 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:41:19.234497 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:41:19.234497 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:41:19.234497 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:41:19.234497 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:41:19.234497 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:41:19.234497 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:41:19.234497 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 10:41:19.234497 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 10:41:19.234497 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 10:41:19.234497 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 10:41:19.235648 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 10:41:19.235648 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 10:41:19.235648 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 10:41:19.235648 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 10:41:19.235648 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:41:19.235648 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:41:19.235648 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:41:19.235648 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:41:19.235648 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:41:19.235648 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:41:19.235648 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:41:19.235648 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application with Lock( Jul 14 10:41:19.235648 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:41:19.235648 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:41:19.235648 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:41:19.235648 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:41:19.236796 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:41:19.236796 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:41:19.236796 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:41:19.236796 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:41:19.236796 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 10:41:19.236796 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 10:41:19.236796 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 10:41:19.236796 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 10:41:19.236796 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 10:41:19.236796 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 10:41:19.236796 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 10:41:19.236796 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application Jul 14 10:41:19.236796 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 571/1141] 10.222.0.16 () {56 vars in 1096 bytes} [Thu Jul 14 10:41:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:41:19.241619 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e03296-cd72-485b-9b33-f2e3c0814ed9 None None] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:41:19.282474 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:41:19.338779 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e03296-cd72-485b-9b33-f2e3c0814ed9 None None] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:41:19.371178 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866bf4f7-2b7a-41c4-b98f-f0d7ea90c6d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:41:19.371835 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866bf4f7-2b7a-41c4-b98f-f0d7ea90c6d5 None admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:41:19.372118 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866bf4f7-2b7a-41c4-b98f-f0d7ea90c6d5 None admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:41:19.372394 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866bf4f7-2b7a-41c4-b98f-f0d7ea90c6d5 None admin] PATH_INFO: `/v3/roles` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:41:19.373174 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866bf4f7-2b7a-41c4-b98f-f0d7ea90c6d5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:41:19.373483 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866bf4f7-2b7a-41c4-b98f-f0d7ea90c6d5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:41:19.374840 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866bf4f7-2b7a-41c4-b98f-f0d7ea90c6d5 None admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:41:19.382606 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 571/1142] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Jul 14 10:41:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:41:19.389623 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4ce58e-6900-42ae-be47-103d27899987 None admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:41:19.486937 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4ce58e-6900-42ae-be47-103d27899987 None admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:41:19.519186 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd87083f-9963-415e-be2b-0da60e76bb5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:41:19.520040 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd87083f-9963-415e-be2b-0da60e76bb5b None admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:41:19.520328 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd87083f-9963-415e-be2b-0da60e76bb5b None admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:41:19.520606 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd87083f-9963-415e-be2b-0da60e76bb5b None admin] PATH_INFO: `/v3/users/0a6c0e920f30493a94f005827d3b1f6d` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:41:19.533270 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd87083f-9963-415e-be2b-0da60e76bb5b None admin] RBAC: Authorizing `identity:get_user(user_id=0a6c0e920f30493a94f005827d3b1f6d)` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:41:19.534723 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd87083f-9963-415e-be2b-0da60e76bb5b None admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:41:19.536366 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 572/1143] 10.222.0.16 () {56 vars in 1177 bytes} [Thu Jul 14 10:41:19 2022] GET /identity/v3/users/0a6c0e920f30493a94f005827d3b1f6d => generated 286 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:41:19.542005 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866bf4f7-2b7a-41c4-b98f-f0d7ea90c6d5 None admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:41:19.641974 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866bf4f7-2b7a-41c4-b98f-f0d7ea90c6d5 None admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:41:19.643390 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=100 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:41:19.676016 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e597be-6a4c-421c-9a60-c451da7987b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:41:19.676665 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e597be-6a4c-421c-9a60-c451da7987b0 None admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:41:19.676978 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e597be-6a4c-421c-9a60-c451da7987b0 None admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:41:19.677265 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e597be-6a4c-421c-9a60-c451da7987b0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:41:19.742161 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e597be-6a4c-421c-9a60-c451da7987b0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:41:19.743593 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e597be-6a4c-421c-9a60-c451da7987b0 None admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:41:19.837687 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 572/1144] 10.222.0.16 () {58 vars in 1282 bytes} [Thu Jul 14 10:41:19 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 14 10:41:19.844136 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd87083f-9963-415e-be2b-0da60e76bb5b None admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:41:19.899018 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=100 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:41:19.942661 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd87083f-9963-415e-be2b-0da60e76bb5b None admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:41:19.975747 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67468e0-5305-4c1e-a6cd-d2dba068c506 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:41:19.976601 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67468e0-5305-4c1e-a6cd-d2dba068c506 None admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:41:19.976916 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67468e0-5305-4c1e-a6cd-d2dba068c506 None admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:41:19.977198 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67468e0-5305-4c1e-a6cd-d2dba068c506 None admin] PATH_INFO: `/v3/projects/b0d13a7c3cd74a2ba6da659bae695915` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:41:19.978374 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67468e0-5305-4c1e-a6cd-d2dba068c506 None admin] RBAC: Authorizing `identity:get_project(project_id=b0d13a7c3cd74a2ba6da659bae695915)` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:41:19.979849 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67468e0-5305-4c1e-a6cd-d2dba068c506 None admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:41:19.981581 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 573/1145] 10.222.0.16 () {56 vars in 1186 bytes} [Thu Jul 14 10:41:19 2022] GET /identity/v3/projects/b0d13a7c3cd74a2ba6da659bae695915 => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:41:19.987541 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e597be-6a4c-421c-9a60-c451da7987b0 None admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:41:19.989723 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=100 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:41:20.084963 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e597be-6a4c-421c-9a60-c451da7987b0 None admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:41:20.118585 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e78ff9e-6688-403d-9ee9-86f8d8cc3316 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:41:20.119231 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e78ff9e-6688-403d-9ee9-86f8d8cc3316 None admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:41:20.119516 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e78ff9e-6688-403d-9ee9-86f8d8cc3316 None admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:41:20.119793 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e78ff9e-6688-403d-9ee9-86f8d8cc3316 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:41:20.120803 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e78ff9e-6688-403d-9ee9-86f8d8cc3316 None admin] RBAC: Adding query filter params (role.id=153539819e5542df99269d2913bbecfb, scope.project.id=b0d13a7c3cd74a2ba6da659bae695915, user.id=0a6c0e920f30493a94f005827d3b1f6d) {{(pid=86655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:41:20.121136 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e78ff9e-6688-403d-9ee9-86f8d8cc3316 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:41:20.122562 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e78ff9e-6688-403d-9ee9-86f8d8cc3316 None admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:41:20.127831 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 573/1146] 10.222.0.16 () {56 vars in 1374 bytes} [Thu Jul 14 10:41:19 2022] GET /identity/v3/role_assignments?user.id=0a6c0e920f30493a94f005827d3b1f6d&scope.project.id=b0d13a7c3cd74a2ba6da659bae695915&role.id=153539819e5542df99269d2913bbecfb => generated 259 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:41:22.093690 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ceac55-8d57-491c-93ad-5cdb4fc23920 None None] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:41:22.094202 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ceac55-8d57-491c-93ad-5cdb4fc23920 None None] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:41:22.094292 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ceac55-8d57-491c-93ad-5cdb4fc23920 None None] PATH_INFO: `/` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:41:22.095619 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 574/1147] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jul 14 10:41:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:41:22.100832 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47493d1-7de9-4dda-ab8f-503ddf88a74b None None] REQUEST_METHOD: `POST` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:41:22.101235 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47493d1-7de9-4dda-ab8f-503ddf88a74b None None] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:41:22.101399 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47493d1-7de9-4dda-ab8f-503ddf88a74b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:41:22.119006 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.auth.core [None req-e47493d1-7de9-4dda-ab8f-503ddf88a74b None None] MFA Rules not processed for user `ae4bcdd8106d4bebbdcae96be33505bc`. Rule list: `[]` (Enabled: `True`). {{(pid=86655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:41:22.120738 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-e47493d1-7de9-4dda-ab8f-503ddf88a74b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:41:22.177393 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=100 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:41:22.185674 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 574/1148] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jul 14 10:41:22 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 10:41:22.207737 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ceac55-8d57-491c-93ad-5cdb4fc23920 None None] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:41:22.303923 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ceac55-8d57-491c-93ad-5cdb4fc23920 None None] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:41:22.326626 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=100 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:41:22.337035 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ae886e-d86c-4fab-8ac5-ad053eafce5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:41:22.337818 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ae886e-d86c-4fab-8ac5-ad053eafce5a None admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:41:22.338099 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ae886e-d86c-4fab-8ac5-ad053eafce5a None admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:41:22.338401 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ae886e-d86c-4fab-8ac5-ad053eafce5a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:41:22.348716 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ae886e-d86c-4fab-8ac5-ad053eafce5a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 10:41:22.356367 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application [None req-24ae886e-d86c-4fab-8ac5-ad053eafce5a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 10:41:22.356367 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:41:22.356367 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:41:22.356367 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:41:22.356367 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:41:22.356367 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:41:22.356367 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:41:22.356367 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:41:22.356367 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:41:22.356367 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:41:22.356367 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:41:22.356367 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:41:22.356367 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 10:41:22.356367 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 10:41:22.356367 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 10:41:22.356367 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 10:41:22.357468 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 10:41:22.357468 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 10:41:22.357468 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 10:41:22.357468 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 10:41:22.357468 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:41:22.357468 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:41:22.357468 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:41:22.357468 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:41:22.357468 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:41:22.357468 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:41:22.357468 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:41:22.357468 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application with Lock( Jul 14 10:41:22.357468 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:41:22.357468 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:41:22.357468 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:41:22.357468 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:41:22.358372 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:41:22.358372 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:41:22.358372 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:41:22.358372 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:41:22.358372 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 10:41:22.358372 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 10:41:22.358372 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 10:41:22.358372 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 10:41:22.358372 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 10:41:22.358372 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 10:41:22.358372 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 10:41:22.358372 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application Jul 14 10:41:22.358372 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 575/1149] 10.222.0.16 () {56 vars in 1096 bytes} [Thu Jul 14 10:41:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:41:22.363559 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47493d1-7de9-4dda-ab8f-503ddf88a74b None None] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:41:22.458413 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47493d1-7de9-4dda-ab8f-503ddf88a74b None None] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:41:22.491088 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8922c34d-b76f-4486-a75e-a4494c16e037 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:41:22.491738 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8922c34d-b76f-4486-a75e-a4494c16e037 None admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:41:22.492020 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8922c34d-b76f-4486-a75e-a4494c16e037 None admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:41:22.492311 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8922c34d-b76f-4486-a75e-a4494c16e037 None admin] PATH_INFO: `/v3/roles` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:41:22.493079 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8922c34d-b76f-4486-a75e-a4494c16e037 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:41:22.493384 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8922c34d-b76f-4486-a75e-a4494c16e037 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:41:22.494730 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8922c34d-b76f-4486-a75e-a4494c16e037 None admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:41:22.502602 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 575/1150] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Jul 14 10:41:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:41:22.508104 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ae886e-d86c-4fab-8ac5-ad053eafce5a None admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:41:22.607732 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ae886e-d86c-4fab-8ac5-ad053eafce5a None admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:41:22.640062 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582d1fde-2e09-49f9-9ffc-d54881c25d7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:41:22.640955 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582d1fde-2e09-49f9-9ffc-d54881c25d7f None admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:41:22.641236 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582d1fde-2e09-49f9-9ffc-d54881c25d7f None admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:41:22.641504 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582d1fde-2e09-49f9-9ffc-d54881c25d7f None admin] PATH_INFO: `/v3/users/0a6c0e920f30493a94f005827d3b1f6d` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:41:22.642676 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582d1fde-2e09-49f9-9ffc-d54881c25d7f None admin] RBAC: Authorizing `identity:get_user(user_id=0a6c0e920f30493a94f005827d3b1f6d)` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:41:22.644091 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582d1fde-2e09-49f9-9ffc-d54881c25d7f None admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:41:22.645728 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 576/1151] 10.222.0.16 () {56 vars in 1177 bytes} [Thu Jul 14 10:41:22 2022] GET /identity/v3/users/0a6c0e920f30493a94f005827d3b1f6d => generated 286 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:41:22.651661 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8922c34d-b76f-4486-a75e-a4494c16e037 None admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:41:22.708052 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=100 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:41:22.748395 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8922c34d-b76f-4486-a75e-a4494c16e037 None admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:41:22.782597 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2292705d-8990-4726-91c6-026ae8bfd22d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:41:22.783726 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2292705d-8990-4726-91c6-026ae8bfd22d None admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:41:22.784015 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2292705d-8990-4726-91c6-026ae8bfd22d None admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:41:22.784317 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2292705d-8990-4726-91c6-026ae8bfd22d None admin] PATH_INFO: `/v3/projects/b0d13a7c3cd74a2ba6da659bae695915` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:41:22.785531 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2292705d-8990-4726-91c6-026ae8bfd22d None admin] RBAC: Authorizing `identity:get_project(project_id=b0d13a7c3cd74a2ba6da659bae695915)` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:41:22.786972 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2292705d-8990-4726-91c6-026ae8bfd22d None admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:41:22.788699 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 576/1152] 10.222.0.16 () {56 vars in 1186 bytes} [Thu Jul 14 10:41:22 2022] GET /identity/v3/projects/b0d13a7c3cd74a2ba6da659bae695915 => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:41:22.795090 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582d1fde-2e09-49f9-9ffc-d54881c25d7f None admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:41:22.846465 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=100 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:41:22.892135 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582d1fde-2e09-49f9-9ffc-d54881c25d7f None admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:41:22.925103 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e00bff-2190-437f-83c1-b5b5cef84a9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:41:22.925987 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e00bff-2190-437f-83c1-b5b5cef84a9b None admin] REQUEST_METHOD: `PUT` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:41:22.926271 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e00bff-2190-437f-83c1-b5b5cef84a9b None admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:41:22.926548 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e00bff-2190-437f-83c1-b5b5cef84a9b None admin] PATH_INFO: `/v3/projects/b0d13a7c3cd74a2ba6da659bae695915/users/0a6c0e920f30493a94f005827d3b1f6d/roles/153539819e5542df99269d2913bbecfb` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:41:22.928482 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e00bff-2190-437f-83c1-b5b5cef84a9b None admin] RBAC: Authorizing `identity:create_grant(project_id=b0d13a7c3cd74a2ba6da659bae695915, user_id=0a6c0e920f30493a94f005827d3b1f6d, role_id=153539819e5542df99269d2913bbecfb)` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:41:22.929949 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e00bff-2190-437f-83c1-b5b5cef84a9b None admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:41:22.942761 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 577/1153] 10.222.0.16 () {58 vars in 1439 bytes} [Thu Jul 14 10:41:22 2022] PUT /identity/v3/projects/b0d13a7c3cd74a2ba6da659bae695915/users/0a6c0e920f30493a94f005827d3b1f6d/roles/153539819e5542df99269d2913bbecfb => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:41:24.942683 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0e6e2a-5043-4059-91da-abaf6059d7aa None None] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:41:24.943222 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0e6e2a-5043-4059-91da-abaf6059d7aa None None] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:41:24.943222 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0e6e2a-5043-4059-91da-abaf6059d7aa None None] PATH_INFO: `/` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:41:24.944597 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 577/1154] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jul 14 10:41:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:41:24.950408 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421cfdcc-22c7-4580-9b15-3efcbbbe1b3d None None] REQUEST_METHOD: `POST` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:41:24.950781 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421cfdcc-22c7-4580-9b15-3efcbbbe1b3d None None] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:41:24.950977 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421cfdcc-22c7-4580-9b15-3efcbbbe1b3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:41:24.967508 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.auth.core [None req-421cfdcc-22c7-4580-9b15-3efcbbbe1b3d None None] MFA Rules not processed for user `ae4bcdd8106d4bebbdcae96be33505bc`. Rule list: `[]` (Enabled: `True`). {{(pid=86656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:41:24.968696 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-421cfdcc-22c7-4580-9b15-3efcbbbe1b3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:41:25.033525 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 578/1155] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jul 14 10:41:24 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 10:41:25.056378 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0e6e2a-5043-4059-91da-abaf6059d7aa None None] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:41:25.155649 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0e6e2a-5043-4059-91da-abaf6059d7aa None None] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:41:25.179570 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=100 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:41:25.189169 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c42583-5ed7-4813-a9f7-d326e165e28c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:41:25.189948 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c42583-5ed7-4813-a9f7-d326e165e28c None admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:41:25.190229 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c42583-5ed7-4813-a9f7-d326e165e28c None admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:41:25.190500 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c42583-5ed7-4813-a9f7-d326e165e28c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:41:25.201155 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c42583-5ed7-4813-a9f7-d326e165e28c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 10:41:25.208620 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application [None req-80c42583-5ed7-4813-a9f7-d326e165e28c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 10:41:25.208620 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:41:25.208620 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:41:25.208620 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:41:25.208620 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:41:25.208620 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:41:25.208620 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:41:25.208620 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:41:25.208620 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:41:25.208620 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:41:25.208620 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:41:25.208620 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:41:25.208620 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 10:41:25.208620 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 10:41:25.208620 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 10:41:25.208620 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 10:41:25.209583 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 10:41:25.209583 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 10:41:25.209583 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 10:41:25.209583 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 10:41:25.209583 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:41:25.209583 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:41:25.209583 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:41:25.209583 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:41:25.209583 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:41:25.209583 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:41:25.209583 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:41:25.209583 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application with Lock( Jul 14 10:41:25.209583 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:41:25.209583 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:41:25.209583 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:41:25.209583 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:41:25.210468 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:41:25.210468 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:41:25.210468 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:41:25.210468 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:41:25.210468 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 10:41:25.210468 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 10:41:25.210468 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 10:41:25.210468 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 10:41:25.210468 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 10:41:25.210468 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 10:41:25.210468 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 10:41:25.210468 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application Jul 14 10:41:25.210468 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 578/1156] 10.222.0.16 () {56 vars in 1096 bytes} [Thu Jul 14 10:41:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:41:25.215934 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421cfdcc-22c7-4580-9b15-3efcbbbe1b3d None None] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:41:25.258694 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:41:25.319234 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421cfdcc-22c7-4580-9b15-3efcbbbe1b3d None None] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:41:25.350943 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf11ad06-202c-499e-8b4e-3dfaaaf9bbd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:41:25.351599 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf11ad06-202c-499e-8b4e-3dfaaaf9bbd0 None admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:41:25.351880 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf11ad06-202c-499e-8b4e-3dfaaaf9bbd0 None admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:41:25.352155 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf11ad06-202c-499e-8b4e-3dfaaaf9bbd0 None admin] PATH_INFO: `/v3/roles` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:41:25.352978 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf11ad06-202c-499e-8b4e-3dfaaaf9bbd0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:41:25.353224 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf11ad06-202c-499e-8b4e-3dfaaaf9bbd0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:41:25.355207 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf11ad06-202c-499e-8b4e-3dfaaaf9bbd0 None admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:41:25.362934 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 579/1157] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Jul 14 10:41:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:41:25.368693 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c42583-5ed7-4813-a9f7-d326e165e28c None admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:41:25.463329 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c42583-5ed7-4813-a9f7-d326e165e28c None admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:41:25.496907 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b915c3-5a49-473e-84d2-01b423d84871 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:41:25.497758 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b915c3-5a49-473e-84d2-01b423d84871 None admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:41:25.498042 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b915c3-5a49-473e-84d2-01b423d84871 None admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:41:25.498317 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b915c3-5a49-473e-84d2-01b423d84871 None admin] PATH_INFO: `/v3/users/0a6c0e920f30493a94f005827d3b1f6d` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:41:25.499489 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b915c3-5a49-473e-84d2-01b423d84871 None admin] RBAC: Authorizing `identity:get_user(user_id=0a6c0e920f30493a94f005827d3b1f6d)` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:41:25.500937 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b915c3-5a49-473e-84d2-01b423d84871 None admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:41:25.502549 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 579/1158] 10.222.0.16 () {56 vars in 1177 bytes} [Thu Jul 14 10:41:25 2022] GET /identity/v3/users/0a6c0e920f30493a94f005827d3b1f6d => generated 286 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:41:25.508103 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf11ad06-202c-499e-8b4e-3dfaaaf9bbd0 None admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:41:25.602962 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf11ad06-202c-499e-8b4e-3dfaaaf9bbd0 None admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:41:25.605851 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=100 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:41:25.639088 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89dc0a1-0abf-4330-9d3f-ad4210e5cb86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:41:25.639738 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89dc0a1-0abf-4330-9d3f-ad4210e5cb86 None admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:41:25.640027 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89dc0a1-0abf-4330-9d3f-ad4210e5cb86 None admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:41:25.640311 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89dc0a1-0abf-4330-9d3f-ad4210e5cb86 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:41:25.707645 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89dc0a1-0abf-4330-9d3f-ad4210e5cb86 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:41:25.709111 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89dc0a1-0abf-4330-9d3f-ad4210e5cb86 None admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:41:25.805107 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 580/1159] 10.222.0.16 () {58 vars in 1282 bytes} [Thu Jul 14 10:41:25 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 14 10:41:25.811227 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b915c3-5a49-473e-84d2-01b423d84871 None admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:41:25.864791 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=100 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:41:25.908073 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b915c3-5a49-473e-84d2-01b423d84871 None admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:41:25.940678 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480e9e13-50e5-4de9-866d-854b51fd666d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:41:25.941553 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480e9e13-50e5-4de9-866d-854b51fd666d None admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:41:25.941837 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480e9e13-50e5-4de9-866d-854b51fd666d None admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:41:25.942107 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480e9e13-50e5-4de9-866d-854b51fd666d None admin] PATH_INFO: `/v3/projects/b0d13a7c3cd74a2ba6da659bae695915` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:41:25.943268 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480e9e13-50e5-4de9-866d-854b51fd666d None admin] RBAC: Authorizing `identity:get_project(project_id=b0d13a7c3cd74a2ba6da659bae695915)` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:41:25.944689 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480e9e13-50e5-4de9-866d-854b51fd666d None admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:41:25.946378 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 580/1160] 10.222.0.16 () {56 vars in 1186 bytes} [Thu Jul 14 10:41:25 2022] GET /identity/v3/projects/b0d13a7c3cd74a2ba6da659bae695915 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:41:25.953109 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89dc0a1-0abf-4330-9d3f-ad4210e5cb86 None admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:41:25.956129 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=100 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:41:26.049489 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89dc0a1-0abf-4330-9d3f-ad4210e5cb86 None admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:41:26.082505 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f104cd44-1ebf-4b32-afff-ce47853697f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:41:26.083151 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f104cd44-1ebf-4b32-afff-ce47853697f3 None admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:41:26.083437 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f104cd44-1ebf-4b32-afff-ce47853697f3 None admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:41:26.083716 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f104cd44-1ebf-4b32-afff-ce47853697f3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:41:26.084546 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f104cd44-1ebf-4b32-afff-ce47853697f3 None admin] RBAC: Adding query filter params (role.id=153539819e5542df99269d2913bbecfb, scope.project.id=b0d13a7c3cd74a2ba6da659bae695915, user.id=0a6c0e920f30493a94f005827d3b1f6d) {{(pid=86656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:41:26.084903 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f104cd44-1ebf-4b32-afff-ce47853697f3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:41:26.086328 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f104cd44-1ebf-4b32-afff-ce47853697f3 None admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:41:26.092796 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 581/1161] 10.222.0.16 () {56 vars in 1374 bytes} [Thu Jul 14 10:41:25 2022] GET /identity/v3/role_assignments?user.id=0a6c0e920f30493a94f005827d3b1f6d&scope.project.id=b0d13a7c3cd74a2ba6da659bae695915&role.id=153539819e5542df99269d2913bbecfb => generated 608 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:41:28.122725 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a91c74-bd19-4fa1-b504-93089bb868a4 None None] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:41:28.123321 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a91c74-bd19-4fa1-b504-93089bb868a4 None None] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:41:28.123321 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a91c74-bd19-4fa1-b504-93089bb868a4 None None] PATH_INFO: `/` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:41:28.124633 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 581/1162] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jul 14 10:41:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:41:28.129695 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c27884e-5728-487b-aa1f-d4fba0f2358e None None] REQUEST_METHOD: `POST` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:41:28.130087 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c27884e-5728-487b-aa1f-d4fba0f2358e None None] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:41:28.130257 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c27884e-5728-487b-aa1f-d4fba0f2358e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:41:28.147087 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.auth.core [None req-7c27884e-5728-487b-aa1f-d4fba0f2358e None None] MFA Rules not processed for user `ae4bcdd8106d4bebbdcae96be33505bc`. Rule list: `[]` (Enabled: `True`). {{(pid=86656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:41:28.148264 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-7c27884e-5728-487b-aa1f-d4fba0f2358e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:41:28.207581 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=100 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:41:28.213394 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 582/1163] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jul 14 10:41:28 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 10:41:28.236626 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a91c74-bd19-4fa1-b504-93089bb868a4 None None] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:41:28.335619 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a91c74-bd19-4fa1-b504-93089bb868a4 None None] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:41:28.357765 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=100 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:41:28.368921 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbf50f0-d0ab-41a1-bb36-9ab9ba419e73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:41:28.369568 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbf50f0-d0ab-41a1-bb36-9ab9ba419e73 None admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:41:28.370400 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbf50f0-d0ab-41a1-bb36-9ab9ba419e73 None admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:41:28.370681 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbf50f0-d0ab-41a1-bb36-9ab9ba419e73 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:41:28.435013 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbf50f0-d0ab-41a1-bb36-9ab9ba419e73 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:41:28.436391 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbf50f0-d0ab-41a1-bb36-9ab9ba419e73 None admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:41:28.530271 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 582/1164] 10.222.0.16 () {58 vars in 1282 bytes} [Thu Jul 14 10:41:28 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 14 10:41:28.536106 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c27884e-5728-487b-aa1f-d4fba0f2358e None None] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:41:28.630258 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c27884e-5728-487b-aa1f-d4fba0f2358e None None] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:41:28.663144 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec4336d-5f0f-41bc-8862-652fcc267fcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:41:28.663926 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec4336d-5f0f-41bc-8862-652fcc267fcb None admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:41:28.664209 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec4336d-5f0f-41bc-8862-652fcc267fcb None admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:41:28.664482 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec4336d-5f0f-41bc-8862-652fcc267fcb None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:41:28.671197 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec4336d-5f0f-41bc-8862-652fcc267fcb None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:41:28.672621 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec4336d-5f0f-41bc-8862-652fcc267fcb None admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:41:28.687145 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application [None req-cec4336d-5f0f-41bc-8862-652fcc267fcb None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Jul 14 10:41:28.687145 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:41:28.687145 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jul 14 10:41:28.687145 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jul 14 10:41:28.687145 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 10:41:28.687145 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 10:41:28.687145 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 10:41:28.687145 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 10:41:28.687145 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Jul 14 10:41:28.687145 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application Jul 14 10:41:28.687145 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 10:41:28.687145 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application Jul 14 10:41:28.687145 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:41:28.687145 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:41:28.687145 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:41:28.687145 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:41:28.687145 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:41:28.688341 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:41:28.688341 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:41:28.688341 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:41:28.688341 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:41:28.688341 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:41:28.688341 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:41:28.688341 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 10:41:28.688341 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 10:41:28.688341 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 10:41:28.688341 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 10:41:28.688341 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:41:28.688341 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:41:28.688341 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:41:28.688341 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:41:28.688341 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:41:28.688341 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:41:28.689384 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:41:28.689384 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application with Lock( Jul 14 10:41:28.689384 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:41:28.689384 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:41:28.689384 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:41:28.689384 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:41:28.689384 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:41:28.689384 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:41:28.689384 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:41:28.689384 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:41:28.689384 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jul 14 10:41:28.689384 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 10:41:28.689384 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Jul 14 10:41:28.689384 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application Jul 14 10:41:28.689384 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 583/1165] 10.222.0.16 () {56 vars in 1117 bytes} [Thu Jul 14 10:41:28 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:41:28.694116 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbf50f0-d0ab-41a1-bb36-9ab9ba419e73 None admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:41:28.717701 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=100 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:41:28.792207 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbf50f0-d0ab-41a1-bb36-9ab9ba419e73 None admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:41:28.827341 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb7b32f-c010-4af0-b9fa-b594a790198d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:41:28.827990 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb7b32f-c010-4af0-b9fa-b594a790198d None admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:41:28.828274 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb7b32f-c010-4af0-b9fa-b594a790198d None admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:41:28.828553 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb7b32f-c010-4af0-b9fa-b594a790198d None admin] PATH_INFO: `/v3/domains` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:41:28.829310 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb7b32f-c010-4af0-b9fa-b594a790198d None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=86655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:41:28.829622 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb7b32f-c010-4af0-b9fa-b594a790198d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:41:28.830981 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb7b32f-c010-4af0-b9fa-b594a790198d None admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:41:28.837958 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 583/1166] 10.222.0.16 () {56 vars in 1115 bytes} [Thu Jul 14 10:41:28 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:41:30.824800 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd55ae3b-34fc-4355-acb7-496fd464e19c None None] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:41:30.825269 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd55ae3b-34fc-4355-acb7-496fd464e19c None None] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:41:30.825358 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd55ae3b-34fc-4355-acb7-496fd464e19c None None] PATH_INFO: `/` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:41:30.826733 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 584/1167] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jul 14 10:41:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:41:30.831740 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a61e5b7-3108-4a69-b37b-10e125229bd1 None None] REQUEST_METHOD: `POST` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:41:30.832173 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a61e5b7-3108-4a69-b37b-10e125229bd1 None None] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:41:30.832295 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a61e5b7-3108-4a69-b37b-10e125229bd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:41:30.848508 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.auth.core [None req-0a61e5b7-3108-4a69-b37b-10e125229bd1 None None] MFA Rules not processed for user `ae4bcdd8106d4bebbdcae96be33505bc`. Rule list: `[]` (Enabled: `True`). {{(pid=86655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:41:30.849708 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-0a61e5b7-3108-4a69-b37b-10e125229bd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:41:30.914721 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 584/1168] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jul 14 10:41:30 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 10:41:30.938289 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd55ae3b-34fc-4355-acb7-496fd464e19c None None] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:41:30.998564 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=100 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:41:31.040519 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd55ae3b-34fc-4355-acb7-496fd464e19c None None] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:41:31.075174 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d75fa22-59d4-40a4-8c71-984c96f066a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:41:31.075828 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d75fa22-59d4-40a4-8c71-984c96f066a8 None admin] REQUEST_METHOD: `POST` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:41:31.076118 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d75fa22-59d4-40a4-8c71-984c96f066a8 None admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:41:31.076397 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d75fa22-59d4-40a4-8c71-984c96f066a8 None admin] PATH_INFO: `/v3/domains` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:41:31.077169 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d75fa22-59d4-40a4-8c71-984c96f066a8 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:41:31.078543 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d75fa22-59d4-40a4-8c71-984c96f066a8 None admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:41:31.093042 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 585/1169] 10.222.0.16 () {60 vars in 1138 bytes} [Thu Jul 14 10:41:30 2022] POST /identity/v3/domains => generated 267 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:41:33.113508 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0e5374-a993-414f-8fb6-f33622ac9fe1 None None] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:41:33.114032 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0e5374-a993-414f-8fb6-f33622ac9fe1 None None] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:41:33.114150 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0e5374-a993-414f-8fb6-f33622ac9fe1 None None] PATH_INFO: `/` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:41:33.115427 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 585/1170] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jul 14 10:41:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:41:33.120854 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b946ee13-cd2e-4167-bf79-27eb95a10828 None None] REQUEST_METHOD: `POST` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:41:33.121226 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b946ee13-cd2e-4167-bf79-27eb95a10828 None None] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:41:33.121423 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b946ee13-cd2e-4167-bf79-27eb95a10828 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:41:33.137837 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.auth.core [None req-b946ee13-cd2e-4167-bf79-27eb95a10828 None None] MFA Rules not processed for user `ae4bcdd8106d4bebbdcae96be33505bc`. Rule list: `[]` (Enabled: `True`). {{(pid=86656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:41:33.139008 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-b946ee13-cd2e-4167-bf79-27eb95a10828 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:41:33.202584 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 586/1171] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jul 14 10:41:33 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 10:41:33.226330 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0e5374-a993-414f-8fb6-f33622ac9fe1 None None] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:41:33.245084 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=100 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:41:33.325976 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0e5374-a993-414f-8fb6-f33622ac9fe1 None None] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:41:33.358547 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766d0fef-6a64-48ef-8960-9f226325cb58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:41:33.359398 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766d0fef-6a64-48ef-8960-9f226325cb58 None admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:41:33.359680 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766d0fef-6a64-48ef-8960-9f226325cb58 None admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:41:33.359957 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766d0fef-6a64-48ef-8960-9f226325cb58 None admin] PATH_INFO: `/v3/domains/adaf10001e3a40f3bcddddc91adb4b37` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:41:33.370008 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766d0fef-6a64-48ef-8960-9f226325cb58 None admin] RBAC: Authorizing `identity:get_domain(domain_id=adaf10001e3a40f3bcddddc91adb4b37)` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:41:33.371373 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766d0fef-6a64-48ef-8960-9f226325cb58 None admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:41:33.373012 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 586/1172] 10.222.0.16 () {56 vars in 1183 bytes} [Thu Jul 14 10:41:33 2022] GET /identity/v3/domains/adaf10001e3a40f3bcddddc91adb4b37 => generated 267 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:41:33.378844 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b946ee13-cd2e-4167-bf79-27eb95a10828 None None] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:41:33.426022 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:41:33.476881 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b946ee13-cd2e-4167-bf79-27eb95a10828 None None] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:41:33.509501 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cab1da7-4fbd-432c-bd2b-f862115a5a76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:41:33.510645 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cab1da7-4fbd-432c-bd2b-f862115a5a76 None admin] REQUEST_METHOD: `POST` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:41:33.511158 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cab1da7-4fbd-432c-bd2b-f862115a5a76 None admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:41:33.511334 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cab1da7-4fbd-432c-bd2b-f862115a5a76 None admin] PATH_INFO: `/v3/projects` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:41:33.512046 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cab1da7-4fbd-432c-bd2b-f862115a5a76 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:41:33.513510 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cab1da7-4fbd-432c-bd2b-f862115a5a76 None admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:41:33.537321 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 587/1173] 10.222.0.16 () {60 vars in 1141 bytes} [Thu Jul 14 10:41:33 2022] POST /identity/v3/projects => generated 361 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:41:35.586618 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1017002b-ce4d-4d38-9573-cfad6e1da056 None None] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:41:35.587255 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1017002b-ce4d-4d38-9573-cfad6e1da056 None None] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:41:35.587255 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1017002b-ce4d-4d38-9573-cfad6e1da056 None None] PATH_INFO: `/` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:41:35.588608 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 587/1174] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jul 14 10:41:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:41:35.593769 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08372817-0bb0-4801-bec8-7f08652e930a None None] REQUEST_METHOD: `POST` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:41:35.594215 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08372817-0bb0-4801-bec8-7f08652e930a None None] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:41:35.594315 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08372817-0bb0-4801-bec8-7f08652e930a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:41:35.610817 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.auth.core [None req-08372817-0bb0-4801-bec8-7f08652e930a None None] MFA Rules not processed for user `ae4bcdd8106d4bebbdcae96be33505bc`. Rule list: `[]` (Enabled: `True`). {{(pid=86656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:41:35.611988 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-08372817-0bb0-4801-bec8-7f08652e930a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:41:35.675579 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 588/1175] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jul 14 10:41:35 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 10:41:35.700794 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1017002b-ce4d-4d38-9573-cfad6e1da056 None None] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:41:35.775415 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=100 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:41:35.799898 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1017002b-ce4d-4d38-9573-cfad6e1da056 None None] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:41:35.832783 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed360211-1e86-4fcc-bbab-c59cbb9060db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:41:35.833661 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed360211-1e86-4fcc-bbab-c59cbb9060db None admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:41:35.833951 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed360211-1e86-4fcc-bbab-c59cbb9060db None admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:41:35.834230 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed360211-1e86-4fcc-bbab-c59cbb9060db None admin] PATH_INFO: `/v3/domains/adaf10001e3a40f3bcddddc91adb4b37` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:41:35.835413 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed360211-1e86-4fcc-bbab-c59cbb9060db None admin] RBAC: Authorizing `identity:get_domain(domain_id=adaf10001e3a40f3bcddddc91adb4b37)` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:41:35.836922 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed360211-1e86-4fcc-bbab-c59cbb9060db None admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:41:35.838534 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 588/1176] 10.222.0.16 () {56 vars in 1183 bytes} [Thu Jul 14 10:41:35 2022] GET /identity/v3/domains/adaf10001e3a40f3bcddddc91adb4b37 => generated 267 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:41:35.844190 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08372817-0bb0-4801-bec8-7f08652e930a None None] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:41:35.873419 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:41:35.941699 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08372817-0bb0-4801-bec8-7f08652e930a None None] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:41:35.973780 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462857e4-0aba-4e9d-89d3-15e6eb66be12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:41:35.974436 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462857e4-0aba-4e9d-89d3-15e6eb66be12 None admin] REQUEST_METHOD: `POST` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:41:35.974723 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462857e4-0aba-4e9d-89d3-15e6eb66be12 None admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:41:35.975000 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462857e4-0aba-4e9d-89d3-15e6eb66be12 None admin] PATH_INFO: `/v3/users` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:41:35.975701 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462857e4-0aba-4e9d-89d3-15e6eb66be12 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:41:35.977162 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462857e4-0aba-4e9d-89d3-15e6eb66be12 None admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:41:35.997596 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 589/1177] 10.222.0.16 () {60 vars in 1132 bytes} [Thu Jul 14 10:41:35 2022] POST /identity/v3/users => generated 311 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:41:38.081696 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f27543-588a-4e9c-b39b-f67b5f7493a3 None None] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:41:38.082236 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f27543-588a-4e9c-b39b-f67b5f7493a3 None None] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:41:38.082236 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f27543-588a-4e9c-b39b-f67b5f7493a3 None None] PATH_INFO: `/` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:41:38.083624 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 589/1178] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jul 14 10:41:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:41:38.088852 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4311c48-32f5-4af8-a552-1c6b54d0c0a6 None None] REQUEST_METHOD: `POST` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:41:38.089268 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4311c48-32f5-4af8-a552-1c6b54d0c0a6 None None] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:41:38.089416 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4311c48-32f5-4af8-a552-1c6b54d0c0a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:41:38.106947 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.auth.core [None req-e4311c48-32f5-4af8-a552-1c6b54d0c0a6 None None] MFA Rules not processed for user `ae4bcdd8106d4bebbdcae96be33505bc`. Rule list: `[]` (Enabled: `True`). {{(pid=86656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:41:38.108109 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-e4311c48-32f5-4af8-a552-1c6b54d0c0a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:41:38.172156 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 590/1179] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jul 14 10:41:38 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 10:41:38.196102 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f27543-588a-4e9c-b39b-f67b5f7493a3 None None] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:41:38.295136 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f27543-588a-4e9c-b39b-f67b5f7493a3 None None] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:41:38.327720 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779c4d00-00aa-47c2-a8e2-5e7bd0a06a5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:41:38.328502 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779c4d00-00aa-47c2-a8e2-5e7bd0a06a5a None admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:41:38.328814 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779c4d00-00aa-47c2-a8e2-5e7bd0a06a5a None admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:41:38.329092 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779c4d00-00aa-47c2-a8e2-5e7bd0a06a5a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:41:38.340072 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779c4d00-00aa-47c2-a8e2-5e7bd0a06a5a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 10:41:38.347507 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application [None req-779c4d00-00aa-47c2-a8e2-5e7bd0a06a5a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 10:41:38.347507 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:41:38.347507 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:41:38.347507 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:41:38.347507 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:41:38.347507 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:41:38.347507 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:41:38.347507 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:41:38.347507 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:41:38.347507 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:41:38.347507 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:41:38.347507 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:41:38.347507 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 10:41:38.347507 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 10:41:38.347507 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 10:41:38.347507 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 10:41:38.348654 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 10:41:38.348654 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 10:41:38.348654 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 10:41:38.348654 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 10:41:38.348654 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:41:38.348654 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:41:38.348654 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:41:38.348654 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:41:38.348654 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:41:38.348654 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:41:38.348654 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:41:38.348654 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application with Lock( Jul 14 10:41:38.348654 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:41:38.348654 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:41:38.348654 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:41:38.348654 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:41:38.349605 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:41:38.349605 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:41:38.349605 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:41:38.349605 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:41:38.349605 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 10:41:38.349605 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 10:41:38.349605 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 10:41:38.349605 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 10:41:38.349605 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 10:41:38.349605 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 10:41:38.349605 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 10:41:38.349605 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application Jul 14 10:41:38.349605 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 590/1180] 10.222.0.16 () {56 vars in 1096 bytes} [Thu Jul 14 10:41:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:41:38.355314 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4311c48-32f5-4af8-a552-1c6b54d0c0a6 None None] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:41:38.372297 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:41:38.452294 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4311c48-32f5-4af8-a552-1c6b54d0c0a6 None None] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:41:38.486440 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8478c409-56f1-4946-ba86-f45beed57577 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:41:38.487103 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8478c409-56f1-4946-ba86-f45beed57577 None admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:41:38.487391 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8478c409-56f1-4946-ba86-f45beed57577 None admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:41:38.487669 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8478c409-56f1-4946-ba86-f45beed57577 None admin] PATH_INFO: `/v3/roles` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:41:38.488423 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8478c409-56f1-4946-ba86-f45beed57577 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:41:38.488843 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8478c409-56f1-4946-ba86-f45beed57577 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:41:38.490588 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8478c409-56f1-4946-ba86-f45beed57577 None admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:41:38.499093 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 591/1181] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Jul 14 10:41:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 10:41:38.504790 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779c4d00-00aa-47c2-a8e2-5e7bd0a06a5a None admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:41:38.508547 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=100 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:41:38.605756 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779c4d00-00aa-47c2-a8e2-5e7bd0a06a5a None admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:41:38.638981 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31829d4f-c3eb-491b-88e2-b0318e4e0b72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:41:38.639842 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31829d4f-c3eb-491b-88e2-b0318e4e0b72 None admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:41:38.640129 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31829d4f-c3eb-491b-88e2-b0318e4e0b72 None admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:41:38.640411 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31829d4f-c3eb-491b-88e2-b0318e4e0b72 None admin] PATH_INFO: `/v3/users/f3452eb72f5344b582095dc7ef4c8741` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:41:38.654972 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31829d4f-c3eb-491b-88e2-b0318e4e0b72 None admin] RBAC: Authorizing `identity:get_user(user_id=f3452eb72f5344b582095dc7ef4c8741)` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:41:38.656410 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31829d4f-c3eb-491b-88e2-b0318e4e0b72 None admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:41:38.658085 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 591/1182] 10.222.0.16 () {56 vars in 1177 bytes} [Thu Jul 14 10:41:38 2022] GET /identity/v3/users/f3452eb72f5344b582095dc7ef4c8741 => generated 311 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:41:38.663803 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8478c409-56f1-4946-ba86-f45beed57577 None admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:41:38.745939 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=100 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:41:38.767216 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8478c409-56f1-4946-ba86-f45beed57577 None admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:41:38.800946 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abece4d-2aa5-46f2-9aa3-15e1b003936c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:41:38.801601 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abece4d-2aa5-46f2-9aa3-15e1b003936c None admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:41:38.801889 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abece4d-2aa5-46f2-9aa3-15e1b003936c None admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:41:38.802172 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abece4d-2aa5-46f2-9aa3-15e1b003936c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:41:38.869045 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5abece4d-2aa5-46f2-9aa3-15e1b003936c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:41:38.871452 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5abece4d-2aa5-46f2-9aa3-15e1b003936c None admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:41:38.946083 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=100 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:41:38.971783 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 592/1183] 10.222.0.16 () {58 vars in 1282 bytes} [Thu Jul 14 10:41:38 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 14 10:41:38.977570 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31829d4f-c3eb-491b-88e2-b0318e4e0b72 None admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:41:39.036053 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=100 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:41:39.074090 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31829d4f-c3eb-491b-88e2-b0318e4e0b72 None admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:41:39.105915 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e4c847-7bc7-4a59-bc31-7e7cb2dfa3f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:41:39.106766 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e4c847-7bc7-4a59-bc31-7e7cb2dfa3f0 None admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:41:39.107048 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e4c847-7bc7-4a59-bc31-7e7cb2dfa3f0 None admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:41:39.107319 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e4c847-7bc7-4a59-bc31-7e7cb2dfa3f0 None admin] PATH_INFO: `/v3/projects/230c02473e364f11ae320682f31f655c` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:41:39.108481 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e4c847-7bc7-4a59-bc31-7e7cb2dfa3f0 None admin] RBAC: Authorizing `identity:get_project(project_id=230c02473e364f11ae320682f31f655c)` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:41:39.109934 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e4c847-7bc7-4a59-bc31-7e7cb2dfa3f0 None admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:41:39.111600 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 592/1184] 10.222.0.16 () {56 vars in 1186 bytes} [Thu Jul 14 10:41:38 2022] GET /identity/v3/projects/230c02473e364f11ae320682f31f655c => generated 361 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:41:39.117596 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abece4d-2aa5-46f2-9aa3-15e1b003936c None admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:41:39.214309 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abece4d-2aa5-46f2-9aa3-15e1b003936c None admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:41:39.247375 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ea4194-acef-4a12-ba1e-b62e7cf0282f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:41:39.248023 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ea4194-acef-4a12-ba1e-b62e7cf0282f None admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:41:39.248312 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ea4194-acef-4a12-ba1e-b62e7cf0282f None admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:41:39.248593 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ea4194-acef-4a12-ba1e-b62e7cf0282f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:41:39.249464 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ea4194-acef-4a12-ba1e-b62e7cf0282f None admin] RBAC: Adding query filter params (role.id=153539819e5542df99269d2913bbecfb, scope.project.id=230c02473e364f11ae320682f31f655c, user.id=f3452eb72f5344b582095dc7ef4c8741) {{(pid=86656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:41:39.249782 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ea4194-acef-4a12-ba1e-b62e7cf0282f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:41:39.251227 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ea4194-acef-4a12-ba1e-b62e7cf0282f None admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:41:39.256547 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 593/1185] 10.222.0.16 () {56 vars in 1374 bytes} [Thu Jul 14 10:41:39 2022] GET /identity/v3/role_assignments?user.id=f3452eb72f5344b582095dc7ef4c8741&scope.project.id=230c02473e364f11ae320682f31f655c&role.id=153539819e5542df99269d2913bbecfb => generated 259 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:41:41.237028 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88169e2d-a25c-4cfa-9449-0ec2a59bc742 None None] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:41:41.237585 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88169e2d-a25c-4cfa-9449-0ec2a59bc742 None None] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:41:41.237585 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88169e2d-a25c-4cfa-9449-0ec2a59bc742 None None] PATH_INFO: `/` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:41:41.238969 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 593/1186] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jul 14 10:41:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:41:41.244170 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d263ae1d-849b-4a13-858d-98e4c1d56cfd None None] REQUEST_METHOD: `POST` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:41:41.244603 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d263ae1d-849b-4a13-858d-98e4c1d56cfd None None] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:41:41.244735 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d263ae1d-849b-4a13-858d-98e4c1d56cfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:41:41.261724 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.auth.core [None req-d263ae1d-849b-4a13-858d-98e4c1d56cfd None None] MFA Rules not processed for user `ae4bcdd8106d4bebbdcae96be33505bc`. Rule list: `[]` (Enabled: `True`). {{(pid=86656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:41:41.262909 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-d263ae1d-849b-4a13-858d-98e4c1d56cfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:41:41.298252 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=100 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:41:41.330650 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 594/1187] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jul 14 10:41:41 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 10:41:41.353291 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88169e2d-a25c-4cfa-9449-0ec2a59bc742 None None] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:41:41.450908 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88169e2d-a25c-4cfa-9449-0ec2a59bc742 None None] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:41:41.479265 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=100 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:41:41.485043 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd92a2a-cd5c-4536-8f3d-e09b0c934422 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:41:41.485828 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd92a2a-cd5c-4536-8f3d-e09b0c934422 None admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:41:41.486110 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd92a2a-cd5c-4536-8f3d-e09b0c934422 None admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:41:41.486385 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd92a2a-cd5c-4536-8f3d-e09b0c934422 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:41:41.496215 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd92a2a-cd5c-4536-8f3d-e09b0c934422 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 10:41:41.503715 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application [None req-7cd92a2a-cd5c-4536-8f3d-e09b0c934422 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 10:41:41.503715 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:41:41.503715 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:41:41.503715 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:41:41.503715 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:41:41.503715 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:41:41.503715 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:41:41.503715 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:41:41.503715 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:41:41.503715 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:41:41.503715 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:41:41.503715 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:41:41.503715 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 10:41:41.503715 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 10:41:41.503715 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 10:41:41.503715 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 10:41:41.504859 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 10:41:41.504859 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 10:41:41.504859 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 10:41:41.504859 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 10:41:41.504859 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:41:41.504859 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:41:41.504859 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:41:41.504859 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:41:41.504859 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:41:41.504859 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:41:41.504859 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:41:41.504859 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application with Lock( Jul 14 10:41:41.504859 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:41:41.504859 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:41:41.504859 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:41:41.504859 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:41:41.505845 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:41:41.505845 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:41:41.505845 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:41:41.505845 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:41:41.505845 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 10:41:41.505845 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 10:41:41.505845 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 10:41:41.505845 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 10:41:41.505845 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 10:41:41.505845 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 10:41:41.505845 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 10:41:41.505845 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application Jul 14 10:41:41.505845 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 594/1188] 10.222.0.16 () {56 vars in 1096 bytes} [Thu Jul 14 10:41:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:41:41.511109 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d263ae1d-849b-4a13-858d-98e4c1d56cfd None None] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:41:41.605467 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d263ae1d-849b-4a13-858d-98e4c1d56cfd None None] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:41:41.637365 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbd12f9-be1e-4645-bb89-60e6508cd0ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:41:41.638009 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbd12f9-be1e-4645-bb89-60e6508cd0ff None admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:41:41.638291 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbd12f9-be1e-4645-bb89-60e6508cd0ff None admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:41:41.638564 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbd12f9-be1e-4645-bb89-60e6508cd0ff None admin] PATH_INFO: `/v3/roles` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:41:41.639291 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cbd12f9-be1e-4645-bb89-60e6508cd0ff None admin] RBAC: Adding query filter params (name=admin) {{(pid=86656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:41:41.639594 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cbd12f9-be1e-4645-bb89-60e6508cd0ff None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:41:41.640971 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cbd12f9-be1e-4645-bb89-60e6508cd0ff None admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:41:41.648635 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 595/1189] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Jul 14 10:41:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:41:41.654734 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd92a2a-cd5c-4536-8f3d-e09b0c934422 None admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:41:41.750777 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd92a2a-cd5c-4536-8f3d-e09b0c934422 None admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:41:41.784009 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2709a9f-c1b0-4e10-8090-e4c9728c1e9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:41:41.784916 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2709a9f-c1b0-4e10-8090-e4c9728c1e9e None admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:41:41.785205 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2709a9f-c1b0-4e10-8090-e4c9728c1e9e None admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:41:41.785481 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2709a9f-c1b0-4e10-8090-e4c9728c1e9e None admin] PATH_INFO: `/v3/users/f3452eb72f5344b582095dc7ef4c8741` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:41:41.786665 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2709a9f-c1b0-4e10-8090-e4c9728c1e9e None admin] RBAC: Authorizing `identity:get_user(user_id=f3452eb72f5344b582095dc7ef4c8741)` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:41:41.788091 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2709a9f-c1b0-4e10-8090-e4c9728c1e9e None admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:41:41.789756 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 595/1190] 10.222.0.16 () {56 vars in 1177 bytes} [Thu Jul 14 10:41:41 2022] GET /identity/v3/users/f3452eb72f5344b582095dc7ef4c8741 => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:41:41.795891 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbd12f9-be1e-4645-bb89-60e6508cd0ff None admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:41:41.831285 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=100 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:41:41.896920 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbd12f9-be1e-4645-bb89-60e6508cd0ff None admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:41:41.930838 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72c757b-6f3d-4849-ab2e-37a346008987 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:41:41.932817 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72c757b-6f3d-4849-ab2e-37a346008987 None admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:41:41.933117 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72c757b-6f3d-4849-ab2e-37a346008987 None admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:41:41.933403 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72c757b-6f3d-4849-ab2e-37a346008987 None admin] PATH_INFO: `/v3/projects/230c02473e364f11ae320682f31f655c` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:41:41.934854 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72c757b-6f3d-4849-ab2e-37a346008987 None admin] RBAC: Authorizing `identity:get_project(project_id=230c02473e364f11ae320682f31f655c)` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:41:41.936287 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72c757b-6f3d-4849-ab2e-37a346008987 None admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:41:41.938032 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 596/1191] 10.222.0.16 () {56 vars in 1186 bytes} [Thu Jul 14 10:41:41 2022] GET /identity/v3/projects/230c02473e364f11ae320682f31f655c => generated 361 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:41:41.943845 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2709a9f-c1b0-4e10-8090-e4c9728c1e9e None admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:41:42.000925 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=100 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:41:42.040667 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2709a9f-c1b0-4e10-8090-e4c9728c1e9e None admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:41:42.074273 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6163ca-d45a-4698-960c-b8573b23f05a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:41:42.075153 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6163ca-d45a-4698-960c-b8573b23f05a None admin] REQUEST_METHOD: `PUT` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:41:42.075439 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6163ca-d45a-4698-960c-b8573b23f05a None admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:41:42.075719 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6163ca-d45a-4698-960c-b8573b23f05a None admin] PATH_INFO: `/v3/projects/230c02473e364f11ae320682f31f655c/users/f3452eb72f5344b582095dc7ef4c8741/roles/153539819e5542df99269d2913bbecfb` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:41:42.077698 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6163ca-d45a-4698-960c-b8573b23f05a None admin] RBAC: Authorizing `identity:create_grant(project_id=230c02473e364f11ae320682f31f655c, user_id=f3452eb72f5344b582095dc7ef4c8741, role_id=153539819e5542df99269d2913bbecfb)` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:41:42.079121 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6163ca-d45a-4698-960c-b8573b23f05a None admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:41:42.091784 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 596/1192] 10.222.0.16 () {58 vars in 1439 bytes} [Thu Jul 14 10:41:41 2022] PUT /identity/v3/projects/230c02473e364f11ae320682f31f655c/users/f3452eb72f5344b582095dc7ef4c8741/roles/153539819e5542df99269d2913bbecfb => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:41:44.068563 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6233d8e-5eae-497d-ba27-3baba1e4fb35 None None] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:41:44.069124 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6233d8e-5eae-497d-ba27-3baba1e4fb35 None None] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:41:44.069219 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6233d8e-5eae-497d-ba27-3baba1e4fb35 None None] PATH_INFO: `/` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:41:44.070518 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 597/1193] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jul 14 10:41:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:41:44.076381 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6791aac2-7e38-4f28-a4b5-d29881677f0c None None] REQUEST_METHOD: `POST` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:41:44.076760 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6791aac2-7e38-4f28-a4b5-d29881677f0c None None] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:41:44.076980 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6791aac2-7e38-4f28-a4b5-d29881677f0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:41:44.093939 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.auth.core [None req-6791aac2-7e38-4f28-a4b5-d29881677f0c None None] MFA Rules not processed for user `ae4bcdd8106d4bebbdcae96be33505bc`. Rule list: `[]` (Enabled: `True`). {{(pid=86655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:41:44.095123 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-6791aac2-7e38-4f28-a4b5-d29881677f0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:41:44.158921 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 597/1194] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jul 14 10:41:44 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 10:41:44.182275 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6233d8e-5eae-497d-ba27-3baba1e4fb35 None None] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:41:44.281120 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6233d8e-5eae-497d-ba27-3baba1e4fb35 None None] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:41:44.282607 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=100 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:41:44.316374 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cbde4f-dbf6-470e-9122-a8ee5c92a4e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:41:44.317193 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cbde4f-dbf6-470e-9122-a8ee5c92a4e1 None admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:41:44.317483 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cbde4f-dbf6-470e-9122-a8ee5c92a4e1 None admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:41:44.317763 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cbde4f-dbf6-470e-9122-a8ee5c92a4e1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:41:44.328114 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80cbde4f-dbf6-470e-9122-a8ee5c92a4e1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 10:41:44.335799 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application [None req-80cbde4f-dbf6-470e-9122-a8ee5c92a4e1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 10:41:44.335799 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:41:44.335799 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:41:44.335799 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:41:44.335799 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:41:44.335799 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:41:44.335799 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:41:44.335799 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:41:44.335799 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:41:44.335799 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:41:44.335799 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:41:44.335799 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:41:44.335799 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 10:41:44.335799 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 10:41:44.335799 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 10:41:44.335799 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 10:41:44.336925 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 10:41:44.336925 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 10:41:44.336925 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 10:41:44.336925 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 10:41:44.336925 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:41:44.336925 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:41:44.336925 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:41:44.336925 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:41:44.336925 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:41:44.336925 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:41:44.336925 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:41:44.336925 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application with Lock( Jul 14 10:41:44.336925 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:41:44.336925 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:41:44.336925 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:41:44.336925 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:41:44.343685 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:41:44.343685 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:41:44.343685 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:41:44.343685 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:41:44.343685 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 10:41:44.343685 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 10:41:44.343685 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 10:41:44.343685 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 10:41:44.343685 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 10:41:44.343685 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 10:41:44.343685 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 10:41:44.343685 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application Jul 14 10:41:44.343685 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 598/1195] 10.222.0.16 () {56 vars in 1096 bytes} [Thu Jul 14 10:41:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:41:44.344545 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6791aac2-7e38-4f28-a4b5-d29881677f0c None None] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:41:44.391025 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:41:44.444065 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6791aac2-7e38-4f28-a4b5-d29881677f0c None None] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:41:44.479697 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a466143-b638-49ad-91f7-3779afa59b40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:41:44.480365 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a466143-b638-49ad-91f7-3779afa59b40 None admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:41:44.480656 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a466143-b638-49ad-91f7-3779afa59b40 None admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:41:44.480976 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a466143-b638-49ad-91f7-3779afa59b40 None admin] PATH_INFO: `/v3/roles` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:41:44.481729 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a466143-b638-49ad-91f7-3779afa59b40 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:41:44.482042 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a466143-b638-49ad-91f7-3779afa59b40 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:41:44.483412 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a466143-b638-49ad-91f7-3779afa59b40 None admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:41:44.491542 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 598/1196] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Jul 14 10:41:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:41:44.497928 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cbde4f-dbf6-470e-9122-a8ee5c92a4e1 None admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:41:44.596506 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cbde4f-dbf6-470e-9122-a8ee5c92a4e1 None admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:41:44.629058 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09898db9-9164-48cc-bd60-a93f9d90edd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:41:44.629922 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09898db9-9164-48cc-bd60-a93f9d90edd6 None admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:41:44.630210 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09898db9-9164-48cc-bd60-a93f9d90edd6 None admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:41:44.630486 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09898db9-9164-48cc-bd60-a93f9d90edd6 None admin] PATH_INFO: `/v3/users/f3452eb72f5344b582095dc7ef4c8741` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:41:44.631732 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09898db9-9164-48cc-bd60-a93f9d90edd6 None admin] RBAC: Authorizing `identity:get_user(user_id=f3452eb72f5344b582095dc7ef4c8741)` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:41:44.633214 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09898db9-9164-48cc-bd60-a93f9d90edd6 None admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:41:44.635518 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 599/1197] 10.222.0.16 () {56 vars in 1177 bytes} [Thu Jul 14 10:41:44 2022] GET /identity/v3/users/f3452eb72f5344b582095dc7ef4c8741 => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:41:44.641027 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a466143-b638-49ad-91f7-3779afa59b40 None admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:41:44.742473 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a466143-b638-49ad-91f7-3779afa59b40 None admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:41:44.754150 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=100 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:41:44.778141 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e900845-fc13-42ec-8bc3-e19fb9bce215 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:41:44.778803 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e900845-fc13-42ec-8bc3-e19fb9bce215 None admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:41:44.779087 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e900845-fc13-42ec-8bc3-e19fb9bce215 None admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:41:44.779365 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e900845-fc13-42ec-8bc3-e19fb9bce215 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:41:44.845319 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e900845-fc13-42ec-8bc3-e19fb9bce215 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:41:44.846808 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e900845-fc13-42ec-8bc3-e19fb9bce215 None admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:41:44.941777 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 599/1198] 10.222.0.16 () {58 vars in 1282 bytes} [Thu Jul 14 10:41:44 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 14 10:41:44.947517 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09898db9-9164-48cc-bd60-a93f9d90edd6 None admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:41:44.976940 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=100 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:41:45.045253 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09898db9-9164-48cc-bd60-a93f9d90edd6 None admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:41:45.077590 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816a0673-500f-42e9-b070-b93995e297da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:41:45.078438 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816a0673-500f-42e9-b070-b93995e297da None admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:41:45.078720 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816a0673-500f-42e9-b070-b93995e297da None admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:41:45.078994 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816a0673-500f-42e9-b070-b93995e297da None admin] PATH_INFO: `/v3/projects/230c02473e364f11ae320682f31f655c` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:41:45.080158 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816a0673-500f-42e9-b070-b93995e297da None admin] RBAC: Authorizing `identity:get_project(project_id=230c02473e364f11ae320682f31f655c)` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:41:45.081624 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816a0673-500f-42e9-b070-b93995e297da None admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:41:45.083311 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 600/1199] 10.222.0.16 () {56 vars in 1186 bytes} [Thu Jul 14 10:41:44 2022] GET /identity/v3/projects/230c02473e364f11ae320682f31f655c => generated 361 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:41:45.089989 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e900845-fc13-42ec-8bc3-e19fb9bce215 None admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:41:45.101376 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=100 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:41:45.186899 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e900845-fc13-42ec-8bc3-e19fb9bce215 None admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:41:45.219941 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7e1d3d-a7d1-4515-97e2-fa201bfaafd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:41:45.220581 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7e1d3d-a7d1-4515-97e2-fa201bfaafd7 None admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:41:45.220897 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7e1d3d-a7d1-4515-97e2-fa201bfaafd7 None admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:41:45.221178 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7e1d3d-a7d1-4515-97e2-fa201bfaafd7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:41:45.222011 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7e1d3d-a7d1-4515-97e2-fa201bfaafd7 None admin] RBAC: Adding query filter params (role.id=153539819e5542df99269d2913bbecfb, scope.project.id=230c02473e364f11ae320682f31f655c, user.id=f3452eb72f5344b582095dc7ef4c8741) {{(pid=86655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:41:45.222323 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7e1d3d-a7d1-4515-97e2-fa201bfaafd7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:41:45.223735 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7e1d3d-a7d1-4515-97e2-fa201bfaafd7 None admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:41:45.230103 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 600/1200] 10.222.0.16 () {56 vars in 1374 bytes} [Thu Jul 14 10:41:45 2022] GET /identity/v3/role_assignments?user.id=f3452eb72f5344b582095dc7ef4c8741&scope.project.id=230c02473e364f11ae320682f31f655c&role.id=153539819e5542df99269d2913bbecfb => generated 608 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:41:55.073569 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=51 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:41:55.226864 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=63 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:42:40.034435 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8386b891-a3a3-418c-b9be-fee2a34d4eae None None] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:42:40.035011 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8386b891-a3a3-418c-b9be-fee2a34d4eae None None] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:42:40.035011 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8386b891-a3a3-418c-b9be-fee2a34d4eae None None] PATH_INFO: `/` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:42:40.036201 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 601/1201] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jul 14 10:42:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:42:40.042216 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522de844-661c-4b9b-9fb8-16425fee5abf None None] REQUEST_METHOD: `POST` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:42:40.042739 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522de844-661c-4b9b-9fb8-16425fee5abf None None] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:42:40.042840 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522de844-661c-4b9b-9fb8-16425fee5abf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:42:40.068609 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.auth.core [None req-522de844-661c-4b9b-9fb8-16425fee5abf None None] MFA Rules not processed for user `ae4bcdd8106d4bebbdcae96be33505bc`. Rule list: `[]` (Enabled: `True`). {{(pid=86655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:42:40.070028 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-522de844-661c-4b9b-9fb8-16425fee5abf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:42:40.156456 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 601/1202] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jul 14 10:42:40 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 10:42:40.185355 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8386b891-a3a3-418c-b9be-fee2a34d4eae None None] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:42:40.331075 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8386b891-a3a3-418c-b9be-fee2a34d4eae None None] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:42:40.384797 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd5a1c6-6229-4a83-91eb-8ed20973b6aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:42:40.386505 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd5a1c6-6229-4a83-91eb-8ed20973b6aa None admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:42:40.389271 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd5a1c6-6229-4a83-91eb-8ed20973b6aa None admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:42:40.389715 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd5a1c6-6229-4a83-91eb-8ed20973b6aa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:42:40.410893 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd5a1c6-6229-4a83-91eb-8ed20973b6aa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:42:40.414776 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd5a1c6-6229-4a83-91eb-8ed20973b6aa None admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:42:40.443858 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application [None req-efd5a1c6-6229-4a83-91eb-8ed20973b6aa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 10:42:40.443858 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:42:40.443858 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:42:40.443858 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:42:40.443858 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:42:40.443858 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:42:40.443858 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:42:40.443858 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:42:40.443858 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:42:40.443858 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:42:40.443858 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:42:40.443858 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:42:40.443858 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 10:42:40.443858 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 10:42:40.443858 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 10:42:40.447025 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 10:42:40.447025 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:42:40.447025 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:42:40.447025 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:42:40.447025 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:42:40.447025 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:42:40.447025 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:42:40.447025 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:42:40.447025 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application with Lock( Jul 14 10:42:40.447025 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:42:40.447025 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:42:40.447025 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:42:40.447025 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:42:40.447025 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:42:40.447025 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:42:40.447025 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:42:40.447025 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:42:40.452862 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 10:42:40.452862 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 10:42:40.452862 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 10:42:40.452862 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application Jul 14 10:42:40.452862 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 602/1203] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Jul 14 10:42:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:42:40.456041 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522de844-661c-4b9b-9fb8-16425fee5abf None None] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:42:40.621157 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522de844-661c-4b9b-9fb8-16425fee5abf None None] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:42:40.662703 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=100 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:42:40.673664 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880d32f3-017d-4d2e-a6c9-28e8824d29af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:42:40.674331 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880d32f3-017d-4d2e-a6c9-28e8824d29af None admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:42:40.674647 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880d32f3-017d-4d2e-a6c9-28e8824d29af None admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:42:40.675030 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880d32f3-017d-4d2e-a6c9-28e8824d29af None admin] PATH_INFO: `/v3/domains` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:42:40.675799 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880d32f3-017d-4d2e-a6c9-28e8824d29af None admin] RBAC: Adding query filter params (name=Default) {{(pid=86655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:42:40.676149 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880d32f3-017d-4d2e-a6c9-28e8824d29af None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:42:40.677751 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880d32f3-017d-4d2e-a6c9-28e8824d29af None admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:42:40.693522 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 602/1204] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Jul 14 10:42:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 10:42:40.699447 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd5a1c6-6229-4a83-91eb-8ed20973b6aa None admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:42:40.769091 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=100 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:42:40.836048 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd5a1c6-6229-4a83-91eb-8ed20973b6aa None admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:42:40.884974 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75efa403-9281-43c1-980a-e3d49f62087b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:42:40.885698 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75efa403-9281-43c1-980a-e3d49f62087b None admin] REQUEST_METHOD: `POST` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:42:40.885998 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75efa403-9281-43c1-980a-e3d49f62087b None admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:42:40.886328 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75efa403-9281-43c1-980a-e3d49f62087b None admin] PATH_INFO: `/v3/users` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:42:40.887187 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75efa403-9281-43c1-980a-e3d49f62087b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:42:40.888834 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75efa403-9281-43c1-980a-e3d49f62087b None admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:42:40.912115 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 603/1205] 10.222.0.16 () {60 vars in 1132 bytes} [Thu Jul 14 10:42:40 2022] POST /identity/v3/users => generated 251 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:42:43.099627 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f912767d-b6e7-437f-9564-c2b55fd9bfe5 None None] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:42:43.100292 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f912767d-b6e7-437f-9564-c2b55fd9bfe5 None None] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:42:43.100292 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f912767d-b6e7-437f-9564-c2b55fd9bfe5 None None] PATH_INFO: `/` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:42:43.101823 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 603/1206] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jul 14 10:42:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:42:43.110114 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1536a52c-0655-42b0-b730-0acf776944b6 None None] REQUEST_METHOD: `POST` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:42:43.110790 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1536a52c-0655-42b0-b730-0acf776944b6 None None] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:42:43.110790 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1536a52c-0655-42b0-b730-0acf776944b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:42:43.131537 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.auth.core [None req-1536a52c-0655-42b0-b730-0acf776944b6 None None] MFA Rules not processed for user `ae4bcdd8106d4bebbdcae96be33505bc`. Rule list: `[]` (Enabled: `True`). {{(pid=86656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:42:43.132805 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-1536a52c-0655-42b0-b730-0acf776944b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:42:43.213417 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 604/1207] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jul 14 10:42:43 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 10:42:43.238305 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f912767d-b6e7-437f-9564-c2b55fd9bfe5 None None] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:42:43.373049 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f912767d-b6e7-437f-9564-c2b55fd9bfe5 None None] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:42:43.410440 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6173b6c3-2dbc-4fae-ae10-3494b76444e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:42:43.411250 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6173b6c3-2dbc-4fae-ae10-3494b76444e0 None admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:42:43.411524 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6173b6c3-2dbc-4fae-ae10-3494b76444e0 None admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:42:43.411797 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6173b6c3-2dbc-4fae-ae10-3494b76444e0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:42:43.424166 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6173b6c3-2dbc-4fae-ae10-3494b76444e0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 10:42:43.433502 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application [None req-6173b6c3-2dbc-4fae-ae10-3494b76444e0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 14 10:42:43.433502 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:42:43.433502 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:42:43.433502 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:42:43.433502 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:42:43.433502 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:42:43.433502 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:42:43.433502 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:42:43.433502 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:42:43.433502 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:42:43.433502 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:42:43.433502 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:42:43.433502 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 10:42:43.433502 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 10:42:43.433502 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 10:42:43.433502 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 10:42:43.435092 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 10:42:43.435092 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 10:42:43.435092 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 10:42:43.435092 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 10:42:43.435092 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:42:43.435092 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:42:43.435092 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:42:43.435092 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:42:43.435092 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:42:43.435092 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:42:43.435092 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:42:43.435092 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application with Lock( Jul 14 10:42:43.435092 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:42:43.435092 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:42:43.435092 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:42:43.435092 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:42:43.435950 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:42:43.435950 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:42:43.435950 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:42:43.435950 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:42:43.435950 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 10:42:43.435950 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 10:42:43.435950 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 10:42:43.435950 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 10:42:43.435950 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 10:42:43.435950 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 10:42:43.435950 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 14 10:42:43.435950 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application Jul 14 10:42:43.435950 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 604/1208] 10.222.0.16 () {56 vars in 1102 bytes} [Thu Jul 14 10:42:43 2022] GET /identity/v3/roles/service => generated 85 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:42:43.440984 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1536a52c-0655-42b0-b730-0acf776944b6 None None] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:42:43.491347 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:42:43.561393 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1536a52c-0655-42b0-b730-0acf776944b6 None None] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:42:43.600391 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46dfbe40-e8bb-4f4b-a944-63f4c0da03c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:42:43.601315 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46dfbe40-e8bb-4f4b-a944-63f4c0da03c4 None admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:42:43.601631 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46dfbe40-e8bb-4f4b-a944-63f4c0da03c4 None admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:42:43.601893 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46dfbe40-e8bb-4f4b-a944-63f4c0da03c4 None admin] PATH_INFO: `/v3/roles` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:42:43.602744 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46dfbe40-e8bb-4f4b-a944-63f4c0da03c4 None admin] RBAC: Adding query filter params (name=service) {{(pid=86656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:42:43.603021 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46dfbe40-e8bb-4f4b-a944-63f4c0da03c4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:42:43.604402 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46dfbe40-e8bb-4f4b-a944-63f4c0da03c4 None admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:42:43.618782 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 605/1209] 10.222.0.16 () {56 vars in 1103 bytes} [Thu Jul 14 10:42:43 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:42:43.621286 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6173b6c3-2dbc-4fae-ae10-3494b76444e0 None admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:42:43.682402 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=100 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:42:43.737576 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6173b6c3-2dbc-4fae-ae10-3494b76444e0 None admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:42:43.777742 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88369017-4111-4320-b5da-7f4d1e92a36a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:42:43.778770 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88369017-4111-4320-b5da-7f4d1e92a36a None admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:42:43.779101 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88369017-4111-4320-b5da-7f4d1e92a36a None admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:42:43.779358 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88369017-4111-4320-b5da-7f4d1e92a36a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:42:43.793743 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88369017-4111-4320-b5da-7f4d1e92a36a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:42:43.795427 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88369017-4111-4320-b5da-7f4d1e92a36a None admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:42:43.815335 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application [None req-88369017-4111-4320-b5da-7f4d1e92a36a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 10:42:43.815335 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:42:43.815335 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:42:43.815335 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:42:43.815335 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:42:43.815335 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:42:43.815335 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:42:43.815335 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:42:43.815335 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:42:43.815335 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:42:43.815335 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:42:43.815335 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:42:43.815335 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 10:42:43.815335 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 10:42:43.815335 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 10:42:43.816492 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 10:42:43.816492 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:42:43.816492 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:42:43.816492 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:42:43.816492 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:42:43.816492 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:42:43.816492 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:42:43.816492 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:42:43.816492 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application with Lock( Jul 14 10:42:43.816492 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:42:43.816492 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:42:43.816492 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:42:43.816492 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:42:43.816492 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:42:43.816492 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:42:43.816492 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:42:43.816492 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:42:43.817612 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 10:42:43.817612 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 10:42:43.817612 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 10:42:43.817612 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application Jul 14 10:42:43.819180 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 605/1210] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Jul 14 10:42:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:42:43.824734 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46dfbe40-e8bb-4f4b-a944-63f4c0da03c4 None admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:42:43.957626 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=100 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:42:43.965407 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46dfbe40-e8bb-4f4b-a944-63f4c0da03c4 None admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:42:44.020072 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076b5d81-8572-4e21-8c86-15754fddd127 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:42:44.021022 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076b5d81-8572-4e21-8c86-15754fddd127 None admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:42:44.021426 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076b5d81-8572-4e21-8c86-15754fddd127 None admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:42:44.021972 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076b5d81-8572-4e21-8c86-15754fddd127 None admin] PATH_INFO: `/v3/domains` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:42:44.023025 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076b5d81-8572-4e21-8c86-15754fddd127 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:42:44.023437 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076b5d81-8572-4e21-8c86-15754fddd127 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:42:44.025350 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076b5d81-8572-4e21-8c86-15754fddd127 None admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:42:44.043587 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 606/1211] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Jul 14 10:42:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 10:42:44.051450 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88369017-4111-4320-b5da-7f4d1e92a36a None admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:42:44.176583 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88369017-4111-4320-b5da-7f4d1e92a36a None admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:42:44.178931 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=100 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:42:44.216978 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf37554-232b-4e83-9b3a-7300936fc6e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:42:44.217730 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf37554-232b-4e83-9b3a-7300936fc6e0 None admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:42:44.218020 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf37554-232b-4e83-9b3a-7300936fc6e0 None admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:42:44.218305 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf37554-232b-4e83-9b3a-7300936fc6e0 None admin] PATH_INFO: `/v3/users/placement` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:42:44.227095 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf37554-232b-4e83-9b3a-7300936fc6e0 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:42:44.228655 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf37554-232b-4e83-9b3a-7300936fc6e0 None admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:42:44.244758 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application [None req-1bf37554-232b-4e83-9b3a-7300936fc6e0 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 14 10:42:44.244758 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:42:44.244758 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:42:44.244758 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:42:44.244758 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:42:44.244758 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:42:44.244758 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:42:44.244758 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:42:44.244758 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:42:44.244758 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:42:44.244758 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:42:44.244758 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:42:44.244758 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 10:42:44.244758 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 10:42:44.244758 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 10:42:44.244758 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 10:42:44.251308 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:42:44.251308 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:42:44.251308 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 10:42:44.251308 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 10:42:44.251308 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 10:42:44.251308 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 10:42:44.251308 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:42:44.251308 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:42:44.251308 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:42:44.251308 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:42:44.251308 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:42:44.251308 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application with Lock( Jul 14 10:42:44.251308 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:42:44.251308 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:42:44.251308 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:42:44.251308 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:42:44.251308 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:42:44.251308 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:42:44.252463 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:42:44.252463 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:42:44.252463 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 10:42:44.252463 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 10:42:44.252463 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 10:42:44.252463 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 10:42:44.252463 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 10:42:44.252463 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 10:42:44.252463 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 14 10:42:44.252463 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application Jul 14 10:42:44.252463 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 606/1212] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Jul 14 10:42:44 2022] GET /identity/v3/users/placement => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 10:42:44.253374 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076b5d81-8572-4e21-8c86-15754fddd127 None admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:42:44.375358 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076b5d81-8572-4e21-8c86-15754fddd127 None admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:42:44.419428 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef015a3-f58f-4e03-be2c-af28c19b4f9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:42:44.420104 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef015a3-f58f-4e03-be2c-af28c19b4f9e None admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:42:44.422728 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef015a3-f58f-4e03-be2c-af28c19b4f9e None admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:42:44.422728 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef015a3-f58f-4e03-be2c-af28c19b4f9e None admin] PATH_INFO: `/v3/users` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:42:44.424736 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef015a3-f58f-4e03-be2c-af28c19b4f9e None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=86656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:42:44.425084 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef015a3-f58f-4e03-be2c-af28c19b4f9e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:42:44.426527 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef015a3-f58f-4e03-be2c-af28c19b4f9e None admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:42:44.451115 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 607/1213] 10.222.0.16 () {56 vars in 1143 bytes} [Thu Jul 14 10:42:44 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:42:44.458508 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf37554-232b-4e83-9b3a-7300936fc6e0 None admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:42:44.596194 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf37554-232b-4e83-9b3a-7300936fc6e0 None admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:42:44.635807 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633c7b7f-f405-4da2-a29d-d206f578328c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:42:44.636536 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633c7b7f-f405-4da2-a29d-d206f578328c None admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:42:44.636950 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633c7b7f-f405-4da2-a29d-d206f578328c None admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:42:44.637397 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633c7b7f-f405-4da2-a29d-d206f578328c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:42:44.669513 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=100 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:42:44.712319 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633c7b7f-f405-4da2-a29d-d206f578328c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:42:44.713807 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633c7b7f-f405-4da2-a29d-d206f578328c None admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:42:44.840161 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 607/1214] 10.222.0.16 () {58 vars in 1282 bytes} [Thu Jul 14 10:42:44 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 14 10:42:44.847043 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef015a3-f58f-4e03-be2c-af28c19b4f9e None admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:42:44.871493 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=100 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:42:44.974236 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef015a3-f58f-4e03-be2c-af28c19b4f9e None admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:42:45.017503 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df21b3bc-8a0d-4425-bcc6-ed1344c9d1fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:42:45.018307 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df21b3bc-8a0d-4425-bcc6-ed1344c9d1fb None admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:42:45.018600 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df21b3bc-8a0d-4425-bcc6-ed1344c9d1fb None admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:42:45.018881 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df21b3bc-8a0d-4425-bcc6-ed1344c9d1fb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:42:45.031149 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df21b3bc-8a0d-4425-bcc6-ed1344c9d1fb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:42:45.032934 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df21b3bc-8a0d-4425-bcc6-ed1344c9d1fb None admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:42:45.056681 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application [None req-df21b3bc-8a0d-4425-bcc6-ed1344c9d1fb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 10:42:45.056681 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:42:45.056681 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:42:45.056681 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:42:45.056681 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:42:45.056681 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:42:45.056681 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:42:45.056681 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:42:45.056681 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:42:45.056681 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:42:45.056681 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:42:45.056681 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:42:45.056681 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 10:42:45.056681 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 10:42:45.056681 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 10:42:45.065079 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 10:42:45.065079 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:42:45.065079 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:42:45.065079 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:42:45.065079 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:42:45.065079 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:42:45.065079 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:42:45.065079 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:42:45.065079 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application with Lock( Jul 14 10:42:45.065079 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:42:45.065079 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:42:45.065079 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:42:45.065079 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:42:45.065079 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:42:45.065079 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:42:45.065079 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:42:45.065079 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:42:45.066205 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 10:42:45.066205 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 10:42:45.066205 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 10:42:45.066205 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application Jul 14 10:42:45.066205 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 608/1215] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Jul 14 10:42:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:42:45.066557 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633c7b7f-f405-4da2-a29d-d206f578328c None admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:42:45.141444 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=100 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:42:45.191122 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633c7b7f-f405-4da2-a29d-d206f578328c None admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:42:45.235393 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf39a85-1238-4e07-a1c6-442653208dd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:42:45.236078 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf39a85-1238-4e07-a1c6-442653208dd7 None admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:42:45.236335 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf39a85-1238-4e07-a1c6-442653208dd7 None admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:42:45.236614 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf39a85-1238-4e07-a1c6-442653208dd7 None admin] PATH_INFO: `/v3/domains` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:42:45.237578 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf39a85-1238-4e07-a1c6-442653208dd7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:42:45.237870 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf39a85-1238-4e07-a1c6-442653208dd7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:42:45.239227 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf39a85-1238-4e07-a1c6-442653208dd7 None admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:42:45.251846 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 608/1216] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Jul 14 10:42:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:42:45.257974 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df21b3bc-8a0d-4425-bcc6-ed1344c9d1fb None admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:42:45.330777 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=100 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:42:45.368650 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df21b3bc-8a0d-4425-bcc6-ed1344c9d1fb None admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:42:45.412732 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d662c5-5162-40d2-a81b-f05964e577b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:42:45.413541 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d662c5-5162-40d2-a81b-f05964e577b0 None admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:42:45.413829 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d662c5-5162-40d2-a81b-f05964e577b0 None admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:42:45.414114 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d662c5-5162-40d2-a81b-f05964e577b0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:42:45.422320 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d662c5-5162-40d2-a81b-f05964e577b0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:42:45.423969 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d662c5-5162-40d2-a81b-f05964e577b0 None admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:42:45.439308 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application [None req-47d662c5-5162-40d2-a81b-f05964e577b0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 10:42:45.439308 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:42:45.439308 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:42:45.439308 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:42:45.439308 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:42:45.439308 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:42:45.439308 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:42:45.439308 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:42:45.439308 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:42:45.439308 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:42:45.439308 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:42:45.439308 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:42:45.439308 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 10:42:45.439308 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 10:42:45.439308 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 10:42:45.441693 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 10:42:45.441693 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:42:45.441693 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:42:45.441693 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:42:45.441693 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:42:45.441693 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:42:45.441693 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:42:45.441693 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:42:45.441693 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application with Lock( Jul 14 10:42:45.441693 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:42:45.441693 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:42:45.441693 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:42:45.441693 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:42:45.441693 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:42:45.441693 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:42:45.441693 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:42:45.441693 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:42:45.442588 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 10:42:45.442588 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 10:42:45.442588 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 10:42:45.442588 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 10:42:45.442588 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 10:42:45.442588 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 10:42:45.442588 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 10:42:45.442588 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application Jul 14 10:42:45.442588 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 609/1217] 10.222.0.16 () {56 vars in 1111 bytes} [Thu Jul 14 10:42:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:42:45.447275 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf39a85-1238-4e07-a1c6-442653208dd7 None admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:42:45.564002 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf39a85-1238-4e07-a1c6-442653208dd7 None admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:42:45.586756 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=100 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:42:45.599000 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31be8106-f3fb-456e-b922-ee3fe7573d7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:42:45.599678 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31be8106-f3fb-456e-b922-ee3fe7573d7c None admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:42:45.600533 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31be8106-f3fb-456e-b922-ee3fe7573d7c None admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:42:45.600900 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31be8106-f3fb-456e-b922-ee3fe7573d7c None admin] PATH_INFO: `/v3/projects` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:42:45.601897 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31be8106-f3fb-456e-b922-ee3fe7573d7c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:42:45.603025 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31be8106-f3fb-456e-b922-ee3fe7573d7c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:42:45.604458 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31be8106-f3fb-456e-b922-ee3fe7573d7c None admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:42:45.617631 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 609/1218] 10.222.0.16 () {56 vars in 1148 bytes} [Thu Jul 14 10:42:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:42:45.623395 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d662c5-5162-40d2-a81b-f05964e577b0 None admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:42:45.732633 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d662c5-5162-40d2-a81b-f05964e577b0 None admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:42:45.761375 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=100 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:42:45.767462 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93fe58ca-23d1-437b-ab6e-eb221771bcf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:42:45.768224 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fe58ca-23d1-437b-ab6e-eb221771bcf5 None admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:42:45.768607 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fe58ca-23d1-437b-ab6e-eb221771bcf5 None admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:42:45.769024 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fe58ca-23d1-437b-ab6e-eb221771bcf5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:42:45.769951 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93fe58ca-23d1-437b-ab6e-eb221771bcf5 None admin] RBAC: Adding query filter params (role.id=d58911e96aad48cf9ca61ac5df79e21d, scope.project.id=59391272ecbe48b0aa736cb43807be1d, user.id=16846111ee2a42dd99c3052d40980f72) {{(pid=86656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:42:45.770364 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93fe58ca-23d1-437b-ab6e-eb221771bcf5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:42:45.771922 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93fe58ca-23d1-437b-ab6e-eb221771bcf5 None admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:42:45.785023 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 610/1219] 10.222.0.16 () {56 vars in 1374 bytes} [Thu Jul 14 10:42:45 2022] GET /identity/v3/role_assignments?user.id=16846111ee2a42dd99c3052d40980f72&scope.project.id=59391272ecbe48b0aa736cb43807be1d&role.id=d58911e96aad48cf9ca61ac5df79e21d => generated 259 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:42:47.863062 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41d6396-b21d-4f84-8063-d0b6e65938ec None None] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:42:47.863594 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41d6396-b21d-4f84-8063-d0b6e65938ec None None] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:42:47.863594 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41d6396-b21d-4f84-8063-d0b6e65938ec None None] PATH_INFO: `/` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:42:47.864998 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 610/1220] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jul 14 10:42:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:42:47.870679 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b5e41c-8179-4303-8fec-a0f762342d42 None None] REQUEST_METHOD: `POST` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:42:47.871119 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b5e41c-8179-4303-8fec-a0f762342d42 None None] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:42:47.871344 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b5e41c-8179-4303-8fec-a0f762342d42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:42:47.890330 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.auth.core [None req-b9b5e41c-8179-4303-8fec-a0f762342d42 None None] MFA Rules not processed for user `ae4bcdd8106d4bebbdcae96be33505bc`. Rule list: `[]` (Enabled: `True`). {{(pid=86656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:42:47.891564 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-b9b5e41c-8179-4303-8fec-a0f762342d42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:42:47.965698 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 611/1221] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jul 14 10:42:47 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 14 10:42:47.989696 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41d6396-b21d-4f84-8063-d0b6e65938ec None None] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:42:48.098649 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41d6396-b21d-4f84-8063-d0b6e65938ec None None] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:42:48.136260 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe807fb-b810-4ced-be34-482fc81ae2bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:42:48.137091 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe807fb-b810-4ced-be34-482fc81ae2bc None admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:42:48.137390 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe807fb-b810-4ced-be34-482fc81ae2bc None admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:42:48.137656 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe807fb-b810-4ced-be34-482fc81ae2bc None admin] PATH_INFO: `/v3/roles/service` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:42:48.149737 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe807fb-b810-4ced-be34-482fc81ae2bc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 10:42:48.157471 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application [None req-8fe807fb-b810-4ced-be34-482fc81ae2bc None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 14 10:42:48.157471 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:42:48.157471 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:42:48.157471 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:42:48.157471 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:42:48.157471 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:42:48.157471 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:42:48.157471 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:42:48.157471 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:42:48.157471 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:42:48.157471 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:42:48.157471 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:42:48.157471 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 10:42:48.157471 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 10:42:48.157471 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 10:42:48.157471 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 10:42:48.158630 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 10:42:48.158630 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 10:42:48.158630 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 10:42:48.158630 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 10:42:48.158630 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:42:48.158630 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:42:48.158630 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:42:48.158630 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:42:48.158630 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:42:48.158630 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:42:48.158630 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:42:48.158630 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application with Lock( Jul 14 10:42:48.158630 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:42:48.158630 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:42:48.158630 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:42:48.158630 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:42:48.159484 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:42:48.159484 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:42:48.159484 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:42:48.159484 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:42:48.159484 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 10:42:48.159484 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 10:42:48.159484 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 10:42:48.159484 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 10:42:48.159484 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 10:42:48.159484 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 10:42:48.159484 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 14 10:42:48.159484 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application Jul 14 10:42:48.159484 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 611/1222] 10.222.0.16 () {56 vars in 1102 bytes} [Thu Jul 14 10:42:47 2022] GET /identity/v3/roles/service => generated 85 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:42:48.165946 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b5e41c-8179-4303-8fec-a0f762342d42 None None] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:42:48.283829 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b5e41c-8179-4303-8fec-a0f762342d42 None None] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:42:48.310477 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=100 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:42:48.321719 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31219860-6b54-4b97-82b6-f46706f6d799 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:42:48.322392 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31219860-6b54-4b97-82b6-f46706f6d799 None admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:42:48.322677 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31219860-6b54-4b97-82b6-f46706f6d799 None admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:42:48.322954 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31219860-6b54-4b97-82b6-f46706f6d799 None admin] PATH_INFO: `/v3/roles` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:42:48.323700 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31219860-6b54-4b97-82b6-f46706f6d799 None admin] RBAC: Adding query filter params (name=service) {{(pid=86656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:42:48.324009 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31219860-6b54-4b97-82b6-f46706f6d799 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:42:48.325410 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31219860-6b54-4b97-82b6-f46706f6d799 None admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:42:48.335467 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 612/1223] 10.222.0.16 () {56 vars in 1103 bytes} [Thu Jul 14 10:42:48 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:42:48.341859 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe807fb-b810-4ced-be34-482fc81ae2bc None admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:42:48.391613 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=100 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:42:48.452204 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe807fb-b810-4ced-be34-482fc81ae2bc None admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:42:48.487993 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07409d7f-8cde-40fa-afeb-b1414ebf5ce4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:42:48.488813 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07409d7f-8cde-40fa-afeb-b1414ebf5ce4 None admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:42:48.489105 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07409d7f-8cde-40fa-afeb-b1414ebf5ce4 None admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:42:48.489381 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07409d7f-8cde-40fa-afeb-b1414ebf5ce4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:42:48.503224 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07409d7f-8cde-40fa-afeb-b1414ebf5ce4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:42:48.505427 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07409d7f-8cde-40fa-afeb-b1414ebf5ce4 None admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:42:48.528146 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application [None req-07409d7f-8cde-40fa-afeb-b1414ebf5ce4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 10:42:48.528146 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:42:48.528146 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:42:48.528146 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:42:48.528146 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:42:48.528146 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:42:48.528146 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:42:48.528146 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:42:48.528146 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:42:48.528146 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:42:48.528146 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:42:48.528146 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:42:48.528146 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 10:42:48.528146 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 10:42:48.528146 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 10:42:48.529326 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 10:42:48.529326 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:42:48.529326 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:42:48.529326 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:42:48.529326 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:42:48.529326 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:42:48.529326 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:42:48.529326 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:42:48.529326 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application with Lock( Jul 14 10:42:48.529326 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:42:48.529326 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:42:48.529326 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:42:48.529326 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:42:48.529326 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:42:48.529326 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:42:48.529326 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:42:48.529326 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:42:48.530264 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 10:42:48.530264 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 10:42:48.530264 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 10:42:48.530264 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application Jul 14 10:42:48.530264 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 612/1224] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Jul 14 10:42:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:42:48.535900 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31219860-6b54-4b97-82b6-f46706f6d799 None admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:42:48.637388 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31219860-6b54-4b97-82b6-f46706f6d799 None admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:42:48.671445 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8115b0f-5029-48e6-88cb-da074430b21b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:42:48.672027 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8115b0f-5029-48e6-88cb-da074430b21b None admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:42:48.672309 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8115b0f-5029-48e6-88cb-da074430b21b None admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:42:48.672583 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8115b0f-5029-48e6-88cb-da074430b21b None admin] PATH_INFO: `/v3/domains` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:42:48.673338 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8115b0f-5029-48e6-88cb-da074430b21b None admin] RBAC: Adding query filter params (name=Default) {{(pid=86656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:42:48.673646 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8115b0f-5029-48e6-88cb-da074430b21b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:42:48.675015 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8115b0f-5029-48e6-88cb-da074430b21b None admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:42:48.689713 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 613/1225] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Jul 14 10:42:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 10:42:48.696102 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07409d7f-8cde-40fa-afeb-b1414ebf5ce4 None admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:42:48.801839 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=100 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:42:48.809812 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07409d7f-8cde-40fa-afeb-b1414ebf5ce4 None admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:42:48.849775 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5aa8bdf-1a95-4bc5-b58b-7a4319758106 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:42:48.850589 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5aa8bdf-1a95-4bc5-b58b-7a4319758106 None admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:42:48.850872 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5aa8bdf-1a95-4bc5-b58b-7a4319758106 None admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:42:48.851139 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5aa8bdf-1a95-4bc5-b58b-7a4319758106 None admin] PATH_INFO: `/v3/users/placement` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:42:48.858594 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5aa8bdf-1a95-4bc5-b58b-7a4319758106 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:42:48.860020 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5aa8bdf-1a95-4bc5-b58b-7a4319758106 None admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:42:48.876736 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application [None req-c5aa8bdf-1a95-4bc5-b58b-7a4319758106 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 14 10:42:48.876736 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:42:48.876736 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:42:48.876736 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:42:48.876736 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:42:48.876736 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:42:48.876736 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:42:48.876736 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:42:48.876736 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:42:48.876736 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:42:48.876736 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:42:48.876736 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:42:48.876736 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 10:42:48.876736 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 10:42:48.876736 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 10:42:48.876736 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 10:42:48.878159 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:42:48.878159 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:42:48.878159 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 10:42:48.878159 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 10:42:48.878159 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 10:42:48.878159 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 10:42:48.878159 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:42:48.878159 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:42:48.878159 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:42:48.878159 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:42:48.878159 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:42:48.878159 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application with Lock( Jul 14 10:42:48.878159 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:42:48.878159 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:42:48.878159 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:42:48.878159 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:42:48.878159 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:42:48.878159 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:42:48.879084 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:42:48.879084 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:42:48.879084 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 10:42:48.879084 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 10:42:48.879084 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 10:42:48.879084 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 10:42:48.879084 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 10:42:48.879084 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 10:42:48.879084 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 14 10:42:48.879084 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application Jul 14 10:42:48.879084 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 613/1226] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Jul 14 10:42:48 2022] GET /identity/v3/users/placement => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:42:48.885548 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8115b0f-5029-48e6-88cb-da074430b21b None admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:42:48.937688 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=100 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:42:48.993358 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8115b0f-5029-48e6-88cb-da074430b21b None admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:42:49.027550 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52950ea3-0cf9-4128-9489-5305726fe9f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:42:49.028227 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52950ea3-0cf9-4128-9489-5305726fe9f4 None admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:42:49.028513 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52950ea3-0cf9-4128-9489-5305726fe9f4 None admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:42:49.028824 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52950ea3-0cf9-4128-9489-5305726fe9f4 None admin] PATH_INFO: `/v3/users` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:42:49.029661 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52950ea3-0cf9-4128-9489-5305726fe9f4 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=86656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:42:49.029978 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52950ea3-0cf9-4128-9489-5305726fe9f4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:42:49.031412 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52950ea3-0cf9-4128-9489-5305726fe9f4 None admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:42:49.050011 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 614/1227] 10.222.0.16 () {56 vars in 1143 bytes} [Thu Jul 14 10:42:48 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:42:49.055860 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5aa8bdf-1a95-4bc5-b58b-7a4319758106 None admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:42:49.160280 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5aa8bdf-1a95-4bc5-b58b-7a4319758106 None admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:42:49.196636 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a3484a-2dd8-42dc-8820-54726cf81b44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:42:49.198514 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a3484a-2dd8-42dc-8820-54726cf81b44 None admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:42:49.198820 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a3484a-2dd8-42dc-8820-54726cf81b44 None admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:42:49.199089 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a3484a-2dd8-42dc-8820-54726cf81b44 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:42:49.211992 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a3484a-2dd8-42dc-8820-54726cf81b44 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:42:49.213581 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a3484a-2dd8-42dc-8820-54726cf81b44 None admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:42:49.233944 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application [None req-42a3484a-2dd8-42dc-8820-54726cf81b44 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 10:42:49.233944 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:42:49.233944 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:42:49.233944 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:42:49.233944 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:42:49.233944 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:42:49.233944 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:42:49.233944 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:42:49.233944 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:42:49.233944 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:42:49.233944 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:42:49.233944 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:42:49.233944 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 10:42:49.233944 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 10:42:49.233944 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 10:42:49.235106 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 10:42:49.235106 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:42:49.235106 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:42:49.235106 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:42:49.235106 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:42:49.235106 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:42:49.235106 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:42:49.235106 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:42:49.235106 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application with Lock( Jul 14 10:42:49.235106 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:42:49.235106 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:42:49.235106 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:42:49.235106 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:42:49.235106 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:42:49.235106 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:42:49.235106 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:42:49.235106 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:42:49.236177 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 10:42:49.236177 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 10:42:49.236177 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 10:42:49.236177 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application Jul 14 10:42:49.236177 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 614/1228] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Jul 14 10:42:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:42:49.241200 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52950ea3-0cf9-4128-9489-5305726fe9f4 None admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:42:49.355487 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52950ea3-0cf9-4128-9489-5305726fe9f4 None admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:42:49.357912 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=100 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:42:49.393583 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309970b3-4620-4cb9-ae88-abb854c68534 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:42:49.394256 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309970b3-4620-4cb9-ae88-abb854c68534 None admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:42:49.394538 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309970b3-4620-4cb9-ae88-abb854c68534 None admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:42:49.394814 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309970b3-4620-4cb9-ae88-abb854c68534 None admin] PATH_INFO: `/v3/domains` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:42:49.395571 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309970b3-4620-4cb9-ae88-abb854c68534 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:42:49.395851 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309970b3-4620-4cb9-ae88-abb854c68534 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:42:49.397419 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309970b3-4620-4cb9-ae88-abb854c68534 None admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:42:49.415470 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 615/1229] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Jul 14 10:42:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 10:42:49.416574 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a3484a-2dd8-42dc-8820-54726cf81b44 None admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:42:49.426261 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=100 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:42:49.540990 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a3484a-2dd8-42dc-8820-54726cf81b44 None admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:42:49.582136 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd25fd3-9a9a-43f4-b6c6-e2fc80acd011 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:42:49.582940 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd25fd3-9a9a-43f4-b6c6-e2fc80acd011 None admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:42:49.583226 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd25fd3-9a9a-43f4-b6c6-e2fc80acd011 None admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:42:49.583501 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd25fd3-9a9a-43f4-b6c6-e2fc80acd011 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:42:49.591074 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd25fd3-9a9a-43f4-b6c6-e2fc80acd011 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:42:49.592794 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd25fd3-9a9a-43f4-b6c6-e2fc80acd011 None admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:42:49.609170 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application [None req-ebd25fd3-9a9a-43f4-b6c6-e2fc80acd011 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 10:42:49.609170 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:42:49.609170 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:42:49.609170 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:42:49.609170 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:42:49.609170 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:42:49.609170 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:42:49.609170 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:42:49.609170 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:42:49.609170 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:42:49.609170 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:42:49.609170 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:42:49.609170 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 10:42:49.609170 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 10:42:49.609170 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 10:42:49.610398 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 10:42:49.610398 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:42:49.610398 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:42:49.610398 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:42:49.610398 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:42:49.610398 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:42:49.610398 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:42:49.610398 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:42:49.610398 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application with Lock( Jul 14 10:42:49.610398 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:42:49.610398 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:42:49.610398 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:42:49.610398 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:42:49.610398 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:42:49.610398 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:42:49.610398 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:42:49.610398 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:42:49.611418 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 10:42:49.611418 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 10:42:49.611418 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 10:42:49.611418 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 10:42:49.611418 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 10:42:49.611418 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 10:42:49.611418 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 10:42:49.611418 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application Jul 14 10:42:49.611418 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 615/1230] 10.222.0.16 () {56 vars in 1111 bytes} [Thu Jul 14 10:42:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 10:42:49.617033 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309970b3-4620-4cb9-ae88-abb854c68534 None admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:42:49.727308 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309970b3-4620-4cb9-ae88-abb854c68534 None admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:42:49.761951 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5859b16-2667-4638-9d65-cf2b2fcbcebc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:42:49.762609 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5859b16-2667-4638-9d65-cf2b2fcbcebc None admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:42:49.762898 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5859b16-2667-4638-9d65-cf2b2fcbcebc None admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:42:49.763192 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5859b16-2667-4638-9d65-cf2b2fcbcebc None admin] PATH_INFO: `/v3/projects` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:42:49.763975 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5859b16-2667-4638-9d65-cf2b2fcbcebc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:42:49.764282 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5859b16-2667-4638-9d65-cf2b2fcbcebc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:42:49.765764 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5859b16-2667-4638-9d65-cf2b2fcbcebc None admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:42:49.779738 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 616/1231] 10.222.0.16 () {56 vars in 1148 bytes} [Thu Jul 14 10:42:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:42:49.784677 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd25fd3-9a9a-43f4-b6c6-e2fc80acd011 None admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:42:49.855316 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=100 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:42:49.891894 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd25fd3-9a9a-43f4-b6c6-e2fc80acd011 None admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:42:49.928360 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0c6d06-4dbf-40f8-96cd-445a9ff79f32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:42:49.929384 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0c6d06-4dbf-40f8-96cd-445a9ff79f32 None admin] REQUEST_METHOD: `PUT` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:42:49.929690 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0c6d06-4dbf-40f8-96cd-445a9ff79f32 None admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:42:49.929959 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0c6d06-4dbf-40f8-96cd-445a9ff79f32 None admin] PATH_INFO: `/v3/projects/59391272ecbe48b0aa736cb43807be1d/users/16846111ee2a42dd99c3052d40980f72/roles/d58911e96aad48cf9ca61ac5df79e21d` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:42:49.945173 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0c6d06-4dbf-40f8-96cd-445a9ff79f32 None admin] RBAC: Authorizing `identity:create_grant(project_id=59391272ecbe48b0aa736cb43807be1d, user_id=16846111ee2a42dd99c3052d40980f72, role_id=d58911e96aad48cf9ca61ac5df79e21d)` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:42:49.946621 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0c6d06-4dbf-40f8-96cd-445a9ff79f32 None admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:42:49.958701 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 616/1232] 10.222.0.16 () {58 vars in 1439 bytes} [Thu Jul 14 10:42:49 2022] PUT /identity/v3/projects/59391272ecbe48b0aa736cb43807be1d/users/16846111ee2a42dd99c3052d40980f72/roles/d58911e96aad48cf9ca61ac5df79e21d => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:42:52.145665 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbb1670-d3e8-48db-97a9-7f128d7cad95 None None] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:42:52.146236 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbb1670-d3e8-48db-97a9-7f128d7cad95 None None] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:42:52.146236 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbb1670-d3e8-48db-97a9-7f128d7cad95 None None] PATH_INFO: `/` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:42:52.147784 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 617/1233] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jul 14 10:42:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:42:52.153006 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1a6c8f-92c9-4712-9a11-6fc4bd3f18d1 None None] REQUEST_METHOD: `POST` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:42:52.153391 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1a6c8f-92c9-4712-9a11-6fc4bd3f18d1 None None] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:42:52.153569 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1a6c8f-92c9-4712-9a11-6fc4bd3f18d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:42:52.170854 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.auth.core [None req-3d1a6c8f-92c9-4712-9a11-6fc4bd3f18d1 None None] MFA Rules not processed for user `ae4bcdd8106d4bebbdcae96be33505bc`. Rule list: `[]` (Enabled: `True`). {{(pid=86655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:42:52.172060 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-3d1a6c8f-92c9-4712-9a11-6fc4bd3f18d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:42:52.243894 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 617/1234] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jul 14 10:42:52 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 10:42:52.269278 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbb1670-d3e8-48db-97a9-7f128d7cad95 None None] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:42:52.298848 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=100 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:42:52.382459 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbb1670-d3e8-48db-97a9-7f128d7cad95 None None] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:42:52.417447 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6bc0e3-0795-45a1-9d06-7dbbcb846c0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:42:52.418167 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6bc0e3-0795-45a1-9d06-7dbbcb846c0c None admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:42:52.418450 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6bc0e3-0795-45a1-9d06-7dbbcb846c0c None admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:42:52.418731 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6bc0e3-0795-45a1-9d06-7dbbcb846c0c None admin] PATH_INFO: `/v3/roles/service` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:42:52.428821 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6bc0e3-0795-45a1-9d06-7dbbcb846c0c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 10:42:52.437879 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application [None req-6c6bc0e3-0795-45a1-9d06-7dbbcb846c0c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 14 10:42:52.437879 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:42:52.437879 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:42:52.437879 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:42:52.437879 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:42:52.437879 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:42:52.437879 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:42:52.437879 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:42:52.437879 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:42:52.437879 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:42:52.437879 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:42:52.437879 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:42:52.437879 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 10:42:52.437879 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 10:42:52.437879 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 10:42:52.437879 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 10:42:52.438979 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 10:42:52.438979 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 10:42:52.438979 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 10:42:52.438979 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 10:42:52.438979 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:42:52.438979 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:42:52.438979 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:42:52.438979 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:42:52.438979 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:42:52.438979 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:42:52.438979 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:42:52.438979 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application with Lock( Jul 14 10:42:52.438979 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:42:52.438979 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:42:52.438979 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:42:52.438979 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:42:52.439959 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:42:52.439959 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:42:52.439959 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:42:52.439959 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:42:52.439959 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 10:42:52.439959 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 10:42:52.439959 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 10:42:52.439959 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 10:42:52.439959 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 10:42:52.439959 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 10:42:52.439959 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 14 10:42:52.439959 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application Jul 14 10:42:52.439959 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 618/1235] 10.222.0.16 () {56 vars in 1102 bytes} [Thu Jul 14 10:42:52 2022] GET /identity/v3/roles/service => generated 85 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:42:52.446318 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1a6c8f-92c9-4712-9a11-6fc4bd3f18d1 None None] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:42:52.499777 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:42:52.570939 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1a6c8f-92c9-4712-9a11-6fc4bd3f18d1 None None] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:42:52.609965 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88937c15-9530-484f-8325-5da6179d15c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:42:52.610809 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88937c15-9530-484f-8325-5da6179d15c2 None admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:42:52.611101 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88937c15-9530-484f-8325-5da6179d15c2 None admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:42:52.613188 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88937c15-9530-484f-8325-5da6179d15c2 None admin] PATH_INFO: `/v3/roles` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:42:52.614005 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88937c15-9530-484f-8325-5da6179d15c2 None admin] RBAC: Adding query filter params (name=service) {{(pid=86655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:42:52.614325 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88937c15-9530-484f-8325-5da6179d15c2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:42:52.616507 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88937c15-9530-484f-8325-5da6179d15c2 None admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:42:52.625639 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 618/1236] 10.222.0.16 () {56 vars in 1103 bytes} [Thu Jul 14 10:42:52 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 10:42:52.632347 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6bc0e3-0795-45a1-9d06-7dbbcb846c0c None admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:42:52.729648 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=100 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:42:52.749650 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6bc0e3-0795-45a1-9d06-7dbbcb846c0c None admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:42:52.794032 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da5d067-e654-4ae3-8237-aa0fae00ca6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:42:52.794907 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da5d067-e654-4ae3-8237-aa0fae00ca6a None admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:42:52.795210 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da5d067-e654-4ae3-8237-aa0fae00ca6a None admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:42:52.795508 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da5d067-e654-4ae3-8237-aa0fae00ca6a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:42:52.809314 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da5d067-e654-4ae3-8237-aa0fae00ca6a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:42:52.810818 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da5d067-e654-4ae3-8237-aa0fae00ca6a None admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:42:52.830385 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application [None req-9da5d067-e654-4ae3-8237-aa0fae00ca6a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 10:42:52.830385 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:42:52.830385 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:42:52.830385 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:42:52.830385 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:42:52.830385 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:42:52.830385 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:42:52.830385 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:42:52.830385 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:42:52.830385 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:42:52.830385 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:42:52.830385 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:42:52.830385 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 10:42:52.830385 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 10:42:52.830385 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 10:42:52.831536 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 10:42:52.831536 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:42:52.831536 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:42:52.831536 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:42:52.831536 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:42:52.831536 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:42:52.831536 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:42:52.831536 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:42:52.831536 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application with Lock( Jul 14 10:42:52.831536 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:42:52.831536 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:42:52.831536 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:42:52.831536 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:42:52.831536 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:42:52.831536 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:42:52.831536 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:42:52.831536 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:42:52.832460 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 10:42:52.832460 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 10:42:52.832460 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 10:42:52.832460 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application Jul 14 10:42:52.832460 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 619/1237] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Jul 14 10:42:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:42:52.838022 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88937c15-9530-484f-8325-5da6179d15c2 None admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:42:52.946423 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88937c15-9530-484f-8325-5da6179d15c2 None admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:42:52.955719 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=100 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:42:52.986391 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3657c979-70b5-4aa8-a6fc-d63fcea952d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:42:52.987029 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3657c979-70b5-4aa8-a6fc-d63fcea952d7 None admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:42:52.987319 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3657c979-70b5-4aa8-a6fc-d63fcea952d7 None admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:42:52.987613 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3657c979-70b5-4aa8-a6fc-d63fcea952d7 None admin] PATH_INFO: `/v3/domains` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:42:52.988420 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3657c979-70b5-4aa8-a6fc-d63fcea952d7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:42:52.988739 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3657c979-70b5-4aa8-a6fc-d63fcea952d7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:42:52.990902 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3657c979-70b5-4aa8-a6fc-d63fcea952d7 None admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:42:53.004512 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 619/1238] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Jul 14 10:42:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:42:53.011237 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da5d067-e654-4ae3-8237-aa0fae00ca6a None admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:42:53.127399 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da5d067-e654-4ae3-8237-aa0fae00ca6a None admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:42:53.169151 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e551f2b4-04a1-4e26-a998-26bd7c4d7eeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:42:53.170010 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e551f2b4-04a1-4e26-a998-26bd7c4d7eeb None admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:42:53.170301 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e551f2b4-04a1-4e26-a998-26bd7c4d7eeb None admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:42:53.170587 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e551f2b4-04a1-4e26-a998-26bd7c4d7eeb None admin] PATH_INFO: `/v3/users/placement` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:42:53.173628 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=100 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:42:53.179642 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e551f2b4-04a1-4e26-a998-26bd7c4d7eeb None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:42:53.181316 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e551f2b4-04a1-4e26-a998-26bd7c4d7eeb None admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:42:53.197899 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application [None req-e551f2b4-04a1-4e26-a998-26bd7c4d7eeb None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 14 10:42:53.197899 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:42:53.197899 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:42:53.197899 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:42:53.197899 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:42:53.197899 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:42:53.197899 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:42:53.197899 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:42:53.197899 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:42:53.197899 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:42:53.197899 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:42:53.197899 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:42:53.197899 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 10:42:53.197899 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 10:42:53.197899 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 10:42:53.197899 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 10:42:53.199026 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:42:53.199026 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:42:53.199026 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 10:42:53.199026 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 10:42:53.199026 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 10:42:53.199026 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 10:42:53.199026 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:42:53.199026 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:42:53.199026 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:42:53.199026 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:42:53.199026 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:42:53.199026 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application with Lock( Jul 14 10:42:53.199026 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:42:53.199026 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:42:53.199026 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:42:53.199026 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:42:53.199026 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:42:53.199026 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:42:53.200191 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:42:53.200191 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:42:53.200191 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 10:42:53.200191 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 10:42:53.200191 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 10:42:53.200191 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 10:42:53.200191 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 10:42:53.200191 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 10:42:53.200191 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 14 10:42:53.200191 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application Jul 14 10:42:53.200191 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 620/1239] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Jul 14 10:42:53 2022] GET /identity/v3/users/placement => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:42:53.204946 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3657c979-70b5-4aa8-a6fc-d63fcea952d7 None admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:42:53.315596 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3657c979-70b5-4aa8-a6fc-d63fcea952d7 None admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:42:53.351629 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c70d93-c5cc-4e64-8dcc-6bebcd3021a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:42:53.352306 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c70d93-c5cc-4e64-8dcc-6bebcd3021a7 None admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:42:53.352592 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c70d93-c5cc-4e64-8dcc-6bebcd3021a7 None admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:42:53.352943 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c70d93-c5cc-4e64-8dcc-6bebcd3021a7 None admin] PATH_INFO: `/v3/users` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:42:53.353749 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c70d93-c5cc-4e64-8dcc-6bebcd3021a7 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=86655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:42:53.354086 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c70d93-c5cc-4e64-8dcc-6bebcd3021a7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:42:53.355501 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c70d93-c5cc-4e64-8dcc-6bebcd3021a7 None admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:42:53.373474 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 620/1240] 10.222.0.16 () {56 vars in 1143 bytes} [Thu Jul 14 10:42:53 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:42:53.379798 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e551f2b4-04a1-4e26-a998-26bd7c4d7eeb None admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:42:53.504391 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e551f2b4-04a1-4e26-a998-26bd7c4d7eeb None admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:42:53.543335 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196d8d4d-0d1e-46b3-8689-f62c35315628 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:42:53.544057 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196d8d4d-0d1e-46b3-8689-f62c35315628 None admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:42:53.544389 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196d8d4d-0d1e-46b3-8689-f62c35315628 None admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:42:53.544744 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196d8d4d-0d1e-46b3-8689-f62c35315628 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:42:53.622045 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=100 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:42:53.629132 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196d8d4d-0d1e-46b3-8689-f62c35315628 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:42:53.630589 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196d8d4d-0d1e-46b3-8689-f62c35315628 None admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:42:53.740750 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 621/1241] 10.222.0.16 () {58 vars in 1282 bytes} [Thu Jul 14 10:42:53 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 14 10:42:53.746640 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c70d93-c5cc-4e64-8dcc-6bebcd3021a7 None admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:42:53.776210 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=100 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:42:53.862147 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c70d93-c5cc-4e64-8dcc-6bebcd3021a7 None admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:42:53.900025 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c069c6-6829-46ad-8664-c7070eb62563 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:42:53.900764 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c069c6-6829-46ad-8664-c7070eb62563 None admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:42:53.901123 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c069c6-6829-46ad-8664-c7070eb62563 None admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:42:53.901406 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c069c6-6829-46ad-8664-c7070eb62563 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:42:53.913260 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c069c6-6829-46ad-8664-c7070eb62563 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:42:53.914943 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c069c6-6829-46ad-8664-c7070eb62563 None admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:42:53.936184 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application [None req-45c069c6-6829-46ad-8664-c7070eb62563 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 10:42:53.936184 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:42:53.936184 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:42:53.936184 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:42:53.936184 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:42:53.936184 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:42:53.936184 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:42:53.936184 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:42:53.936184 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:42:53.936184 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:42:53.936184 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:42:53.936184 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:42:53.936184 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 10:42:53.936184 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 10:42:53.936184 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 10:42:53.937497 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 10:42:53.937497 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:42:53.937497 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:42:53.937497 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:42:53.937497 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:42:53.937497 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:42:53.937497 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:42:53.937497 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:42:53.937497 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application with Lock( Jul 14 10:42:53.937497 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:42:53.937497 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:42:53.937497 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:42:53.937497 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:42:53.937497 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:42:53.937497 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:42:53.937497 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:42:53.937497 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:42:53.938577 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 10:42:53.938577 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 10:42:53.938577 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 10:42:53.938577 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application Jul 14 10:42:53.938577 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 621/1242] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Jul 14 10:42:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:42:53.944727 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196d8d4d-0d1e-46b3-8689-f62c35315628 None admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:42:54.055603 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=100 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:42:54.062733 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196d8d4d-0d1e-46b3-8689-f62c35315628 None admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:42:54.105476 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0ff770-5094-4865-aed0-64161579cb78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:42:54.106276 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0ff770-5094-4865-aed0-64161579cb78 None admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:42:54.106585 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0ff770-5094-4865-aed0-64161579cb78 None admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:42:54.106976 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0ff770-5094-4865-aed0-64161579cb78 None admin] PATH_INFO: `/v3/domains` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:42:54.107717 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0ff770-5094-4865-aed0-64161579cb78 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:42:54.108164 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0ff770-5094-4865-aed0-64161579cb78 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:42:54.109774 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0ff770-5094-4865-aed0-64161579cb78 None admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:42:54.123935 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 622/1243] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Jul 14 10:42:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 10:42:54.129394 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c069c6-6829-46ad-8664-c7070eb62563 None admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:42:54.217354 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=100 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:42:54.243316 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c069c6-6829-46ad-8664-c7070eb62563 None admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:42:54.284041 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9e9be0-ee1d-4be5-a0d5-b68510887355 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:42:54.284914 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9e9be0-ee1d-4be5-a0d5-b68510887355 None admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:42:54.285208 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9e9be0-ee1d-4be5-a0d5-b68510887355 None admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:42:54.285545 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9e9be0-ee1d-4be5-a0d5-b68510887355 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:42:54.293860 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9e9be0-ee1d-4be5-a0d5-b68510887355 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:42:54.295349 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9e9be0-ee1d-4be5-a0d5-b68510887355 None admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:42:54.310140 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application [None req-fa9e9be0-ee1d-4be5-a0d5-b68510887355 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 10:42:54.310140 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:42:54.310140 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:42:54.310140 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:42:54.310140 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:42:54.310140 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:42:54.310140 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:42:54.310140 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:42:54.310140 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:42:54.310140 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:42:54.310140 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:42:54.310140 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:42:54.310140 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 10:42:54.310140 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 10:42:54.310140 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 10:42:54.311353 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 10:42:54.311353 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:42:54.311353 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:42:54.311353 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:42:54.311353 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:42:54.311353 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:42:54.311353 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:42:54.311353 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:42:54.311353 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application with Lock( Jul 14 10:42:54.311353 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:42:54.311353 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:42:54.311353 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:42:54.311353 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:42:54.311353 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:42:54.311353 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:42:54.311353 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:42:54.311353 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:42:54.312653 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 10:42:54.312653 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 10:42:54.312653 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 10:42:54.312653 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 10:42:54.312653 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 10:42:54.312653 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 10:42:54.312653 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 10:42:54.312653 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application Jul 14 10:42:54.312653 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 622/1244] 10.222.0.16 () {56 vars in 1111 bytes} [Thu Jul 14 10:42:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 10:42:54.317188 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0ff770-5094-4865-aed0-64161579cb78 None admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:42:54.426834 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0ff770-5094-4865-aed0-64161579cb78 None admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:42:54.466343 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbf85bc-3d9e-459c-840e-77066dc46102 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:42:54.467025 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbf85bc-3d9e-459c-840e-77066dc46102 None admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:42:54.467291 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbf85bc-3d9e-459c-840e-77066dc46102 None admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:42:54.467611 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbf85bc-3d9e-459c-840e-77066dc46102 None admin] PATH_INFO: `/v3/projects` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:42:54.468345 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cbf85bc-3d9e-459c-840e-77066dc46102 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:42:54.468655 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cbf85bc-3d9e-459c-840e-77066dc46102 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:42:54.470118 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cbf85bc-3d9e-459c-840e-77066dc46102 None admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:42:54.482403 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 623/1245] 10.222.0.16 () {56 vars in 1148 bytes} [Thu Jul 14 10:42:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:42:54.488558 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9e9be0-ee1d-4be5-a0d5-b68510887355 None admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:42:54.599313 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9e9be0-ee1d-4be5-a0d5-b68510887355 None admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:42:54.638597 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71cdb1fb-509b-4e2e-84e4-d026d4dad26d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:42:54.639295 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cdb1fb-509b-4e2e-84e4-d026d4dad26d None admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:42:54.639634 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cdb1fb-509b-4e2e-84e4-d026d4dad26d None admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:42:54.639938 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cdb1fb-509b-4e2e-84e4-d026d4dad26d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:42:54.640907 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71cdb1fb-509b-4e2e-84e4-d026d4dad26d None admin] RBAC: Adding query filter params (role.id=d58911e96aad48cf9ca61ac5df79e21d, scope.project.id=59391272ecbe48b0aa736cb43807be1d, user.id=16846111ee2a42dd99c3052d40980f72) {{(pid=86655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:42:54.641226 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71cdb1fb-509b-4e2e-84e4-d026d4dad26d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:42:54.642789 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71cdb1fb-509b-4e2e-84e4-d026d4dad26d None admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:42:54.651177 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 623/1246] 10.222.0.16 () {56 vars in 1374 bytes} [Thu Jul 14 10:42:54 2022] GET /identity/v3/role_assignments?user.id=16846111ee2a42dd99c3052d40980f72&scope.project.id=59391272ecbe48b0aa736cb43807be1d&role.id=d58911e96aad48cf9ca61ac5df79e21d => generated 608 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:42:56.884238 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de97175-ab78-44b7-99f2-a9b2251546ab None None] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:42:56.884819 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de97175-ab78-44b7-99f2-a9b2251546ab None None] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:42:56.884911 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de97175-ab78-44b7-99f2-a9b2251546ab None None] PATH_INFO: `/` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:42:56.886243 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 624/1247] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jul 14 10:42:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:42:56.893135 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575512ff-bf2a-4036-836b-45d567d3b100 None None] REQUEST_METHOD: `POST` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:42:56.893634 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575512ff-bf2a-4036-836b-45d567d3b100 None None] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:42:56.893727 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575512ff-bf2a-4036-836b-45d567d3b100 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:42:56.901532 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=100 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:42:56.916605 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.auth.core [None req-575512ff-bf2a-4036-836b-45d567d3b100 None None] MFA Rules not processed for user `ae4bcdd8106d4bebbdcae96be33505bc`. Rule list: `[]` (Enabled: `True`). {{(pid=86655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:42:56.918381 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-575512ff-bf2a-4036-836b-45d567d3b100 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:42:57.001290 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 624/1248] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jul 14 10:42:56 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 10:42:57.025667 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de97175-ab78-44b7-99f2-a9b2251546ab None None] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:42:57.046146 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=100 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:42:57.133997 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de97175-ab78-44b7-99f2-a9b2251546ab None None] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:42:57.169423 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8c8703-a949-417f-a27f-06496c64bbee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:42:57.170220 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8c8703-a949-417f-a27f-06496c64bbee None admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:42:57.170506 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8c8703-a949-417f-a27f-06496c64bbee None admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:42:57.170812 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8c8703-a949-417f-a27f-06496c64bbee None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:42:57.182334 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8c8703-a949-417f-a27f-06496c64bbee None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 10:42:57.190199 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application [None req-1e8c8703-a949-417f-a27f-06496c64bbee None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 10:42:57.190199 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:42:57.190199 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:42:57.190199 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:42:57.190199 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:42:57.190199 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:42:57.190199 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:42:57.190199 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:42:57.190199 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:42:57.190199 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:42:57.190199 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:42:57.190199 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:42:57.190199 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 10:42:57.190199 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 10:42:57.190199 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 10:42:57.190199 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 10:42:57.191231 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 10:42:57.191231 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 10:42:57.191231 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 10:42:57.191231 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 10:42:57.191231 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:42:57.191231 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:42:57.191231 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:42:57.191231 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:42:57.191231 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:42:57.191231 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:42:57.191231 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:42:57.191231 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application with Lock( Jul 14 10:42:57.191231 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:42:57.191231 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:42:57.191231 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:42:57.191231 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:42:57.192052 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:42:57.192052 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:42:57.192052 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:42:57.192052 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:42:57.192052 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 10:42:57.192052 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 10:42:57.192052 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 10:42:57.192052 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 10:42:57.192052 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 10:42:57.192052 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 10:42:57.192052 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 10:42:57.192052 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application Jul 14 10:42:57.192052 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 625/1249] 10.222.0.16 () {56 vars in 1096 bytes} [Thu Jul 14 10:42:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:42:57.197540 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575512ff-bf2a-4036-836b-45d567d3b100 None None] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:42:57.301192 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575512ff-bf2a-4036-836b-45d567d3b100 None None] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:42:57.336809 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=100 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:42:57.342817 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3034f60-5aa1-41f8-9d7b-1871c650d47e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:42:57.343731 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3034f60-5aa1-41f8-9d7b-1871c650d47e None admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:42:57.344135 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3034f60-5aa1-41f8-9d7b-1871c650d47e None admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:42:57.344696 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3034f60-5aa1-41f8-9d7b-1871c650d47e None admin] PATH_INFO: `/v3/roles` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:42:57.345680 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3034f60-5aa1-41f8-9d7b-1871c650d47e None admin] RBAC: Adding query filter params (name=admin) {{(pid=86655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:42:57.346064 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3034f60-5aa1-41f8-9d7b-1871c650d47e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:42:57.347634 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3034f60-5aa1-41f8-9d7b-1871c650d47e None admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:42:57.357327 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 625/1250] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Jul 14 10:42:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:42:57.363383 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8c8703-a949-417f-a27f-06496c64bbee None admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:42:57.451436 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=100 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:42:57.480056 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8c8703-a949-417f-a27f-06496c64bbee None admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:42:57.520088 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f87bb0-d3e3-4515-a41a-a6444df4c0f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:42:57.521261 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f87bb0-d3e3-4515-a41a-a6444df4c0f2 None admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:42:57.521603 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f87bb0-d3e3-4515-a41a-a6444df4c0f2 None admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:42:57.522212 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f87bb0-d3e3-4515-a41a-a6444df4c0f2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:42:57.540275 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f87bb0-d3e3-4515-a41a-a6444df4c0f2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:42:57.542075 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f87bb0-d3e3-4515-a41a-a6444df4c0f2 None admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:42:57.567927 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application [None req-18f87bb0-d3e3-4515-a41a-a6444df4c0f2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 10:42:57.567927 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:42:57.567927 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:42:57.567927 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:42:57.567927 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:42:57.567927 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:42:57.567927 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:42:57.567927 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:42:57.567927 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:42:57.567927 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:42:57.567927 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:42:57.567927 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:42:57.567927 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 10:42:57.567927 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 10:42:57.567927 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 10:42:57.569061 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 10:42:57.569061 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:42:57.569061 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:42:57.569061 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:42:57.569061 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:42:57.569061 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:42:57.569061 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:42:57.569061 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:42:57.569061 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application with Lock( Jul 14 10:42:57.569061 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:42:57.569061 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:42:57.569061 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:42:57.569061 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:42:57.569061 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:42:57.569061 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:42:57.569061 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:42:57.569061 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:42:57.570240 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 10:42:57.570240 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 10:42:57.570240 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 10:42:57.570240 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application Jul 14 10:42:57.570240 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 626/1251] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Jul 14 10:42:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:42:57.575615 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3034f60-5aa1-41f8-9d7b-1871c650d47e None admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:42:57.696207 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3034f60-5aa1-41f8-9d7b-1871c650d47e None admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:42:57.741300 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2913252b-28a2-4eb7-8092-9b39a0fbaa14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:42:57.741983 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2913252b-28a2-4eb7-8092-9b39a0fbaa14 None admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:42:57.742270 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2913252b-28a2-4eb7-8092-9b39a0fbaa14 None admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:42:57.742551 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2913252b-28a2-4eb7-8092-9b39a0fbaa14 None admin] PATH_INFO: `/v3/domains` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:42:57.743295 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2913252b-28a2-4eb7-8092-9b39a0fbaa14 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:42:57.743602 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2913252b-28a2-4eb7-8092-9b39a0fbaa14 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:42:57.745422 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2913252b-28a2-4eb7-8092-9b39a0fbaa14 None admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:42:57.759331 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 626/1252] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Jul 14 10:42:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:42:57.765257 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f87bb0-d3e3-4515-a41a-a6444df4c0f2 None admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:42:57.885244 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f87bb0-d3e3-4515-a41a-a6444df4c0f2 None admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:42:57.912334 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=100 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:42:57.920696 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d0df73-b270-47d0-bfba-da114c0eaee2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:42:57.921532 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d0df73-b270-47d0-bfba-da114c0eaee2 None admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:42:57.921820 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d0df73-b270-47d0-bfba-da114c0eaee2 None admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:42:57.922097 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d0df73-b270-47d0-bfba-da114c0eaee2 None admin] PATH_INFO: `/v3/users/placement` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:42:57.930400 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d0df73-b270-47d0-bfba-da114c0eaee2 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:42:57.932189 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d0df73-b270-47d0-bfba-da114c0eaee2 None admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:42:57.948426 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application [None req-57d0df73-b270-47d0-bfba-da114c0eaee2 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 14 10:42:57.948426 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:42:57.948426 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:42:57.948426 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:42:57.948426 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:42:57.948426 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:42:57.948426 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:42:57.948426 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:42:57.948426 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:42:57.948426 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:42:57.948426 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:42:57.948426 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:42:57.948426 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 10:42:57.948426 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 10:42:57.948426 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 10:42:57.948426 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 10:42:57.949572 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:42:57.949572 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:42:57.949572 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 10:42:57.949572 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 10:42:57.949572 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 10:42:57.949572 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 10:42:57.949572 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:42:57.949572 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:42:57.949572 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:42:57.949572 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:42:57.949572 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:42:57.949572 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application with Lock( Jul 14 10:42:57.949572 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:42:57.949572 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:42:57.949572 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:42:57.949572 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:42:57.949572 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:42:57.949572 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:42:57.950796 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:42:57.950796 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:42:57.950796 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 10:42:57.950796 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 10:42:57.950796 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 10:42:57.950796 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 10:42:57.950796 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 10:42:57.950796 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 10:42:57.950796 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 14 10:42:57.950796 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application Jul 14 10:42:57.950796 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 627/1253] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Jul 14 10:42:57 2022] GET /identity/v3/users/placement => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:42:57.955840 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2913252b-28a2-4eb7-8092-9b39a0fbaa14 None admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:42:58.018893 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=100 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:42:58.074228 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2913252b-28a2-4eb7-8092-9b39a0fbaa14 None admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:42:58.116063 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a972c0ea-5b0c-4507-a846-5cf0cb5efc21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:42:58.116866 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a972c0ea-5b0c-4507-a846-5cf0cb5efc21 None admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:42:58.117168 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a972c0ea-5b0c-4507-a846-5cf0cb5efc21 None admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:42:58.117500 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a972c0ea-5b0c-4507-a846-5cf0cb5efc21 None admin] PATH_INFO: `/v3/users` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:42:58.118438 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a972c0ea-5b0c-4507-a846-5cf0cb5efc21 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=86655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:42:58.118753 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a972c0ea-5b0c-4507-a846-5cf0cb5efc21 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:42:58.120241 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a972c0ea-5b0c-4507-a846-5cf0cb5efc21 None admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:42:58.140850 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 627/1254] 10.222.0.16 () {56 vars in 1143 bytes} [Thu Jul 14 10:42:57 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:42:58.147036 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d0df73-b270-47d0-bfba-da114c0eaee2 None admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:42:58.260442 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d0df73-b270-47d0-bfba-da114c0eaee2 None admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:42:58.297422 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40337c78-d587-4582-84c2-d711d9cefac4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:42:58.298123 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40337c78-d587-4582-84c2-d711d9cefac4 None admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:42:58.298408 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40337c78-d587-4582-84c2-d711d9cefac4 None admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:42:58.298748 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40337c78-d587-4582-84c2-d711d9cefac4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:42:58.361563 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=100 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:42:58.376359 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40337c78-d587-4582-84c2-d711d9cefac4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:42:58.378214 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40337c78-d587-4582-84c2-d711d9cefac4 None admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:42:58.496209 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 628/1255] 10.222.0.16 () {58 vars in 1282 bytes} [Thu Jul 14 10:42:58 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 14 10:42:58.501996 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a972c0ea-5b0c-4507-a846-5cf0cb5efc21 None admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:42:58.616096 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a972c0ea-5b0c-4507-a846-5cf0cb5efc21 None admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:42:58.629457 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=100 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:42:58.651068 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31882325-5367-4808-88c4-c74f04ebb383 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:42:58.651869 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31882325-5367-4808-88c4-c74f04ebb383 None admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:42:58.652152 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31882325-5367-4808-88c4-c74f04ebb383 None admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:42:58.652426 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31882325-5367-4808-88c4-c74f04ebb383 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:42:58.662813 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31882325-5367-4808-88c4-c74f04ebb383 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:42:58.664259 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31882325-5367-4808-88c4-c74f04ebb383 None admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:42:58.682809 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application [None req-31882325-5367-4808-88c4-c74f04ebb383 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 10:42:58.682809 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:42:58.682809 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:42:58.682809 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:42:58.682809 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:42:58.682809 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:42:58.682809 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:42:58.682809 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:42:58.682809 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:42:58.682809 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:42:58.682809 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:42:58.682809 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:42:58.682809 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 10:42:58.682809 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 10:42:58.682809 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 10:42:58.683883 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 10:42:58.683883 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:42:58.683883 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:42:58.683883 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:42:58.683883 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:42:58.683883 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:42:58.683883 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:42:58.683883 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:42:58.683883 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application with Lock( Jul 14 10:42:58.683883 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:42:58.683883 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:42:58.683883 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:42:58.683883 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:42:58.683883 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:42:58.683883 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:42:58.683883 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:42:58.683883 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:42:58.684820 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 10:42:58.684820 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 10:42:58.684820 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 10:42:58.684820 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application Jul 14 10:42:58.684820 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 628/1256] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Jul 14 10:42:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 10:42:58.689829 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40337c78-d587-4582-84c2-d711d9cefac4 None admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:42:58.776665 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=100 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:42:58.793842 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40337c78-d587-4582-84c2-d711d9cefac4 None admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:42:58.835053 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61280d2-5e19-49a3-af0e-5f8350ef5511 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:42:58.835726 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61280d2-5e19-49a3-af0e-5f8350ef5511 None admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:42:58.836016 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61280d2-5e19-49a3-af0e-5f8350ef5511 None admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:42:58.836300 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61280d2-5e19-49a3-af0e-5f8350ef5511 None admin] PATH_INFO: `/v3/domains` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:42:58.837069 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61280d2-5e19-49a3-af0e-5f8350ef5511 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:42:58.837378 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61280d2-5e19-49a3-af0e-5f8350ef5511 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:42:58.838752 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61280d2-5e19-49a3-af0e-5f8350ef5511 None admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:42:58.852510 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 629/1257] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Jul 14 10:42:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:42:58.856449 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31882325-5367-4808-88c4-c74f04ebb383 None admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:42:58.962886 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31882325-5367-4808-88c4-c74f04ebb383 None admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:42:58.998267 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48686413-0b3d-46c8-a629-26d9bb83f458 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:42:58.999048 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48686413-0b3d-46c8-a629-26d9bb83f458 None admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:42:58.999334 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48686413-0b3d-46c8-a629-26d9bb83f458 None admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:42:58.999611 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48686413-0b3d-46c8-a629-26d9bb83f458 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:42:59.007755 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48686413-0b3d-46c8-a629-26d9bb83f458 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:42:59.009245 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48686413-0b3d-46c8-a629-26d9bb83f458 None admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:42:59.024211 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application [None req-48686413-0b3d-46c8-a629-26d9bb83f458 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 10:42:59.024211 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:42:59.024211 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:42:59.024211 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:42:59.024211 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:42:59.024211 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:42:59.024211 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:42:59.024211 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:42:59.024211 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:42:59.024211 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:42:59.024211 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:42:59.024211 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:42:59.024211 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 10:42:59.024211 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 10:42:59.024211 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 10:42:59.025366 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 10:42:59.025366 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:42:59.025366 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:42:59.025366 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:42:59.025366 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:42:59.025366 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:42:59.025366 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:42:59.025366 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:42:59.025366 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application with Lock( Jul 14 10:42:59.025366 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:42:59.025366 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:42:59.025366 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:42:59.025366 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:42:59.025366 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:42:59.025366 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:42:59.025366 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:42:59.025366 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:42:59.026535 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 10:42:59.026535 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 10:42:59.026535 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 10:42:59.026535 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 10:42:59.026535 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 10:42:59.026535 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 10:42:59.026535 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 10:42:59.026535 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application Jul 14 10:42:59.030379 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 629/1258] 10.222.0.16 () {56 vars in 1111 bytes} [Thu Jul 14 10:42:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:42:59.031339 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61280d2-5e19-49a3-af0e-5f8350ef5511 None admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:42:59.136620 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61280d2-5e19-49a3-af0e-5f8350ef5511 None admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:42:59.171468 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bbed88-c3fa-440f-be09-4b2f71e64ba1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:42:59.172136 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bbed88-c3fa-440f-be09-4b2f71e64ba1 None admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:42:59.172418 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bbed88-c3fa-440f-be09-4b2f71e64ba1 None admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:42:59.172693 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bbed88-c3fa-440f-be09-4b2f71e64ba1 None admin] PATH_INFO: `/v3/projects` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:42:59.173503 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36bbed88-c3fa-440f-be09-4b2f71e64ba1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:42:59.173812 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36bbed88-c3fa-440f-be09-4b2f71e64ba1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:42:59.175250 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36bbed88-c3fa-440f-be09-4b2f71e64ba1 None admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:42:59.188183 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 630/1259] 10.222.0.16 () {56 vars in 1148 bytes} [Thu Jul 14 10:42:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:42:59.194677 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48686413-0b3d-46c8-a629-26d9bb83f458 None admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:42:59.222235 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=100 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:42:59.307685 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48686413-0b3d-46c8-a629-26d9bb83f458 None admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:42:59.342848 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263424e6-e2ed-4b6f-8b61-e2185e7937aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:42:59.343524 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263424e6-e2ed-4b6f-8b61-e2185e7937aa None admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:42:59.343833 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263424e6-e2ed-4b6f-8b61-e2185e7937aa None admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:42:59.344094 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263424e6-e2ed-4b6f-8b61-e2185e7937aa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:42:59.344993 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263424e6-e2ed-4b6f-8b61-e2185e7937aa None admin] RBAC: Adding query filter params (role.id=153539819e5542df99269d2913bbecfb, scope.project.id=59391272ecbe48b0aa736cb43807be1d, user.id=16846111ee2a42dd99c3052d40980f72) {{(pid=86655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:42:59.345295 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263424e6-e2ed-4b6f-8b61-e2185e7937aa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:42:59.346719 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263424e6-e2ed-4b6f-8b61-e2185e7937aa None admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:42:59.352806 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 630/1260] 10.222.0.16 () {56 vars in 1374 bytes} [Thu Jul 14 10:42:59 2022] GET /identity/v3/role_assignments?user.id=16846111ee2a42dd99c3052d40980f72&scope.project.id=59391272ecbe48b0aa736cb43807be1d&role.id=153539819e5542df99269d2913bbecfb => generated 259 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:43:01.371287 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33b2ace-5067-4686-91ee-709aa4b32d7a None None] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:43:01.371820 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33b2ace-5067-4686-91ee-709aa4b32d7a None None] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:43:01.371820 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33b2ace-5067-4686-91ee-709aa4b32d7a None None] PATH_INFO: `/` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:43:01.373250 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 631/1261] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jul 14 10:43:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:43:01.378254 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b85ce31-1cac-4eb2-9e26-bd3993f06e66 None None] REQUEST_METHOD: `POST` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:43:01.378660 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b85ce31-1cac-4eb2-9e26-bd3993f06e66 None None] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:43:01.378805 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b85ce31-1cac-4eb2-9e26-bd3993f06e66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:43:01.395837 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.auth.core [None req-4b85ce31-1cac-4eb2-9e26-bd3993f06e66 None None] MFA Rules not processed for user `ae4bcdd8106d4bebbdcae96be33505bc`. Rule list: `[]` (Enabled: `True`). {{(pid=86655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:43:01.397609 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-4b85ce31-1cac-4eb2-9e26-bd3993f06e66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:43:01.461984 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 631/1262] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jul 14 10:43:01 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 10:43:01.484178 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33b2ace-5067-4686-91ee-709aa4b32d7a None None] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:43:01.494758 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=100 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:43:01.593995 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33b2ace-5067-4686-91ee-709aa4b32d7a None None] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:43:01.627893 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3adecfab-ca65-4448-8217-d11717d9754a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:43:01.628607 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adecfab-ca65-4448-8217-d11717d9754a None admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:43:01.628925 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adecfab-ca65-4448-8217-d11717d9754a None admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:43:01.629206 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adecfab-ca65-4448-8217-d11717d9754a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:43:01.639923 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3adecfab-ca65-4448-8217-d11717d9754a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 10:43:01.648427 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application [None req-3adecfab-ca65-4448-8217-d11717d9754a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 10:43:01.648427 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:43:01.648427 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:43:01.648427 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:43:01.648427 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:43:01.648427 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:43:01.648427 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:43:01.648427 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:43:01.648427 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:43:01.648427 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:43:01.648427 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:43:01.648427 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:43:01.648427 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 10:43:01.648427 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 10:43:01.648427 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 10:43:01.648427 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 10:43:01.649529 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 10:43:01.649529 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 10:43:01.649529 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 10:43:01.649529 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 10:43:01.649529 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:43:01.649529 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:43:01.649529 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:43:01.649529 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:43:01.649529 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:43:01.649529 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:43:01.649529 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:43:01.649529 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application with Lock( Jul 14 10:43:01.649529 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:43:01.649529 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:43:01.649529 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:43:01.649529 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:43:01.650410 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:43:01.650410 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:43:01.650410 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:43:01.650410 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:43:01.650410 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 10:43:01.650410 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 10:43:01.650410 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 10:43:01.650410 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 10:43:01.650410 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 10:43:01.650410 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 10:43:01.650410 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 10:43:01.650410 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application Jul 14 10:43:01.650410 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 632/1263] 10.222.0.16 () {56 vars in 1096 bytes} [Thu Jul 14 10:43:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:43:01.655717 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b85ce31-1cac-4eb2-9e26-bd3993f06e66 None None] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:43:01.674751 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=100 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:43:01.756952 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b85ce31-1cac-4eb2-9e26-bd3993f06e66 None None] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:43:01.791961 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818ca9b4-f0d8-47a5-9098-00015b3d70c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:43:01.792633 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818ca9b4-f0d8-47a5-9098-00015b3d70c9 None admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:43:01.792952 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818ca9b4-f0d8-47a5-9098-00015b3d70c9 None admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:43:01.793233 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818ca9b4-f0d8-47a5-9098-00015b3d70c9 None admin] PATH_INFO: `/v3/roles` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:43:01.793990 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818ca9b4-f0d8-47a5-9098-00015b3d70c9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:43:01.794298 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818ca9b4-f0d8-47a5-9098-00015b3d70c9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:43:01.795679 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818ca9b4-f0d8-47a5-9098-00015b3d70c9 None admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:43:01.804291 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 632/1264] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Jul 14 10:43:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:43:01.810110 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3adecfab-ca65-4448-8217-d11717d9754a None admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:43:01.875660 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=100 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:43:01.908076 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3adecfab-ca65-4448-8217-d11717d9754a None admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:43:01.940119 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d754ffc-af7e-44c2-a650-fa9fd0b7e087 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:43:01.940923 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d754ffc-af7e-44c2-a650-fa9fd0b7e087 None admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:43:01.941210 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d754ffc-af7e-44c2-a650-fa9fd0b7e087 None admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:43:01.941481 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d754ffc-af7e-44c2-a650-fa9fd0b7e087 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:43:01.952302 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d754ffc-af7e-44c2-a650-fa9fd0b7e087 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:43:01.953764 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d754ffc-af7e-44c2-a650-fa9fd0b7e087 None admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:43:01.970674 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application [None req-9d754ffc-af7e-44c2-a650-fa9fd0b7e087 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 10:43:01.970674 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:43:01.970674 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:43:01.970674 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:43:01.970674 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:43:01.970674 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:43:01.970674 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:43:01.970674 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:43:01.970674 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:43:01.970674 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:43:01.970674 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:43:01.970674 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:43:01.970674 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 10:43:01.970674 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 10:43:01.970674 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 10:43:01.971718 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 10:43:01.971718 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:43:01.971718 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:43:01.971718 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:43:01.971718 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:43:01.971718 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:43:01.971718 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:43:01.971718 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:43:01.971718 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application with Lock( Jul 14 10:43:01.971718 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:43:01.971718 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:43:01.971718 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:43:01.971718 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:43:01.971718 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:43:01.971718 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:43:01.971718 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:43:01.971718 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:43:01.972720 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 10:43:01.972720 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 10:43:01.972720 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 10:43:01.972720 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application Jul 14 10:43:01.972720 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 633/1265] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Jul 14 10:43:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:43:01.977983 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818ca9b4-f0d8-47a5-9098-00015b3d70c9 None admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:43:02.055640 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=100 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:43:02.074511 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818ca9b4-f0d8-47a5-9098-00015b3d70c9 None admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:43:02.106800 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c3aa6a-baa3-4965-9e78-ed356ba253af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:43:02.107451 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c3aa6a-baa3-4965-9e78-ed356ba253af None admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:43:02.107731 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c3aa6a-baa3-4965-9e78-ed356ba253af None admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:43:02.108005 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c3aa6a-baa3-4965-9e78-ed356ba253af None admin] PATH_INFO: `/v3/domains` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:43:02.108719 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c3aa6a-baa3-4965-9e78-ed356ba253af None admin] RBAC: Adding query filter params (name=Default) {{(pid=86655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:43:02.109050 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c3aa6a-baa3-4965-9e78-ed356ba253af None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:43:02.110402 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c3aa6a-baa3-4965-9e78-ed356ba253af None admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:43:02.121647 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 633/1266] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Jul 14 10:43:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:43:02.127332 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d754ffc-af7e-44c2-a650-fa9fd0b7e087 None admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:43:02.228068 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d754ffc-af7e-44c2-a650-fa9fd0b7e087 None admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:43:02.246521 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=100 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:43:02.260543 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952e3368-50ac-45dc-8805-ea672bdcf74d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:43:02.261361 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952e3368-50ac-45dc-8805-ea672bdcf74d None admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:43:02.261662 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952e3368-50ac-45dc-8805-ea672bdcf74d None admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:43:02.261918 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952e3368-50ac-45dc-8805-ea672bdcf74d None admin] PATH_INFO: `/v3/users/placement` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:43:02.269018 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952e3368-50ac-45dc-8805-ea672bdcf74d None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:43:02.270449 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952e3368-50ac-45dc-8805-ea672bdcf74d None admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:43:02.284880 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application [None req-952e3368-50ac-45dc-8805-ea672bdcf74d None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 14 10:43:02.284880 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:43:02.284880 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:43:02.284880 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:43:02.284880 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:43:02.284880 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:43:02.284880 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:43:02.284880 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:43:02.284880 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:43:02.284880 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:43:02.284880 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:43:02.284880 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:43:02.284880 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 10:43:02.284880 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 10:43:02.284880 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 10:43:02.284880 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 10:43:02.285934 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:43:02.285934 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:43:02.285934 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 10:43:02.285934 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 10:43:02.285934 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 10:43:02.285934 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 10:43:02.285934 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:43:02.285934 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:43:02.285934 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:43:02.285934 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:43:02.285934 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:43:02.285934 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application with Lock( Jul 14 10:43:02.285934 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:43:02.285934 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:43:02.285934 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:43:02.285934 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:43:02.285934 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:43:02.285934 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:43:02.287089 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:43:02.287089 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:43:02.287089 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 10:43:02.287089 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 10:43:02.287089 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 10:43:02.287089 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 10:43:02.287089 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 10:43:02.287089 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 10:43:02.287089 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 14 10:43:02.287089 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application Jul 14 10:43:02.287089 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 634/1267] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Jul 14 10:43:02 2022] GET /identity/v3/users/placement => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:43:02.291996 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c3aa6a-baa3-4965-9e78-ed356ba253af None admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:43:02.389957 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c3aa6a-baa3-4965-9e78-ed356ba253af None admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:43:02.422302 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf19a8f-b87c-45a5-916e-716ed7070802 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:43:02.422985 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf19a8f-b87c-45a5-916e-716ed7070802 None admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:43:02.423269 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf19a8f-b87c-45a5-916e-716ed7070802 None admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:43:02.423544 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf19a8f-b87c-45a5-916e-716ed7070802 None admin] PATH_INFO: `/v3/users` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:43:02.424372 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf19a8f-b87c-45a5-916e-716ed7070802 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=86655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:43:02.424676 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf19a8f-b87c-45a5-916e-716ed7070802 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:43:02.426123 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf19a8f-b87c-45a5-916e-716ed7070802 None admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:43:02.435350 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=100 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:43:02.444545 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 634/1268] 10.222.0.16 () {56 vars in 1143 bytes} [Thu Jul 14 10:43:02 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:43:02.450099 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952e3368-50ac-45dc-8805-ea672bdcf74d None admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:43:02.547732 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952e3368-50ac-45dc-8805-ea672bdcf74d None admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:43:02.581677 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0e817b-bbeb-4137-afa5-3eb69c4f62c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:43:02.582465 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0e817b-bbeb-4137-afa5-3eb69c4f62c5 None admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:43:02.582752 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0e817b-bbeb-4137-afa5-3eb69c4f62c5 None admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:43:02.583031 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0e817b-bbeb-4137-afa5-3eb69c4f62c5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:43:02.593989 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0e817b-bbeb-4137-afa5-3eb69c4f62c5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:43:02.595441 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0e817b-bbeb-4137-afa5-3eb69c4f62c5 None admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:43:02.612244 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application [None req-6a0e817b-bbeb-4137-afa5-3eb69c4f62c5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 10:43:02.612244 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:43:02.612244 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:43:02.612244 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:43:02.612244 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:43:02.612244 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:43:02.612244 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:43:02.612244 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:43:02.612244 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:43:02.612244 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:43:02.612244 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:43:02.612244 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:43:02.612244 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 10:43:02.612244 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 10:43:02.612244 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 10:43:02.613302 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 10:43:02.613302 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:43:02.613302 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:43:02.613302 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:43:02.613302 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:43:02.613302 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:43:02.613302 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:43:02.613302 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:43:02.613302 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application with Lock( Jul 14 10:43:02.613302 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:43:02.613302 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:43:02.613302 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:43:02.613302 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:43:02.613302 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:43:02.613302 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:43:02.613302 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:43:02.613302 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:43:02.614226 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 10:43:02.614226 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 10:43:02.614226 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 10:43:02.614226 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application Jul 14 10:43:02.614226 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 635/1269] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Jul 14 10:43:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:43:02.619668 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf19a8f-b87c-45a5-916e-716ed7070802 None admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:43:02.721148 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf19a8f-b87c-45a5-916e-716ed7070802 None admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:43:02.753644 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c477f9-f2aa-4d10-a002-7e45c00f6ab3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:43:02.754297 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c477f9-f2aa-4d10-a002-7e45c00f6ab3 None admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:43:02.754580 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c477f9-f2aa-4d10-a002-7e45c00f6ab3 None admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:43:02.754852 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c477f9-f2aa-4d10-a002-7e45c00f6ab3 None admin] PATH_INFO: `/v3/domains` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:43:02.756306 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c477f9-f2aa-4d10-a002-7e45c00f6ab3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:43:02.756607 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c477f9-f2aa-4d10-a002-7e45c00f6ab3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:43:02.757987 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c477f9-f2aa-4d10-a002-7e45c00f6ab3 None admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:43:02.768809 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 635/1270] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Jul 14 10:43:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:43:02.775092 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0e817b-bbeb-4137-afa5-3eb69c4f62c5 None admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:43:02.805628 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=100 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:43:02.872229 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0e817b-bbeb-4137-afa5-3eb69c4f62c5 None admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:43:02.904766 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6ba687-4330-49c8-b9ea-62078c8505ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:43:02.905575 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6ba687-4330-49c8-b9ea-62078c8505ce None admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:43:02.905862 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6ba687-4330-49c8-b9ea-62078c8505ce None admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:43:02.906134 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6ba687-4330-49c8-b9ea-62078c8505ce None admin] PATH_INFO: `/v3/projects/service` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:43:02.912664 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6ba687-4330-49c8-b9ea-62078c8505ce None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:43:02.914130 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6ba687-4330-49c8-b9ea-62078c8505ce None admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:43:02.928110 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application [None req-fa6ba687-4330-49c8-b9ea-62078c8505ce None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 10:43:02.928110 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:43:02.928110 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:43:02.928110 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:43:02.928110 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:43:02.928110 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:43:02.928110 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:43:02.928110 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:43:02.928110 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:43:02.928110 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:43:02.928110 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:43:02.928110 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:43:02.928110 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 10:43:02.928110 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 10:43:02.928110 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 10:43:02.929154 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 10:43:02.929154 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:43:02.929154 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:43:02.929154 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:43:02.929154 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:43:02.929154 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:43:02.929154 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:43:02.929154 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:43:02.929154 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application with Lock( Jul 14 10:43:02.929154 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:43:02.929154 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:43:02.929154 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:43:02.929154 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:43:02.929154 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:43:02.929154 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:43:02.929154 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:43:02.929154 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:43:02.930261 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 10:43:02.930261 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 10:43:02.930261 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 10:43:02.930261 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 10:43:02.930261 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 10:43:02.930261 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 10:43:02.930261 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 10:43:02.930261 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application Jul 14 10:43:02.930261 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 636/1271] 10.222.0.16 () {56 vars in 1111 bytes} [Thu Jul 14 10:43:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:43:02.935266 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c477f9-f2aa-4d10-a002-7e45c00f6ab3 None admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:43:02.991858 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=100 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:43:03.032484 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c477f9-f2aa-4d10-a002-7e45c00f6ab3 None admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:43:03.064876 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd633999-d4b3-41ab-907f-67c3ac68ede8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:43:03.065468 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd633999-d4b3-41ab-907f-67c3ac68ede8 None admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:43:03.065750 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd633999-d4b3-41ab-907f-67c3ac68ede8 None admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:43:03.066027 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd633999-d4b3-41ab-907f-67c3ac68ede8 None admin] PATH_INFO: `/v3/projects` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:43:03.066813 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd633999-d4b3-41ab-907f-67c3ac68ede8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:43:03.067120 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd633999-d4b3-41ab-907f-67c3ac68ede8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:43:03.069224 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd633999-d4b3-41ab-907f-67c3ac68ede8 None admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:43:03.080639 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 636/1272] 10.222.0.16 () {56 vars in 1148 bytes} [Thu Jul 14 10:43:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:43:03.086709 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6ba687-4330-49c8-b9ea-62078c8505ce None admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:43:03.173269 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=100 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:43:03.182653 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6ba687-4330-49c8-b9ea-62078c8505ce None admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:43:03.215756 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d582d372-cdf1-4a4b-b2bc-db81e00c81c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:43:03.216630 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d582d372-cdf1-4a4b-b2bc-db81e00c81c2 None admin] REQUEST_METHOD: `PUT` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:43:03.216949 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d582d372-cdf1-4a4b-b2bc-db81e00c81c2 None admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:43:03.217228 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d582d372-cdf1-4a4b-b2bc-db81e00c81c2 None admin] PATH_INFO: `/v3/projects/59391272ecbe48b0aa736cb43807be1d/users/16846111ee2a42dd99c3052d40980f72/roles/153539819e5542df99269d2913bbecfb` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:43:03.219146 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d582d372-cdf1-4a4b-b2bc-db81e00c81c2 None admin] RBAC: Authorizing `identity:create_grant(project_id=59391272ecbe48b0aa736cb43807be1d, user_id=16846111ee2a42dd99c3052d40980f72, role_id=153539819e5542df99269d2913bbecfb)` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:43:03.220576 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d582d372-cdf1-4a4b-b2bc-db81e00c81c2 None admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:43:03.232711 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 637/1273] 10.222.0.16 () {58 vars in 1439 bytes} [Thu Jul 14 10:43:03 2022] PUT /identity/v3/projects/59391272ecbe48b0aa736cb43807be1d/users/16846111ee2a42dd99c3052d40980f72/roles/153539819e5542df99269d2913bbecfb => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:43:05.229005 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f293c59d-6e08-4d85-b307-0b2360571bc1 None None] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:43:05.229562 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f293c59d-6e08-4d85-b307-0b2360571bc1 None None] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:43:05.229562 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f293c59d-6e08-4d85-b307-0b2360571bc1 None None] PATH_INFO: `/` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:43:05.230929 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 637/1274] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jul 14 10:43:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:43:05.235984 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e5dfaf-5797-4899-a414-344001091bca None None] REQUEST_METHOD: `POST` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:43:05.236370 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e5dfaf-5797-4899-a414-344001091bca None None] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:43:05.236537 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e5dfaf-5797-4899-a414-344001091bca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:43:05.252876 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.auth.core [None req-87e5dfaf-5797-4899-a414-344001091bca None None] MFA Rules not processed for user `ae4bcdd8106d4bebbdcae96be33505bc`. Rule list: `[]` (Enabled: `True`). {{(pid=86656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:43:05.254051 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-87e5dfaf-5797-4899-a414-344001091bca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:43:05.318650 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 638/1275] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jul 14 10:43:05 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 10:43:05.342140 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f293c59d-6e08-4d85-b307-0b2360571bc1 None None] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:43:05.441185 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f293c59d-6e08-4d85-b307-0b2360571bc1 None None] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:43:05.457521 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=100 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:43:05.474541 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffe865a-b708-42f9-8ec1-4886cc82e31e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:43:05.475322 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffe865a-b708-42f9-8ec1-4886cc82e31e None admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:43:05.475608 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffe865a-b708-42f9-8ec1-4886cc82e31e None admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:43:05.475883 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffe865a-b708-42f9-8ec1-4886cc82e31e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:43:05.485671 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ffe865a-b708-42f9-8ec1-4886cc82e31e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 10:43:05.493735 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application [None req-0ffe865a-b708-42f9-8ec1-4886cc82e31e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 10:43:05.493735 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:43:05.493735 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:43:05.493735 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:43:05.493735 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:43:05.493735 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:43:05.493735 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:43:05.493735 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:43:05.493735 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:43:05.493735 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:43:05.493735 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:43:05.493735 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:43:05.493735 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 10:43:05.493735 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 10:43:05.493735 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 10:43:05.493735 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 10:43:05.494811 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 10:43:05.494811 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 10:43:05.494811 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 10:43:05.494811 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 10:43:05.494811 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:43:05.494811 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:43:05.494811 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:43:05.494811 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:43:05.494811 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:43:05.494811 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:43:05.494811 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:43:05.494811 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application with Lock( Jul 14 10:43:05.494811 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:43:05.494811 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:43:05.494811 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:43:05.494811 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:43:05.502850 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:43:05.502850 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:43:05.502850 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:43:05.502850 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:43:05.502850 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 10:43:05.502850 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 10:43:05.502850 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 10:43:05.502850 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 10:43:05.502850 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 10:43:05.502850 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 10:43:05.502850 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 10:43:05.502850 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application Jul 14 10:43:05.502850 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 638/1276] 10.222.0.16 () {56 vars in 1096 bytes} [Thu Jul 14 10:43:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:43:05.504251 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e5dfaf-5797-4899-a414-344001091bca None None] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:43:05.582902 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:43:05.601295 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e5dfaf-5797-4899-a414-344001091bca None None] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:43:05.634684 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a428df-3cea-4c9d-a2c3-5e107b760417 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:43:05.635353 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a428df-3cea-4c9d-a2c3-5e107b760417 None admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:43:05.635642 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a428df-3cea-4c9d-a2c3-5e107b760417 None admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:43:05.635922 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a428df-3cea-4c9d-a2c3-5e107b760417 None admin] PATH_INFO: `/v3/roles` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:43:05.636672 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a428df-3cea-4c9d-a2c3-5e107b760417 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:43:05.637016 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a428df-3cea-4c9d-a2c3-5e107b760417 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:43:05.638384 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a428df-3cea-4c9d-a2c3-5e107b760417 None admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:43:05.646263 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 639/1277] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Jul 14 10:43:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 10:43:05.651903 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffe865a-b708-42f9-8ec1-4886cc82e31e None admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:43:05.750795 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffe865a-b708-42f9-8ec1-4886cc82e31e None admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:43:05.783287 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497c5c95-1b62-4cf5-9e29-fa19f3642bef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:43:05.784085 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497c5c95-1b62-4cf5-9e29-fa19f3642bef None admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:43:05.784371 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497c5c95-1b62-4cf5-9e29-fa19f3642bef None admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:43:05.784647 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497c5c95-1b62-4cf5-9e29-fa19f3642bef None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:43:05.795667 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497c5c95-1b62-4cf5-9e29-fa19f3642bef None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:43:05.797131 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497c5c95-1b62-4cf5-9e29-fa19f3642bef None admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:43:05.814625 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application [None req-497c5c95-1b62-4cf5-9e29-fa19f3642bef None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 10:43:05.814625 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:43:05.814625 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:43:05.814625 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:43:05.814625 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:43:05.814625 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:43:05.814625 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:43:05.814625 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:43:05.814625 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:43:05.814625 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:43:05.814625 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:43:05.814625 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:43:05.814625 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 10:43:05.814625 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 10:43:05.814625 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 10:43:05.815661 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 10:43:05.815661 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:43:05.815661 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:43:05.815661 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:43:05.815661 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:43:05.815661 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:43:05.815661 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:43:05.815661 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:43:05.815661 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application with Lock( Jul 14 10:43:05.815661 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:43:05.815661 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:43:05.815661 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:43:05.815661 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:43:05.815661 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:43:05.815661 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:43:05.815661 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:43:05.815661 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:43:05.816658 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 10:43:05.816658 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 10:43:05.816658 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 10:43:05.816658 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application Jul 14 10:43:05.816658 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 639/1278] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Jul 14 10:43:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:43:05.821470 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a428df-3cea-4c9d-a2c3-5e107b760417 None admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:43:05.918095 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a428df-3cea-4c9d-a2c3-5e107b760417 None admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:43:05.950630 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67b26d7-81a3-4a29-b9d4-8a023dde2742 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:43:05.951278 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67b26d7-81a3-4a29-b9d4-8a023dde2742 None admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:43:05.951563 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67b26d7-81a3-4a29-b9d4-8a023dde2742 None admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:43:05.951839 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67b26d7-81a3-4a29-b9d4-8a023dde2742 None admin] PATH_INFO: `/v3/domains` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:43:05.952553 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67b26d7-81a3-4a29-b9d4-8a023dde2742 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:43:05.952892 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67b26d7-81a3-4a29-b9d4-8a023dde2742 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:43:05.954256 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67b26d7-81a3-4a29-b9d4-8a023dde2742 None admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:43:05.966100 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 640/1279] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Jul 14 10:43:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:43:05.971639 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497c5c95-1b62-4cf5-9e29-fa19f3642bef None admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:43:06.002231 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=100 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:43:06.069577 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497c5c95-1b62-4cf5-9e29-fa19f3642bef None admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:43:06.102602 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45486a4-b364-4f87-9a80-ffb40359cfd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:43:06.103383 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45486a4-b364-4f87-9a80-ffb40359cfd5 None admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:43:06.103665 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45486a4-b364-4f87-9a80-ffb40359cfd5 None admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:43:06.103939 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45486a4-b364-4f87-9a80-ffb40359cfd5 None admin] PATH_INFO: `/v3/users/placement` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:43:06.111173 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45486a4-b364-4f87-9a80-ffb40359cfd5 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:43:06.112593 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45486a4-b364-4f87-9a80-ffb40359cfd5 None admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:43:06.126978 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application [None req-f45486a4-b364-4f87-9a80-ffb40359cfd5 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 14 10:43:06.126978 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:43:06.126978 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:43:06.126978 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:43:06.126978 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:43:06.126978 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:43:06.126978 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:43:06.126978 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:43:06.126978 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:43:06.126978 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:43:06.126978 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:43:06.126978 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:43:06.126978 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 10:43:06.126978 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 10:43:06.126978 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 10:43:06.126978 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 10:43:06.128045 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:43:06.128045 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:43:06.128045 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 10:43:06.128045 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 10:43:06.128045 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 10:43:06.128045 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 10:43:06.128045 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:43:06.128045 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:43:06.128045 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:43:06.128045 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:43:06.128045 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:43:06.128045 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application with Lock( Jul 14 10:43:06.128045 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:43:06.128045 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:43:06.128045 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:43:06.128045 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:43:06.128045 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:43:06.128045 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:43:06.129022 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:43:06.129022 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:43:06.129022 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 10:43:06.129022 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 10:43:06.129022 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 10:43:06.129022 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 10:43:06.129022 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 10:43:06.129022 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 10:43:06.129022 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 14 10:43:06.129022 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application Jul 14 10:43:06.129022 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 640/1280] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Jul 14 10:43:05 2022] GET /identity/v3/users/placement => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:43:06.134112 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67b26d7-81a3-4a29-b9d4-8a023dde2742 None admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:43:06.138042 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=100 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:43:06.230671 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67b26d7-81a3-4a29-b9d4-8a023dde2742 None admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:43:06.262526 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e34b6c8-5d08-44d9-93b1-d930aebf7fb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:43:06.263129 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e34b6c8-5d08-44d9-93b1-d930aebf7fb7 None admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:43:06.263407 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e34b6c8-5d08-44d9-93b1-d930aebf7fb7 None admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:43:06.263678 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e34b6c8-5d08-44d9-93b1-d930aebf7fb7 None admin] PATH_INFO: `/v3/users` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:43:06.264497 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e34b6c8-5d08-44d9-93b1-d930aebf7fb7 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=86656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:43:06.264827 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e34b6c8-5d08-44d9-93b1-d930aebf7fb7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:43:06.266252 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e34b6c8-5d08-44d9-93b1-d930aebf7fb7 None admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:43:06.282939 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 641/1281] 10.222.0.16 () {56 vars in 1143 bytes} [Thu Jul 14 10:43:06 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:43:06.289396 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45486a4-b364-4f87-9a80-ffb40359cfd5 None admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:43:06.375243 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=100 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:43:06.384697 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45486a4-b364-4f87-9a80-ffb40359cfd5 None admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:43:06.417050 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd156441-76e9-44b8-945e-a3cbd82472bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:43:06.417687 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd156441-76e9-44b8-945e-a3cbd82472bd None admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:43:06.417972 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd156441-76e9-44b8-945e-a3cbd82472bd None admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:43:06.418247 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd156441-76e9-44b8-945e-a3cbd82472bd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:43:06.483155 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd156441-76e9-44b8-945e-a3cbd82472bd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:43:06.484594 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd156441-76e9-44b8-945e-a3cbd82472bd None admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:43:06.579915 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=100 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:43:06.591271 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 641/1282] 10.222.0.16 () {58 vars in 1282 bytes} [Thu Jul 14 10:43:06 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 14 10:43:06.596997 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e34b6c8-5d08-44d9-93b1-d930aebf7fb7 None admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:43:06.655627 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=100 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:43:06.691932 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e34b6c8-5d08-44d9-93b1-d930aebf7fb7 None admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:43:06.725065 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24619f3b-3c05-4469-a6c4-7f5d17bbee8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:43:06.725848 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24619f3b-3c05-4469-a6c4-7f5d17bbee8d None admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:43:06.726134 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24619f3b-3c05-4469-a6c4-7f5d17bbee8d None admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:43:06.726407 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24619f3b-3c05-4469-a6c4-7f5d17bbee8d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:43:06.735999 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24619f3b-3c05-4469-a6c4-7f5d17bbee8d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:43:06.737460 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24619f3b-3c05-4469-a6c4-7f5d17bbee8d None admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:43:06.754386 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application [None req-24619f3b-3c05-4469-a6c4-7f5d17bbee8d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 10:43:06.754386 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:43:06.754386 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:43:06.754386 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:43:06.754386 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:43:06.754386 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:43:06.754386 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:43:06.754386 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:43:06.754386 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:43:06.754386 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:43:06.754386 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:43:06.754386 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:43:06.754386 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 10:43:06.754386 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 10:43:06.754386 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 10:43:06.756261 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 10:43:06.756261 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:43:06.756261 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:43:06.756261 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:43:06.756261 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:43:06.756261 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:43:06.756261 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:43:06.756261 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:43:06.756261 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application with Lock( Jul 14 10:43:06.756261 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:43:06.756261 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:43:06.756261 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:43:06.756261 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:43:06.756261 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:43:06.756261 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:43:06.756261 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:43:06.756261 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:43:06.757250 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 10:43:06.757250 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 10:43:06.757250 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 10:43:06.757250 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application Jul 14 10:43:06.757250 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 642/1283] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Jul 14 10:43:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:43:06.762096 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd156441-76e9-44b8-945e-a3cbd82472bd None admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:43:06.861593 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd156441-76e9-44b8-945e-a3cbd82472bd None admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:43:06.894655 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e12978-5031-45c8-96b4-45403503f364 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:43:06.895306 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e12978-5031-45c8-96b4-45403503f364 None admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:43:06.895662 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e12978-5031-45c8-96b4-45403503f364 None admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:43:06.895948 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e12978-5031-45c8-96b4-45403503f364 None admin] PATH_INFO: `/v3/domains` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:43:06.896670 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e12978-5031-45c8-96b4-45403503f364 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:43:06.897025 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e12978-5031-45c8-96b4-45403503f364 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:43:06.898389 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e12978-5031-45c8-96b4-45403503f364 None admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:43:06.909122 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 642/1284] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Jul 14 10:43:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:43:06.914972 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24619f3b-3c05-4469-a6c4-7f5d17bbee8d None admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:43:07.011156 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24619f3b-3c05-4469-a6c4-7f5d17bbee8d None admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:43:07.024443 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=100 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:43:07.044115 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6f1a88-8d6e-4047-8287-8ca2ae3be678 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:43:07.044917 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6f1a88-8d6e-4047-8287-8ca2ae3be678 None admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:43:07.045206 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6f1a88-8d6e-4047-8287-8ca2ae3be678 None admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:43:07.045483 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6f1a88-8d6e-4047-8287-8ca2ae3be678 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:43:07.052455 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6f1a88-8d6e-4047-8287-8ca2ae3be678 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:43:07.054053 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6f1a88-8d6e-4047-8287-8ca2ae3be678 None admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:43:07.067762 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application [None req-8f6f1a88-8d6e-4047-8287-8ca2ae3be678 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 10:43:07.067762 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:43:07.067762 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:43:07.067762 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:43:07.067762 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:43:07.067762 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:43:07.067762 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:43:07.067762 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:43:07.067762 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:43:07.067762 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:43:07.067762 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:43:07.067762 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:43:07.067762 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 10:43:07.067762 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 10:43:07.067762 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 10:43:07.068834 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 10:43:07.068834 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:43:07.068834 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:43:07.068834 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:43:07.068834 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:43:07.068834 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:43:07.068834 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:43:07.068834 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:43:07.068834 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application with Lock( Jul 14 10:43:07.068834 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:43:07.068834 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:43:07.068834 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:43:07.068834 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:43:07.068834 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:43:07.068834 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:43:07.068834 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:43:07.068834 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:43:07.069786 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 10:43:07.069786 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 10:43:07.069786 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 10:43:07.069786 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 10:43:07.069786 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 10:43:07.069786 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 10:43:07.069786 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 10:43:07.069786 dv-cinder-846146-7-smb devstack@keystone.service[86656]: ERROR keystone.server.flask.application Jul 14 10:43:07.069786 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 643/1285] 10.222.0.16 () {56 vars in 1111 bytes} [Thu Jul 14 10:43:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:43:07.074711 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e12978-5031-45c8-96b4-45403503f364 None admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:43:07.124461 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=100 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:43:07.174260 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e12978-5031-45c8-96b4-45403503f364 None admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:43:07.206889 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc964210-226a-4965-adba-791173a20062 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:43:07.207543 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc964210-226a-4965-adba-791173a20062 None admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:43:07.207832 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc964210-226a-4965-adba-791173a20062 None admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:43:07.208707 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc964210-226a-4965-adba-791173a20062 None admin] PATH_INFO: `/v3/projects` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:43:07.209555 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc964210-226a-4965-adba-791173a20062 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:43:07.209866 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc964210-226a-4965-adba-791173a20062 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:43:07.211302 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc964210-226a-4965-adba-791173a20062 None admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:43:07.222939 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 643/1286] 10.222.0.16 () {56 vars in 1148 bytes} [Thu Jul 14 10:43:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:43:07.228985 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6f1a88-8d6e-4047-8287-8ca2ae3be678 None admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:43:07.325415 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6f1a88-8d6e-4047-8287-8ca2ae3be678 None admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:43:07.357836 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c61b3c3-5fb5-4e8f-af44-9ab2d7d817d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:43:07.358476 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c61b3c3-5fb5-4e8f-af44-9ab2d7d817d4 None admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:43:07.358763 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c61b3c3-5fb5-4e8f-af44-9ab2d7d817d4 None admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:43:07.359041 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c61b3c3-5fb5-4e8f-af44-9ab2d7d817d4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:43:07.359880 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c61b3c3-5fb5-4e8f-af44-9ab2d7d817d4 None admin] RBAC: Adding query filter params (role.id=153539819e5542df99269d2913bbecfb, scope.project.id=59391272ecbe48b0aa736cb43807be1d, user.id=16846111ee2a42dd99c3052d40980f72) {{(pid=86656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:43:07.360193 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c61b3c3-5fb5-4e8f-af44-9ab2d7d817d4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:43:07.361647 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c61b3c3-5fb5-4e8f-af44-9ab2d7d817d4 None admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:43:07.367276 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 644/1287] 10.222.0.16 () {56 vars in 1374 bytes} [Thu Jul 14 10:43:07 2022] GET /identity/v3/role_assignments?user.id=16846111ee2a42dd99c3052d40980f72&scope.project.id=59391272ecbe48b0aa736cb43807be1d&role.id=153539819e5542df99269d2913bbecfb => generated 608 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:43:09.385680 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30d6b3d-8e58-4187-b682-8463adad2a94 None None] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:43:09.386277 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30d6b3d-8e58-4187-b682-8463adad2a94 None None] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:43:09.386277 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30d6b3d-8e58-4187-b682-8463adad2a94 None None] PATH_INFO: `/` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:43:09.387605 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 644/1288] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jul 14 10:43:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:43:09.392517 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460dc97a-4020-4caa-877d-05a1dce0fbb9 None None] REQUEST_METHOD: `POST` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:43:09.392943 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460dc97a-4020-4caa-877d-05a1dce0fbb9 None None] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:43:09.393113 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460dc97a-4020-4caa-877d-05a1dce0fbb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:43:09.410011 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.auth.core [None req-460dc97a-4020-4caa-877d-05a1dce0fbb9 None None] MFA Rules not processed for user `ae4bcdd8106d4bebbdcae96be33505bc`. Rule list: `[]` (Enabled: `True`). {{(pid=86656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:43:09.411231 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-460dc97a-4020-4caa-877d-05a1dce0fbb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:43:09.439743 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=100 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:43:09.479911 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 645/1289] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jul 14 10:43:09 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 10:43:09.503069 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30d6b3d-8e58-4187-b682-8463adad2a94 None None] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:43:09.609278 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30d6b3d-8e58-4187-b682-8463adad2a94 None None] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:43:09.620100 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=100 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:43:09.645360 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93cbb37-ee9f-45fe-943f-a56f9355b196 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:43:09.646135 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93cbb37-ee9f-45fe-943f-a56f9355b196 None admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:43:09.646417 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93cbb37-ee9f-45fe-943f-a56f9355b196 None admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:43:09.646691 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93cbb37-ee9f-45fe-943f-a56f9355b196 None admin] PATH_INFO: `/v3/services/placement` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:43:09.647338 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93cbb37-ee9f-45fe-943f-a56f9355b196 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:43:09.648693 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93cbb37-ee9f-45fe-943f-a56f9355b196 None admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:43:09.660199 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application [None req-c93cbb37-ee9f-45fe-943f-a56f9355b196 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 14 10:43:09.660199 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:43:09.660199 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 14 10:43:09.660199 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 14 10:43:09.660199 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 14 10:43:09.660199 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 14 10:43:09.660199 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 14 10:43:09.660199 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 10:43:09.660199 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 14 10:43:09.660199 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application Jul 14 10:43:09.660199 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 10:43:09.660199 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application Jul 14 10:43:09.660199 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:43:09.660199 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:43:09.660199 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:43:09.660199 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:43:09.660199 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:43:09.666631 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:43:09.666631 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:43:09.666631 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:43:09.666631 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:43:09.666631 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:43:09.666631 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:43:09.666631 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 14 10:43:09.666631 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 14 10:43:09.666631 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 14 10:43:09.666631 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 14 10:43:09.666631 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:43:09.666631 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:43:09.666631 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:43:09.666631 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:43:09.666631 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:43:09.666631 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:43:09.667798 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:43:09.667798 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application with Lock( Jul 14 10:43:09.667798 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:43:09.667798 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:43:09.667798 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:43:09.667798 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:43:09.667798 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:43:09.667798 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:43:09.667798 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:43:09.667798 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:43:09.667798 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 14 10:43:09.667798 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 10:43:09.667798 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 14 10:43:09.667798 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application Jul 14 10:43:09.667798 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 645/1290] 10.222.0.16 () {56 vars in 1117 bytes} [Thu Jul 14 10:43:09 2022] GET /identity/v3/services/placement => generated 90 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 10:43:09.668893 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460dc97a-4020-4caa-877d-05a1dce0fbb9 None None] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:43:09.762692 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460dc97a-4020-4caa-877d-05a1dce0fbb9 None None] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:43:09.795173 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bddbaf-aa2d-4706-9cc3-d7c0072f97df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:43:09.795834 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bddbaf-aa2d-4706-9cc3-d7c0072f97df None admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:43:09.796115 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bddbaf-aa2d-4706-9cc3-d7c0072f97df None admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:43:09.796385 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bddbaf-aa2d-4706-9cc3-d7c0072f97df None admin] PATH_INFO: `/v3/services` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:43:09.797114 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1bddbaf-aa2d-4706-9cc3-d7c0072f97df None admin] RBAC: Adding query filter params (name=placement) {{(pid=86656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:43:09.797419 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1bddbaf-aa2d-4706-9cc3-d7c0072f97df None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:43:09.798786 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1bddbaf-aa2d-4706-9cc3-d7c0072f97df None admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:43:09.804235 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 646/1291] 10.222.0.16 () {56 vars in 1116 bytes} [Thu Jul 14 10:43:09 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:43:09.810102 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93cbb37-ee9f-45fe-943f-a56f9355b196 None admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:43:09.908665 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93cbb37-ee9f-45fe-943f-a56f9355b196 None admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:43:09.941237 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5445deca-3692-45af-816b-019dbabdd28a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:43:09.941897 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5445deca-3692-45af-816b-019dbabdd28a None admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:43:09.942180 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5445deca-3692-45af-816b-019dbabdd28a None admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:43:09.942501 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5445deca-3692-45af-816b-019dbabdd28a None admin] PATH_INFO: `/v3/services` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:43:09.943183 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5445deca-3692-45af-816b-019dbabdd28a None admin] RBAC: Adding query filter params (type=placement) {{(pid=86655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:43:09.943487 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5445deca-3692-45af-816b-019dbabdd28a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:43:09.944860 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5445deca-3692-45af-816b-019dbabdd28a None admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:43:09.949167 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 646/1292] 10.222.0.16 () {56 vars in 1116 bytes} [Thu Jul 14 10:43:09 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:43:11.966109 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e353786-ac0e-418e-8084-0f72f70ece1b None None] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:43:11.966662 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e353786-ac0e-418e-8084-0f72f70ece1b None None] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:43:11.966662 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e353786-ac0e-418e-8084-0f72f70ece1b None None] PATH_INFO: `/` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:43:11.968039 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 647/1293] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jul 14 10:43:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:43:11.973186 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd51c822-a192-4e38-b6b2-822cfd92a9c6 None None] REQUEST_METHOD: `POST` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:43:11.973883 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd51c822-a192-4e38-b6b2-822cfd92a9c6 None None] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:43:11.973883 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd51c822-a192-4e38-b6b2-822cfd92a9c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:43:11.993016 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.auth.core [None req-fd51c822-a192-4e38-b6b2-822cfd92a9c6 None None] MFA Rules not processed for user `ae4bcdd8106d4bebbdcae96be33505bc`. Rule list: `[]` (Enabled: `True`). {{(pid=86655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:43:11.994207 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-fd51c822-a192-4e38-b6b2-822cfd92a9c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:43:12.028643 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=100 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:43:12.065277 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 647/1294] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jul 14 10:43:11 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 10:43:12.088264 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e353786-ac0e-418e-8084-0f72f70ece1b None None] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:43:12.118698 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=100 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:43:12.186373 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e353786-ac0e-418e-8084-0f72f70ece1b None None] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:43:12.218493 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10786bf6-0af8-4e90-8b4f-74fc21b85392 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:43:12.219146 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10786bf6-0af8-4e90-8b4f-74fc21b85392 None admin] REQUEST_METHOD: `POST` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:43:12.219426 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10786bf6-0af8-4e90-8b4f-74fc21b85392 None admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:43:12.219698 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10786bf6-0af8-4e90-8b4f-74fc21b85392 None admin] PATH_INFO: `/v3/services` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:43:12.220418 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10786bf6-0af8-4e90-8b4f-74fc21b85392 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:43:12.221802 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10786bf6-0af8-4e90-8b4f-74fc21b85392 None admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:43:12.234060 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 648/1295] 10.222.0.16 () {60 vars in 1141 bytes} [Thu Jul 14 10:43:12 2022] POST /identity/v3/services => generated 246 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:43:14.258965 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9c9fac-89eb-472b-b1a2-5c08b30263f4 None None] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:43:14.259518 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9c9fac-89eb-472b-b1a2-5c08b30263f4 None None] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:43:14.259518 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9c9fac-89eb-472b-b1a2-5c08b30263f4 None None] PATH_INFO: `/` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:43:14.260933 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 648/1296] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jul 14 10:43:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:43:14.266031 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c96802-5265-49dc-ba22-e1bc56fc52ab None None] REQUEST_METHOD: `POST` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:43:14.266415 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c96802-5265-49dc-ba22-e1bc56fc52ab None None] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:43:14.266593 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c96802-5265-49dc-ba22-e1bc56fc52ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:43:14.283371 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.auth.core [None req-71c96802-5265-49dc-ba22-e1bc56fc52ab None None] MFA Rules not processed for user `ae4bcdd8106d4bebbdcae96be33505bc`. Rule list: `[]` (Enabled: `True`). {{(pid=86656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:43:14.284558 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-71c96802-5265-49dc-ba22-e1bc56fc52ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:43:14.354921 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 649/1297] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jul 14 10:43:14 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 10:43:14.377982 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9c9fac-89eb-472b-b1a2-5c08b30263f4 None None] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:43:14.476981 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9c9fac-89eb-472b-b1a2-5c08b30263f4 None None] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:43:14.511365 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abd03ca-afe9-4963-9c32-240f44c6c393 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:43:14.512099 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abd03ca-afe9-4963-9c32-240f44c6c393 None admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:43:14.512383 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abd03ca-afe9-4963-9c32-240f44c6c393 None admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:43:14.512661 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abd03ca-afe9-4963-9c32-240f44c6c393 None admin] PATH_INFO: `/v3/services/placement` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:43:14.513402 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2abd03ca-afe9-4963-9c32-240f44c6c393 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:43:14.514725 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2abd03ca-afe9-4963-9c32-240f44c6c393 None admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:43:14.526724 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application [None req-2abd03ca-afe9-4963-9c32-240f44c6c393 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 14 10:43:14.526724 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:43:14.526724 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 14 10:43:14.526724 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 14 10:43:14.526724 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 14 10:43:14.526724 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 14 10:43:14.526724 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 14 10:43:14.526724 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 10:43:14.526724 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 14 10:43:14.526724 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application Jul 14 10:43:14.526724 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 10:43:14.526724 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application Jul 14 10:43:14.526724 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:43:14.526724 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:43:14.526724 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:43:14.526724 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:43:14.526724 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:43:14.527807 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:43:14.527807 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:43:14.527807 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:43:14.527807 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:43:14.527807 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:43:14.527807 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:43:14.527807 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 14 10:43:14.527807 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 14 10:43:14.527807 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 14 10:43:14.527807 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 14 10:43:14.527807 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:43:14.527807 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:43:14.527807 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:43:14.527807 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:43:14.527807 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:43:14.527807 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:43:14.528890 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:43:14.528890 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application with Lock( Jul 14 10:43:14.528890 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:43:14.528890 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:43:14.528890 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:43:14.528890 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:43:14.528890 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:43:14.528890 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:43:14.528890 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:43:14.528890 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:43:14.528890 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 14 10:43:14.528890 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 10:43:14.528890 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 14 10:43:14.528890 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application Jul 14 10:43:14.528890 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 649/1298] 10.222.0.16 () {56 vars in 1117 bytes} [Thu Jul 14 10:43:14 2022] GET /identity/v3/services/placement => generated 90 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:43:14.534607 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c96802-5265-49dc-ba22-e1bc56fc52ab None None] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:43:14.553837 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:43:14.635201 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c96802-5265-49dc-ba22-e1bc56fc52ab None None] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:43:14.668334 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3792d227-9f54-4967-8d63-937c02a79b1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:43:14.669021 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3792d227-9f54-4967-8d63-937c02a79b1a None admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:43:14.669308 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3792d227-9f54-4967-8d63-937c02a79b1a None admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:43:14.669588 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3792d227-9f54-4967-8d63-937c02a79b1a None admin] PATH_INFO: `/v3/services` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:43:14.670290 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3792d227-9f54-4967-8d63-937c02a79b1a None admin] RBAC: Adding query filter params (name=placement) {{(pid=86656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:43:14.670599 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3792d227-9f54-4967-8d63-937c02a79b1a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:43:14.671968 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3792d227-9f54-4967-8d63-937c02a79b1a None admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:43:14.677826 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 650/1299] 10.222.0.16 () {56 vars in 1116 bytes} [Thu Jul 14 10:43:14 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:43:14.683819 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abd03ca-afe9-4963-9c32-240f44c6c393 None admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:43:14.714906 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=100 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:43:14.781929 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abd03ca-afe9-4963-9c32-240f44c6c393 None admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:43:14.818280 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9bb13b-4c85-4218-9c70-5058c06f50d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:43:14.818947 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9bb13b-4c85-4218-9c70-5058c06f50d5 None admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:43:14.819233 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9bb13b-4c85-4218-9c70-5058c06f50d5 None admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:43:14.819510 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9bb13b-4c85-4218-9c70-5058c06f50d5 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:43:14.820306 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9bb13b-4c85-4218-9c70-5058c06f50d5 None admin] RBAC: Adding query filter params (interface=public, service_id=9e7065a862944d2fb9672409bb5cd0de, region_id=RegionOne) {{(pid=86655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:43:14.820622 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9bb13b-4c85-4218-9c70-5058c06f50d5 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:43:14.822024 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9bb13b-4c85-4218-9c70-5058c06f50d5 None admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:43:14.827087 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 650/1300] 10.222.0.16 () {56 vars in 1251 bytes} [Thu Jul 14 10:43:14 2022] GET /identity/v3/endpoints?service_id=9e7065a862944d2fb9672409bb5cd0de&interface=public®ion_id=RegionOne => generated 194 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:43:14.833349 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3792d227-9f54-4967-8d63-937c02a79b1a None admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:43:14.911770 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=100 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:43:14.929137 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3792d227-9f54-4967-8d63-937c02a79b1a None admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:43:14.962304 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d50f4b6-a4b8-4965-8d8d-c87f6bd9b3d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:43:14.962956 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d50f4b6-a4b8-4965-8d8d-c87f6bd9b3d9 None admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:43:14.963241 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d50f4b6-a4b8-4965-8d8d-c87f6bd9b3d9 None admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:43:14.963518 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d50f4b6-a4b8-4965-8d8d-c87f6bd9b3d9 None admin] PATH_INFO: `/v3/services` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:43:14.964199 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d50f4b6-a4b8-4965-8d8d-c87f6bd9b3d9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:43:14.965596 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d50f4b6-a4b8-4965-8d8d-c87f6bd9b3d9 None admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:43:14.972224 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 651/1301] 10.222.0.16 () {56 vars in 1087 bytes} [Thu Jul 14 10:43:14 2022] GET /identity/v3/services => generated 2191 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:43:16.990638 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fd96bb-49bf-4521-b3d1-9fb21fb83234 None None] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:43:16.991183 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fd96bb-49bf-4521-b3d1-9fb21fb83234 None None] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:43:16.991183 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fd96bb-49bf-4521-b3d1-9fb21fb83234 None None] PATH_INFO: `/` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:43:16.992614 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 651/1302] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jul 14 10:43:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:43:16.997730 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0570eeff-2020-4831-bdd0-534b16fc79c0 None None] REQUEST_METHOD: `POST` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:43:16.998168 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0570eeff-2020-4831-bdd0-534b16fc79c0 None None] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:43:16.998297 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0570eeff-2020-4831-bdd0-534b16fc79c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:43:17.015160 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.auth.core [None req-0570eeff-2020-4831-bdd0-534b16fc79c0 None None] MFA Rules not processed for user `ae4bcdd8106d4bebbdcae96be33505bc`. Rule list: `[]` (Enabled: `True`). {{(pid=86656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:43:17.016358 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-0570eeff-2020-4831-bdd0-534b16fc79c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:43:17.081386 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 652/1303] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jul 14 10:43:16 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 10:43:17.104582 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fd96bb-49bf-4521-b3d1-9fb21fb83234 None None] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:43:17.196963 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=100 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:43:17.203610 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fd96bb-49bf-4521-b3d1-9fb21fb83234 None None] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:43:17.235783 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60800675-7eb6-420b-9f0b-6a1ed09f5816 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:43:17.236576 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60800675-7eb6-420b-9f0b-6a1ed09f5816 None admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:43:17.236893 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60800675-7eb6-420b-9f0b-6a1ed09f5816 None admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:43:17.237175 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60800675-7eb6-420b-9f0b-6a1ed09f5816 None admin] PATH_INFO: `/v3/services/placement` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:43:17.237824 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60800675-7eb6-420b-9f0b-6a1ed09f5816 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:43:17.239466 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60800675-7eb6-420b-9f0b-6a1ed09f5816 None admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:43:17.251106 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application [None req-60800675-7eb6-420b-9f0b-6a1ed09f5816 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 14 10:43:17.251106 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:43:17.251106 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 14 10:43:17.251106 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 14 10:43:17.251106 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 14 10:43:17.251106 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 14 10:43:17.251106 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 14 10:43:17.251106 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 10:43:17.251106 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 14 10:43:17.251106 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application Jul 14 10:43:17.251106 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 10:43:17.251106 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application Jul 14 10:43:17.251106 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 10:43:17.251106 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 10:43:17.251106 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 10:43:17.251106 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 10:43:17.251106 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 10:43:17.252234 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 10:43:17.252234 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 10:43:17.252234 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 10:43:17.252234 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 10:43:17.252234 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 10:43:17.252234 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 10:43:17.252234 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 14 10:43:17.252234 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 14 10:43:17.252234 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 14 10:43:17.252234 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 14 10:43:17.252234 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 10:43:17.252234 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 10:43:17.252234 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 10:43:17.252234 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 10:43:17.252234 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 10:43:17.252234 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 10:43:17.253467 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 10:43:17.253467 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application with Lock( Jul 14 10:43:17.253467 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 10:43:17.253467 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self._enter() Jul 14 10:43:17.253467 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 10:43:17.253467 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 10:43:17.253467 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 10:43:17.253467 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application return self.creator() Jul 14 10:43:17.253467 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 10:43:17.253467 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application created_value = creator( Jul 14 10:43:17.253467 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 14 10:43:17.253467 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 10:43:17.253467 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 14 10:43:17.253467 dv-cinder-846146-7-smb devstack@keystone.service[86655]: ERROR keystone.server.flask.application Jul 14 10:43:17.253467 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 652/1304] 10.222.0.16 () {56 vars in 1117 bytes} [Thu Jul 14 10:43:17 2022] GET /identity/v3/services/placement => generated 90 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 10:43:17.258944 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0570eeff-2020-4831-bdd0-534b16fc79c0 None None] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:43:17.334453 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=100 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:43:17.356291 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0570eeff-2020-4831-bdd0-534b16fc79c0 None None] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:43:17.389469 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216834bb-ab73-4710-8dc5-9899a802386f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:43:17.390121 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216834bb-ab73-4710-8dc5-9899a802386f None admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:43:17.390402 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216834bb-ab73-4710-8dc5-9899a802386f None admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:43:17.390675 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216834bb-ab73-4710-8dc5-9899a802386f None admin] PATH_INFO: `/v3/services` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:43:17.391374 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216834bb-ab73-4710-8dc5-9899a802386f None admin] RBAC: Adding query filter params (name=placement) {{(pid=86656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:43:17.391679 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216834bb-ab73-4710-8dc5-9899a802386f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:43:17.393067 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216834bb-ab73-4710-8dc5-9899a802386f None admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:43:17.398080 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 653/1305] 10.222.0.16 () {56 vars in 1116 bytes} [Thu Jul 14 10:43:17 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 10:43:17.403777 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60800675-7eb6-420b-9f0b-6a1ed09f5816 None admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:43:17.506446 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60800675-7eb6-420b-9f0b-6a1ed09f5816 None admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:43:17.543253 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660769a6-130c-4a33-8668-0e38385b85c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:43:17.543962 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660769a6-130c-4a33-8668-0e38385b85c6 None admin] REQUEST_METHOD: `POST` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:43:17.544217 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660769a6-130c-4a33-8668-0e38385b85c6 None admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:43:17.544494 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660769a6-130c-4a33-8668-0e38385b85c6 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:43:17.545269 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660769a6-130c-4a33-8668-0e38385b85c6 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:43:17.546627 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660769a6-130c-4a33-8668-0e38385b85c6 None admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:43:17.564272 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 653/1306] 10.222.0.16 () {60 vars in 1144 bytes} [Thu Jul 14 10:43:17 2022] POST /identity/v3/endpoints => generated 331 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:43:27.395400 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=30 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:43:27.560094 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:44:20.065467 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3a02d1-e314-4b7a-9a25-f9420a8e3f21 None None] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:44:20.066060 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3a02d1-e314-4b7a-9a25-f9420a8e3f21 None None] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:44:20.066060 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3a02d1-e314-4b7a-9a25-f9420a8e3f21 None None] PATH_INFO: `/` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:44:20.067732 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 654/1307] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jul 14 10:44:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:44:20.078765 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f14c1ed-a281-4dff-9282-64d248615873 None None] REQUEST_METHOD: `POST` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:44:20.079951 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f14c1ed-a281-4dff-9282-64d248615873 None None] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:44:20.080306 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f14c1ed-a281-4dff-9282-64d248615873 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:44:20.178737 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.auth.core [None req-8f14c1ed-a281-4dff-9282-64d248615873 None None] MFA Rules not processed for user `ae4bcdd8106d4bebbdcae96be33505bc`. Rule list: `[]` (Enabled: `True`). {{(pid=86655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:44:20.180628 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-8f14c1ed-a281-4dff-9282-64d248615873 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:44:20.421182 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 654/1308] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jul 14 10:44:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 344 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 10:44:20.468289 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365ffa80-a9cc-48bb-a4c7-676072185944 None None] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:44:20.468661 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365ffa80-a9cc-48bb-a4c7-676072185944 None None] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:44:20.468911 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365ffa80-a9cc-48bb-a4c7-676072185944 None None] PATH_INFO: `/` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:44:20.470649 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 655/1309] 10.222.0.16 () {54 vars in 964 bytes} [Thu Jul 14 10:44:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:44:20.476748 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a52d18-8658-4a54-9710-0e7aca3cc4a3 None None] REQUEST_METHOD: `POST` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:44:20.477146 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a52d18-8658-4a54-9710-0e7aca3cc4a3 None None] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:44:20.477496 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a52d18-8658-4a54-9710-0e7aca3cc4a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:44:20.558163 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.auth.core [None req-e3a52d18-8658-4a54-9710-0e7aca3cc4a3 None None] MFA Rules not processed for user `4dddf93691844886982c91fea974385d`. Rule list: `[]` (Enabled: `True`). {{(pid=86655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:44:20.559476 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-e3a52d18-8658-4a54-9710-0e7aca3cc4a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:44:20.581224 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=100 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:44:20.638952 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 655/1310] 10.222.0.16 () {58 vars in 1061 bytes} [Thu Jul 14 10:44:20 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:44:20.647898 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365ffa80-a9cc-48bb-a4c7-676072185944 None None] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:44:20.649898 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-365ffa80-a9cc-48bb-a4c7-676072185944 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:44:20.764408 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365ffa80-a9cc-48bb-a4c7-676072185944 None None] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:44:20.847407 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce96d680-a206-4427-b805-c95f2ddc4877 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dddf93691844886982c91fea974385d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59391272ecbe48b0aa736cb43807be1d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:44:20.847962 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce96d680-a206-4427-b805-c95f2ddc4877 service neutron] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:44:20.848244 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce96d680-a206-4427-b805-c95f2ddc4877 service neutron] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:44:20.848520 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce96d680-a206-4427-b805-c95f2ddc4877 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:44:20.850205 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-ce96d680-a206-4427-b805-c95f2ddc4877 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:44:20.911146 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=100 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:44:20.975988 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce96d680-a206-4427-b805-c95f2ddc4877 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:44:20.977633 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce96d680-a206-4427-b805-c95f2ddc4877 service neutron] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:44:21.001005 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 656/1311] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jul 14 10:44:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:44:23.325251 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf877625-33e1-4d07-a89e-3f825f249fff None None] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:44:23.325833 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf877625-33e1-4d07-a89e-3f825f249fff None None] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:44:23.325833 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf877625-33e1-4d07-a89e-3f825f249fff None None] PATH_INFO: `/` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:44:23.327191 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 656/1312] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jul 14 10:44:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:44:23.333657 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f77e1fb-1e34-449a-b8c2-7c6365fe2557 None None] REQUEST_METHOD: `POST` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:44:23.334175 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f77e1fb-1e34-449a-b8c2-7c6365fe2557 None None] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:44:23.334264 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f77e1fb-1e34-449a-b8c2-7c6365fe2557 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:44:23.426900 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.auth.core [None req-9f77e1fb-1e34-449a-b8c2-7c6365fe2557 None None] MFA Rules not processed for user `ae4bcdd8106d4bebbdcae96be33505bc`. Rule list: `[]` (Enabled: `True`). {{(pid=86656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:44:23.428135 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-9f77e1fb-1e34-449a-b8c2-7c6365fe2557 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:44:23.533925 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 657/1313] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jul 14 10:44:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:44:23.572987 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf877625-33e1-4d07-a89e-3f825f249fff None None] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:44:23.574589 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-cf877625-33e1-4d07-a89e-3f825f249fff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:44:23.693217 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf877625-33e1-4d07-a89e-3f825f249fff None None] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:44:23.767640 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=100 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:44:23.770230 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff86837-cc6b-4469-8ea6-d82b720a86ed service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dddf93691844886982c91fea974385d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59391272ecbe48b0aa736cb43807be1d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:44:23.771043 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff86837-cc6b-4469-8ea6-d82b720a86ed service neutron] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:44:23.771594 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff86837-cc6b-4469-8ea6-d82b720a86ed service neutron] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:44:23.772121 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff86837-cc6b-4469-8ea6-d82b720a86ed service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:44:23.774086 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-0ff86837-cc6b-4469-8ea6-d82b720a86ed service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:44:23.885985 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff86837-cc6b-4469-8ea6-d82b720a86ed service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:44:23.887351 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff86837-cc6b-4469-8ea6-d82b720a86ed service neutron] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:44:23.906822 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 657/1314] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jul 14 10:44:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:44:26.286358 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88cecb8-8f2b-48b7-b7b1-7abe3ae3abd0 None None] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:44:26.286904 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88cecb8-8f2b-48b7-b7b1-7abe3ae3abd0 None None] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:44:26.286904 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88cecb8-8f2b-48b7-b7b1-7abe3ae3abd0 None None] PATH_INFO: `/` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:44:26.288291 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 658/1315] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jul 14 10:44:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:44:26.293527 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8d9a54-001f-4f46-b0fc-b6cef52cf8bf None None] REQUEST_METHOD: `POST` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:44:26.293946 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8d9a54-001f-4f46-b0fc-b6cef52cf8bf None None] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:44:26.294089 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8d9a54-001f-4f46-b0fc-b6cef52cf8bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:44:26.359718 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.auth.core [None req-ea8d9a54-001f-4f46-b0fc-b6cef52cf8bf None None] MFA Rules not processed for user `e58c38e93bc5470c8e1f42d205fe21c2`. Rule list: `[]` (Enabled: `True`). {{(pid=86655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:44:26.361155 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-ea8d9a54-001f-4f46-b0fc-b6cef52cf8bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:44:26.412465 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=100 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:44:26.456427 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 658/1316] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jul 14 10:44:26 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:44:26.510229 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8ff67a-1bd6-440d-8993-33309d33dd5a None None] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:44:26.510519 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8ff67a-1bd6-440d-8993-33309d33dd5a None None] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:44:26.510803 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8ff67a-1bd6-440d-8993-33309d33dd5a None None] PATH_INFO: `/` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:44:26.512165 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 659/1317] 10.222.0.16 () {54 vars in 964 bytes} [Thu Jul 14 10:44:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:44:26.518599 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf4ae56-c373-4920-94cc-08ba1ac63d47 None None] REQUEST_METHOD: `POST` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:44:26.518923 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf4ae56-c373-4920-94cc-08ba1ac63d47 None None] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:44:26.519206 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf4ae56-c373-4920-94cc-08ba1ac63d47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:44:26.592613 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.auth.core [None req-fbf4ae56-c373-4920-94cc-08ba1ac63d47 None None] MFA Rules not processed for user `4dddf93691844886982c91fea974385d`. Rule list: `[]` (Enabled: `True`). {{(pid=86655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:44:26.593846 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-fbf4ae56-c373-4920-94cc-08ba1ac63d47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:44:26.669660 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 659/1318] 10.222.0.16 () {58 vars in 1061 bytes} [Thu Jul 14 10:44:26 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:44:26.678528 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8ff67a-1bd6-440d-8993-33309d33dd5a None None] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:44:26.680325 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-8c8ff67a-1bd6-440d-8993-33309d33dd5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:44:26.690782 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=100 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:44:26.784496 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8ff67a-1bd6-440d-8993-33309d33dd5a None None] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:44:26.857496 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed637ad3-5358-4314-ac73-8f69d3dab79e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dddf93691844886982c91fea974385d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59391272ecbe48b0aa736cb43807be1d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:44:26.858072 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed637ad3-5358-4314-ac73-8f69d3dab79e service neutron] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:44:26.858359 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed637ad3-5358-4314-ac73-8f69d3dab79e service neutron] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:44:26.858638 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed637ad3-5358-4314-ac73-8f69d3dab79e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:44:26.860930 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-ed637ad3-5358-4314-ac73-8f69d3dab79e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:44:26.920675 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=100 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:44:26.966663 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed637ad3-5358-4314-ac73-8f69d3dab79e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:44:26.968100 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed637ad3-5358-4314-ac73-8f69d3dab79e service neutron] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:44:26.987644 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 660/1319] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jul 14 10:44:26 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:44:29.896998 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978c26d0-088b-4d1b-9c8b-aa423f3cd6ad None None] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:44:29.897553 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978c26d0-088b-4d1b-9c8b-aa423f3cd6ad None None] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:44:29.897553 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978c26d0-088b-4d1b-9c8b-aa423f3cd6ad None None] PATH_INFO: `/` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:44:29.898866 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 660/1320] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jul 14 10:44:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:44:29.903994 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c535cdab-dda5-4999-907c-9046d4deaae4 None None] REQUEST_METHOD: `POST` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:44:29.904406 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c535cdab-dda5-4999-907c-9046d4deaae4 None None] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:44:29.904562 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c535cdab-dda5-4999-907c-9046d4deaae4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:44:29.969946 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.auth.core [None req-c535cdab-dda5-4999-907c-9046d4deaae4 None None] MFA Rules not processed for user `ae4bcdd8106d4bebbdcae96be33505bc`. Rule list: `[]` (Enabled: `True`). {{(pid=86656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:44:29.971338 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-c535cdab-dda5-4999-907c-9046d4deaae4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:44:30.066451 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 661/1321] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jul 14 10:44:29 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:44:30.105972 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978c26d0-088b-4d1b-9c8b-aa423f3cd6ad None None] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:44:30.107526 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-978c26d0-088b-4d1b-9c8b-aa423f3cd6ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:44:30.156364 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=100 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:44:30.219842 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978c26d0-088b-4d1b-9c8b-aa423f3cd6ad None None] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:44:30.292147 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2b96d4-2c60-4d5c-a8cd-57b3bdd9badc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dddf93691844886982c91fea974385d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59391272ecbe48b0aa736cb43807be1d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:44:30.292810 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2b96d4-2c60-4d5c-a8cd-57b3bdd9badc service neutron] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:44:30.293099 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2b96d4-2c60-4d5c-a8cd-57b3bdd9badc service neutron] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:44:30.293375 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2b96d4-2c60-4d5c-a8cd-57b3bdd9badc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:44:30.295022 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-3f2b96d4-2c60-4d5c-a8cd-57b3bdd9badc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:44:30.389690 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=100 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:44:30.403153 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2b96d4-2c60-4d5c-a8cd-57b3bdd9badc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:44:30.404597 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2b96d4-2c60-4d5c-a8cd-57b3bdd9badc service neutron] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:44:30.422846 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 661/1322] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jul 14 10:44:30 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:44:33.141616 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674d25fd-1312-4e2b-a7ed-a083855433b3 None None] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:44:33.142365 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674d25fd-1312-4e2b-a7ed-a083855433b3 None None] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:44:33.142683 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674d25fd-1312-4e2b-a7ed-a083855433b3 None None] PATH_INFO: `/` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:44:33.144088 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 662/1323] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jul 14 10:44:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:44:33.149449 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55e42b0-288d-4dcf-8e70-a3aa6a55caa0 None None] REQUEST_METHOD: `POST` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:44:33.149872 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55e42b0-288d-4dcf-8e70-a3aa6a55caa0 None None] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:44:33.150024 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55e42b0-288d-4dcf-8e70-a3aa6a55caa0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:44:33.214907 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.auth.core [None req-f55e42b0-288d-4dcf-8e70-a3aa6a55caa0 None None] MFA Rules not processed for user `ae4bcdd8106d4bebbdcae96be33505bc`. Rule list: `[]` (Enabled: `True`). {{(pid=86655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:44:33.216137 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-f55e42b0-288d-4dcf-8e70-a3aa6a55caa0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:44:33.321600 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 662/1324] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jul 14 10:44:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:44:33.358488 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674d25fd-1312-4e2b-a7ed-a083855433b3 None None] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:44:33.360026 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-674d25fd-1312-4e2b-a7ed-a083855433b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:44:33.381332 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=100 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:44:33.473827 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674d25fd-1312-4e2b-a7ed-a083855433b3 None None] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:44:33.548838 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d6cbac-eb0a-4d1d-881f-f969a8a3d6ff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dddf93691844886982c91fea974385d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59391272ecbe48b0aa736cb43807be1d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:44:33.549490 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d6cbac-eb0a-4d1d-881f-f969a8a3d6ff service neutron] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:44:33.549773 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d6cbac-eb0a-4d1d-881f-f969a8a3d6ff service neutron] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:44:33.550047 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d6cbac-eb0a-4d1d-881f-f969a8a3d6ff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:44:33.551693 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-82d6cbac-eb0a-4d1d-881f-f969a8a3d6ff service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:44:33.622258 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=100 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:44:33.660274 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d6cbac-eb0a-4d1d-881f-f969a8a3d6ff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:44:33.661744 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d6cbac-eb0a-4d1d-881f-f969a8a3d6ff service neutron] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:44:33.680069 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 663/1325] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jul 14 10:44:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:44:35.759199 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e777531f-7bed-4d6b-bbda-4d42bf37f609 None None] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:44:35.759725 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e777531f-7bed-4d6b-bbda-4d42bf37f609 None None] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:44:35.759725 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e777531f-7bed-4d6b-bbda-4d42bf37f609 None None] PATH_INFO: `/` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:44:35.761051 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 663/1326] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jul 14 10:44:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:44:35.766278 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc35129-2108-4f8c-9243-14d19deb1629 None None] REQUEST_METHOD: `POST` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:44:35.766866 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc35129-2108-4f8c-9243-14d19deb1629 None None] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:44:35.766866 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc35129-2108-4f8c-9243-14d19deb1629 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:44:35.831991 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.auth.core [None req-9bc35129-2108-4f8c-9243-14d19deb1629 None None] MFA Rules not processed for user `ae4bcdd8106d4bebbdcae96be33505bc`. Rule list: `[]` (Enabled: `True`). {{(pid=86656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:44:35.833230 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-9bc35129-2108-4f8c-9243-14d19deb1629 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:44:35.928645 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 664/1327] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jul 14 10:44:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:44:35.963771 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e777531f-7bed-4d6b-bbda-4d42bf37f609 None None] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:44:35.965752 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-e777531f-7bed-4d6b-bbda-4d42bf37f609 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:44:36.026331 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=100 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:44:36.070720 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e777531f-7bed-4d6b-bbda-4d42bf37f609 None None] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:44:36.147535 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05038ee-7542-4dd4-bfe0-c4009ecffc21 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dddf93691844886982c91fea974385d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59391272ecbe48b0aa736cb43807be1d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:44:36.148217 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05038ee-7542-4dd4-bfe0-c4009ecffc21 service neutron] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:44:36.148502 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05038ee-7542-4dd4-bfe0-c4009ecffc21 service neutron] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:44:36.148796 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05038ee-7542-4dd4-bfe0-c4009ecffc21 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:44:36.150577 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-b05038ee-7542-4dd4-bfe0-c4009ecffc21 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:44:36.260362 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=100 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:44:36.263124 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05038ee-7542-4dd4-bfe0-c4009ecffc21 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:44:36.265033 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05038ee-7542-4dd4-bfe0-c4009ecffc21 service neutron] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:44:36.284753 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 664/1328] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jul 14 10:44:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:44:38.360685 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0282644f-5b04-42ed-9032-3157359e4ed6 None None] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:44:38.361260 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0282644f-5b04-42ed-9032-3157359e4ed6 None None] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:44:38.361260 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0282644f-5b04-42ed-9032-3157359e4ed6 None None] PATH_INFO: `/` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:44:38.362646 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 665/1329] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jul 14 10:44:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:44:38.367730 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5791cc-cb3f-4e77-9263-54ccd478f5ac None None] REQUEST_METHOD: `POST` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:44:38.368158 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5791cc-cb3f-4e77-9263-54ccd478f5ac None None] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:44:38.368359 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5791cc-cb3f-4e77-9263-54ccd478f5ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:44:38.435371 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.auth.core [None req-aa5791cc-cb3f-4e77-9263-54ccd478f5ac None None] MFA Rules not processed for user `e58c38e93bc5470c8e1f42d205fe21c2`. Rule list: `[]` (Enabled: `True`). {{(pid=86655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:44:38.436621 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-aa5791cc-cb3f-4e77-9263-54ccd478f5ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:44:38.542223 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 665/1330] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jul 14 10:44:38 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:44:38.581504 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0282644f-5b04-42ed-9032-3157359e4ed6 None None] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:44:38.583050 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-0282644f-5b04-42ed-9032-3157359e4ed6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:44:38.613450 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=100 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:44:38.686345 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0282644f-5b04-42ed-9032-3157359e4ed6 None None] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:44:38.759737 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98db8623-5b1d-498c-953d-46f0109f04bd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dddf93691844886982c91fea974385d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59391272ecbe48b0aa736cb43807be1d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:44:38.760307 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98db8623-5b1d-498c-953d-46f0109f04bd service neutron] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:44:38.760592 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98db8623-5b1d-498c-953d-46f0109f04bd service neutron] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:44:38.760903 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98db8623-5b1d-498c-953d-46f0109f04bd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:44:38.762573 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-98db8623-5b1d-498c-953d-46f0109f04bd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:44:38.846374 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=100 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:44:38.879107 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98db8623-5b1d-498c-953d-46f0109f04bd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:44:38.880546 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98db8623-5b1d-498c-953d-46f0109f04bd service neutron] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:44:38.898811 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 666/1331] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jul 14 10:44:38 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:44:41.215900 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4465fbca-2786-4f26-938c-8d0a0ce1dbab None None] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:44:41.216499 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4465fbca-2786-4f26-938c-8d0a0ce1dbab None None] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:44:41.216499 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4465fbca-2786-4f26-938c-8d0a0ce1dbab None None] PATH_INFO: `/` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:44:41.217885 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 666/1332] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jul 14 10:44:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:44:41.223713 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1045d6-4e4b-464e-9862-ebbf13f8e669 None None] REQUEST_METHOD: `POST` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:44:41.224155 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1045d6-4e4b-464e-9862-ebbf13f8e669 None None] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:44:41.224254 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1045d6-4e4b-464e-9862-ebbf13f8e669 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:44:41.287523 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.auth.core [None req-7a1045d6-4e4b-464e-9862-ebbf13f8e669 None None] MFA Rules not processed for user `ae4bcdd8106d4bebbdcae96be33505bc`. Rule list: `[]` (Enabled: `True`). {{(pid=86656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:44:41.288725 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-7a1045d6-4e4b-464e-9862-ebbf13f8e669 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:44:41.383682 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 667/1333] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jul 14 10:44:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:44:41.419029 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4465fbca-2786-4f26-938c-8d0a0ce1dbab None None] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:44:41.420569 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-4465fbca-2786-4f26-938c-8d0a0ce1dbab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:44:41.490222 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=100 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:44:41.526897 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4465fbca-2786-4f26-938c-8d0a0ce1dbab None None] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:44:41.598895 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5450d8b2-09bd-4198-b2b9-0a0289a6e491 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dddf93691844886982c91fea974385d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59391272ecbe48b0aa736cb43807be1d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:44:41.599541 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5450d8b2-09bd-4198-b2b9-0a0289a6e491 service neutron] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:44:41.599823 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5450d8b2-09bd-4198-b2b9-0a0289a6e491 service neutron] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:44:41.600097 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5450d8b2-09bd-4198-b2b9-0a0289a6e491 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:44:41.601764 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-5450d8b2-09bd-4198-b2b9-0a0289a6e491 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:44:41.714321 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5450d8b2-09bd-4198-b2b9-0a0289a6e491 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:44:41.715849 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5450d8b2-09bd-4198-b2b9-0a0289a6e491 service neutron] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:44:41.726406 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=100 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:44:41.735774 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 667/1334] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jul 14 10:44:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:44:43.817946 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8127d5-8a5f-4924-9bb9-a240c93a0ae0 None None] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:44:43.818442 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8127d5-8a5f-4924-9bb9-a240c93a0ae0 None None] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:44:43.818539 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8127d5-8a5f-4924-9bb9-a240c93a0ae0 None None] PATH_INFO: `/` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:44:43.819901 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 668/1335] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jul 14 10:44:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:44:43.825121 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ad31f1-1bea-4bfd-aaf8-32a250e93ad8 None None] REQUEST_METHOD: `POST` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:44:43.825535 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ad31f1-1bea-4bfd-aaf8-32a250e93ad8 None None] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:44:43.825766 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ad31f1-1bea-4bfd-aaf8-32a250e93ad8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:44:43.889867 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.auth.core [None req-f4ad31f1-1bea-4bfd-aaf8-32a250e93ad8 None None] MFA Rules not processed for user `ae4bcdd8106d4bebbdcae96be33505bc`. Rule list: `[]` (Enabled: `True`). {{(pid=86655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:44:43.891523 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-f4ad31f1-1bea-4bfd-aaf8-32a250e93ad8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:44:43.986749 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 668/1336] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jul 14 10:44:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:44:44.026141 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8127d5-8a5f-4924-9bb9-a240c93a0ae0 None None] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:44:44.027719 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-ec8127d5-8a5f-4924-9bb9-a240c93a0ae0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:44:44.068056 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=100 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:44:44.131127 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8127d5-8a5f-4924-9bb9-a240c93a0ae0 None None] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:44:44.201753 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e3b90c-1115-4f6a-89d5-37cc10e0b448 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dddf93691844886982c91fea974385d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59391272ecbe48b0aa736cb43807be1d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:44:44.202331 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e3b90c-1115-4f6a-89d5-37cc10e0b448 service neutron] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:44:44.202612 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e3b90c-1115-4f6a-89d5-37cc10e0b448 service neutron] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:44:44.203558 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e3b90c-1115-4f6a-89d5-37cc10e0b448 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:44:44.206077 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-31e3b90c-1115-4f6a-89d5-37cc10e0b448 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:44:44.287326 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=100 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:44:44.313662 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e3b90c-1115-4f6a-89d5-37cc10e0b448 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:44:44.315098 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e3b90c-1115-4f6a-89d5-37cc10e0b448 service neutron] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:44:44.333164 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 669/1337] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jul 14 10:44:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:44:46.684059 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfd5f0b-0097-4334-9f11-b43fa0d7865b None None] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:44:46.684626 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfd5f0b-0097-4334-9f11-b43fa0d7865b None None] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:44:46.684626 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfd5f0b-0097-4334-9f11-b43fa0d7865b None None] PATH_INFO: `/` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:44:46.686097 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 669/1338] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jul 14 10:44:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:44:46.692027 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81117ae-f8bf-4b46-9a21-44a4edc2569d None None] REQUEST_METHOD: `POST` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:44:46.692422 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81117ae-f8bf-4b46-9a21-44a4edc2569d None None] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:44:46.692587 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81117ae-f8bf-4b46-9a21-44a4edc2569d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:44:46.754945 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.auth.core [None req-b81117ae-f8bf-4b46-9a21-44a4edc2569d None None] MFA Rules not processed for user `ae4bcdd8106d4bebbdcae96be33505bc`. Rule list: `[]` (Enabled: `True`). {{(pid=86656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:44:46.756147 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-b81117ae-f8bf-4b46-9a21-44a4edc2569d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:44:46.852704 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 670/1339] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jul 14 10:44:46 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:44:46.888551 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfd5f0b-0097-4334-9f11-b43fa0d7865b None None] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:44:46.890686 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-9cfd5f0b-0097-4334-9f11-b43fa0d7865b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:44:46.967403 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=100 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:44:46.995103 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfd5f0b-0097-4334-9f11-b43fa0d7865b None None] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:44:47.067399 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d3740d-03aa-4bb2-81f0-6a57ded254e7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dddf93691844886982c91fea974385d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59391272ecbe48b0aa736cb43807be1d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:44:47.068048 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d3740d-03aa-4bb2-81f0-6a57ded254e7 service neutron] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:44:47.068334 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d3740d-03aa-4bb2-81f0-6a57ded254e7 service neutron] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:44:47.068610 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d3740d-03aa-4bb2-81f0-6a57ded254e7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:44:47.070294 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-75d3740d-03aa-4bb2-81f0-6a57ded254e7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:44:47.176794 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d3740d-03aa-4bb2-81f0-6a57ded254e7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:44:47.178224 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d3740d-03aa-4bb2-81f0-6a57ded254e7 service neutron] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:44:47.196723 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 670/1340] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jul 14 10:44:46 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:44:51.363451 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d78f6e-964a-4e84-b5b4-d452303a4c36 None None] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:44:51.364009 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d78f6e-964a-4e84-b5b4-d452303a4c36 None None] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:44:51.364009 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d78f6e-964a-4e84-b5b4-d452303a4c36 None None] PATH_INFO: `/` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:44:51.365508 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 671/1341] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jul 14 10:44:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:44:51.371014 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922a7a4e-5963-4838-93bf-c0e96a7287d1 None None] REQUEST_METHOD: `POST` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:44:51.371428 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922a7a4e-5963-4838-93bf-c0e96a7287d1 None None] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:44:51.371708 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922a7a4e-5963-4838-93bf-c0e96a7287d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:44:51.376254 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=100 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:44:51.442619 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.auth.core [None req-922a7a4e-5963-4838-93bf-c0e96a7287d1 None None] MFA Rules not processed for user `ae4bcdd8106d4bebbdcae96be33505bc`. Rule list: `[]` (Enabled: `True`). {{(pid=86655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:44:51.443754 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-922a7a4e-5963-4838-93bf-c0e96a7287d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:44:51.543011 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 671/1342] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jul 14 10:44:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:44:51.582186 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d78f6e-964a-4e84-b5b4-d452303a4c36 None None] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:44:51.583826 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-36d78f6e-964a-4e84-b5b4-d452303a4c36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:44:51.632345 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=100 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:44:51.688605 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d78f6e-964a-4e84-b5b4-d452303a4c36 None None] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:44:51.762068 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a06001e-71f5-4255-8a19-15d2bf51370e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dddf93691844886982c91fea974385d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59391272ecbe48b0aa736cb43807be1d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:44:51.762633 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a06001e-71f5-4255-8a19-15d2bf51370e service neutron] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:44:51.762917 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a06001e-71f5-4255-8a19-15d2bf51370e service neutron] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:44:51.763195 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a06001e-71f5-4255-8a19-15d2bf51370e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:44:51.764877 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-2a06001e-71f5-4255-8a19-15d2bf51370e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:44:51.879522 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a06001e-71f5-4255-8a19-15d2bf51370e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:44:51.880987 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a06001e-71f5-4255-8a19-15d2bf51370e service neutron] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:44:51.885307 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=100 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:44:51.902479 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 672/1343] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jul 14 10:44:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:44:54.555446 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2752b70d-5caf-4738-8f66-3cf9d02baca0 None None] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:44:54.556055 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2752b70d-5caf-4738-8f66-3cf9d02baca0 None None] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:44:54.556055 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2752b70d-5caf-4738-8f66-3cf9d02baca0 None None] PATH_INFO: `/` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:44:54.557553 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 672/1344] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jul 14 10:44:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:44:54.563488 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6e0172-3aa1-4d03-9307-73648153344c None None] REQUEST_METHOD: `POST` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:44:54.564030 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6e0172-3aa1-4d03-9307-73648153344c None None] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:44:54.565146 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6e0172-3aa1-4d03-9307-73648153344c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:44:54.638999 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.auth.core [None req-fc6e0172-3aa1-4d03-9307-73648153344c None None] MFA Rules not processed for user `ae4bcdd8106d4bebbdcae96be33505bc`. Rule list: `[]` (Enabled: `True`). {{(pid=86656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:44:54.640344 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-fc6e0172-3aa1-4d03-9307-73648153344c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:44:54.740729 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 673/1345] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jul 14 10:44:54 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:44:54.777109 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2752b70d-5caf-4738-8f66-3cf9d02baca0 None None] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:44:54.778764 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-2752b70d-5caf-4738-8f66-3cf9d02baca0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:44:54.870139 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=100 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:44:54.887327 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2752b70d-5caf-4738-8f66-3cf9d02baca0 None None] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:44:54.961167 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc544f8f-f3f7-4852-9812-9e8c97869c12 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dddf93691844886982c91fea974385d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59391272ecbe48b0aa736cb43807be1d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:44:54.961819 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc544f8f-f3f7-4852-9812-9e8c97869c12 service neutron] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:44:54.962100 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc544f8f-f3f7-4852-9812-9e8c97869c12 service neutron] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:44:54.962369 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc544f8f-f3f7-4852-9812-9e8c97869c12 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:44:54.964006 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-bc544f8f-f3f7-4852-9812-9e8c97869c12 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:44:55.072312 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc544f8f-f3f7-4852-9812-9e8c97869c12 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:44:55.073767 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc544f8f-f3f7-4852-9812-9e8c97869c12 service neutron] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:44:55.092714 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 673/1346] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jul 14 10:44:54 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:44:59.096793 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c23358e-e61e-43a4-9b6c-860789e4b385 None None] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:44:59.097370 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c23358e-e61e-43a4-9b6c-860789e4b385 None None] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:44:59.097370 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c23358e-e61e-43a4-9b6c-860789e4b385 None None] PATH_INFO: `/` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:44:59.098771 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 674/1347] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jul 14 10:44:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:44:59.103973 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9007b38b-8b31-4e0d-bb55-cd3e6a62c90b None None] REQUEST_METHOD: `POST` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:44:59.104401 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9007b38b-8b31-4e0d-bb55-cd3e6a62c90b None None] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:44:59.104666 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9007b38b-8b31-4e0d-bb55-cd3e6a62c90b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:44:59.119264 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=100 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:44:59.170452 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.auth.core [None req-9007b38b-8b31-4e0d-bb55-cd3e6a62c90b None None] MFA Rules not processed for user `ae4bcdd8106d4bebbdcae96be33505bc`. Rule list: `[]` (Enabled: `True`). {{(pid=86655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:44:59.172483 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-9007b38b-8b31-4e0d-bb55-cd3e6a62c90b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:44:59.278541 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 674/1348] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jul 14 10:44:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:44:59.318033 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c23358e-e61e-43a4-9b6c-860789e4b385 None None] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:44:59.319595 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-5c23358e-e61e-43a4-9b6c-860789e4b385 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:44:59.382449 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=100 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:44:59.433853 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c23358e-e61e-43a4-9b6c-860789e4b385 None None] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:44:59.510272 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7a8b8f-d178-44d2-aa50-a6c128891fdd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dddf93691844886982c91fea974385d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59391272ecbe48b0aa736cb43807be1d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:44:59.511310 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7a8b8f-d178-44d2-aa50-a6c128891fdd service neutron] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:44:59.511532 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7a8b8f-d178-44d2-aa50-a6c128891fdd service neutron] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:44:59.511812 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7a8b8f-d178-44d2-aa50-a6c128891fdd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:44:59.513573 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-dd7a8b8f-d178-44d2-aa50-a6c128891fdd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:44:59.623909 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=100 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:44:59.627948 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7a8b8f-d178-44d2-aa50-a6c128891fdd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:44:59.630114 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7a8b8f-d178-44d2-aa50-a6c128891fdd service neutron] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:44:59.653062 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 675/1349] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jul 14 10:44:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:45:04.521559 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea438f39-f3e4-4ab9-b786-f3aa39b80667 None None] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:45:04.521994 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea438f39-f3e4-4ab9-b786-f3aa39b80667 None None] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:45:04.522106 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea438f39-f3e4-4ab9-b786-f3aa39b80667 None None] PATH_INFO: `/` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:45:04.523497 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 675/1350] 10.222.0.16 () {54 vars in 921 bytes} [Thu Jul 14 10:45:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:45:04.528727 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6271bd29-fce7-4435-a2db-37f1b8641b89 None None] REQUEST_METHOD: `POST` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:45:04.529201 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6271bd29-fce7-4435-a2db-37f1b8641b89 None None] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:45:04.529385 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6271bd29-fce7-4435-a2db-37f1b8641b89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:45:04.681697 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.auth.core [None req-6271bd29-fce7-4435-a2db-37f1b8641b89 None None] MFA Rules not processed for user `16846111ee2a42dd99c3052d40980f72`. Rule list: `[]` (Enabled: `True`). {{(pid=86656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:45:04.683029 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-6271bd29-fce7-4435-a2db-37f1b8641b89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:45:04.803652 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 676/1351] 10.222.0.16 () {58 vars in 1018 bytes} [Thu Jul 14 10:45:04 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 276 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:45:08.953401 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1c4327-9789-4043-bb0e-6aa0ea15eec1 None None] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:45:08.953932 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1c4327-9789-4043-bb0e-6aa0ea15eec1 None None] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:45:08.953932 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1c4327-9789-4043-bb0e-6aa0ea15eec1 None None] PATH_INFO: `/` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:45:08.955595 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 676/1352] 10.222.0.16 () {54 vars in 921 bytes} [Thu Jul 14 10:45:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:45:08.960914 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783e2cf1-1619-495c-824c-7759f66665a0 None None] REQUEST_METHOD: `POST` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:45:08.961737 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783e2cf1-1619-495c-824c-7759f66665a0 None None] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:45:08.962224 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783e2cf1-1619-495c-824c-7759f66665a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:45:09.022216 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=100 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:45:09.050255 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.auth.core [None req-783e2cf1-1619-495c-824c-7759f66665a0 None None] MFA Rules not processed for user `16846111ee2a42dd99c3052d40980f72`. Rule list: `[]` (Enabled: `True`). {{(pid=86656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:45:09.051706 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-783e2cf1-1619-495c-824c-7759f66665a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:45:09.174589 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 677/1353] 10.222.0.16 () {58 vars in 1018 bytes} [Thu Jul 14 10:45:08 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:45:09.276969 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=59 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:45:10.512362 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99368b10-ec86-480d-9016-b8f95c7a47b0 None None] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:45:10.512999 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99368b10-ec86-480d-9016-b8f95c7a47b0 None None] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:45:10.512999 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99368b10-ec86-480d-9016-b8f95c7a47b0 None None] PATH_INFO: `/` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:45:10.514537 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 677/1354] 10.222.0.16 () {54 vars in 921 bytes} [Thu Jul 14 10:45:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:45:10.519524 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8458e84-342a-43ea-a4f4-f3662e4f88c0 None None] REQUEST_METHOD: `POST` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:45:10.519925 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8458e84-342a-43ea-a4f4-f3662e4f88c0 None None] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:45:10.520412 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8458e84-342a-43ea-a4f4-f3662e4f88c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:45:10.603070 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.auth.core [None req-e8458e84-342a-43ea-a4f4-f3662e4f88c0 None None] MFA Rules not processed for user `16846111ee2a42dd99c3052d40980f72`. Rule list: `[]` (Enabled: `True`). {{(pid=86656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:45:10.604267 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-e8458e84-342a-43ea-a4f4-f3662e4f88c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:45:10.648601 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=100 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:45:10.719074 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 678/1355] 10.222.0.16 () {58 vars in 1018 bytes} [Thu Jul 14 10:45:10 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:45:14.243489 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8ce0aa-84db-4cd4-bee5-7367f6425dca None None] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:45:14.244044 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8ce0aa-84db-4cd4-bee5-7367f6425dca None None] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:45:14.244044 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8ce0aa-84db-4cd4-bee5-7367f6425dca None None] PATH_INFO: `/` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:45:14.245877 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 678/1356] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jul 14 10:45:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:45:14.252514 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5979c267-fbc0-45c2-83d7-f9abe4892519 None None] REQUEST_METHOD: `POST` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:45:14.252514 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5979c267-fbc0-45c2-83d7-f9abe4892519 None None] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:45:14.252514 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5979c267-fbc0-45c2-83d7-f9abe4892519 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:45:14.327459 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.auth.core [None req-5979c267-fbc0-45c2-83d7-f9abe4892519 None None] MFA Rules not processed for user `ae4bcdd8106d4bebbdcae96be33505bc`. Rule list: `[]` (Enabled: `True`). {{(pid=86656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:45:14.328669 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-5979c267-fbc0-45c2-83d7-f9abe4892519 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:45:14.434015 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 679/1357] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jul 14 10:45:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:45:14.489196 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b1f605-1f6c-4db3-8ed8-60709b888969 None None] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:45:14.489790 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b1f605-1f6c-4db3-8ed8-60709b888969 None None] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:45:14.490346 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b1f605-1f6c-4db3-8ed8-60709b888969 None None] PATH_INFO: `/` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:45:14.492090 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 679/1358] 10.222.0.16 () {54 vars in 961 bytes} [Thu Jul 14 10:45:14 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:45:14.501141 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d06c591-af00-4493-909f-5c16096b51ed None None] REQUEST_METHOD: `POST` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:45:14.501746 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d06c591-af00-4493-909f-5c16096b51ed None None] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:45:14.502267 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d06c591-af00-4493-909f-5c16096b51ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:45:14.523759 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=100 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:45:14.591363 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.auth.core [None req-6d06c591-af00-4493-909f-5c16096b51ed None None] MFA Rules not processed for user `26aa294c913c408499a913ec25bb677d`. Rule list: `[]` (Enabled: `True`). {{(pid=86656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:45:14.592645 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-6d06c591-af00-4493-909f-5c16096b51ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:45:14.719230 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 680/1359] 10.222.0.16 () {58 vars in 1058 bytes} [Thu Jul 14 10:45:14 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 10:45:14.726977 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b1f605-1f6c-4db3-8ed8-60709b888969 None None] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:45:14.728530 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-b8b1f605-1f6c-4db3-8ed8-60709b888969 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:45:14.891431 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b1f605-1f6c-4db3-8ed8-60709b888969 None None] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:45:14.968599 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=100 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:45:15.015599 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00db8332-3fb5-4c24-879d-44c08fd7772d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26aa294c913c408499a913ec25bb677d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59391272ecbe48b0aa736cb43807be1d', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:45:15.016253 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00db8332-3fb5-4c24-879d-44c08fd7772d service nova] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:45:15.016540 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00db8332-3fb5-4c24-879d-44c08fd7772d service nova] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:45:15.016845 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00db8332-3fb5-4c24-879d-44c08fd7772d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:45:15.018501 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-00db8332-3fb5-4c24-879d-44c08fd7772d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:45:15.120276 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00db8332-3fb5-4c24-879d-44c08fd7772d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:45:15.121906 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00db8332-3fb5-4c24-879d-44c08fd7772d service nova] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:45:15.141983 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 680/1360] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jul 14 10:45:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 415 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:45:17.407702 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5139ecce-6f86-4a4b-9116-f61cbe64bab2 None None] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:45:17.408266 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5139ecce-6f86-4a4b-9116-f61cbe64bab2 None None] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:45:17.408266 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5139ecce-6f86-4a4b-9116-f61cbe64bab2 None None] PATH_INFO: `/` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:45:17.409846 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 681/1361] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jul 14 10:45:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 14 10:45:17.415330 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccbcfab-dc42-4854-bf2e-80b7bed6cae0 None None] REQUEST_METHOD: `POST` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:45:17.415789 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccbcfab-dc42-4854-bf2e-80b7bed6cae0 None None] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:45:17.415967 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccbcfab-dc42-4854-bf2e-80b7bed6cae0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:45:17.487197 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.auth.core [None req-6ccbcfab-dc42-4854-bf2e-80b7bed6cae0 None None] MFA Rules not processed for user `ae4bcdd8106d4bebbdcae96be33505bc`. Rule list: `[]` (Enabled: `True`). {{(pid=86655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:45:17.488325 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-6ccbcfab-dc42-4854-bf2e-80b7bed6cae0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:45:17.531580 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=100 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:45:17.601536 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 681/1362] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jul 14 10:45:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:45:17.649462 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5139ecce-6f86-4a4b-9116-f61cbe64bab2 None None] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:45:17.651107 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-5139ecce-6f86-4a4b-9116-f61cbe64bab2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:45:17.729219 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=100 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:45:17.821707 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5139ecce-6f86-4a4b-9116-f61cbe64bab2 None None] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:45:17.973305 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1ae942-5315-42f2-b82e-600c744660c6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26aa294c913c408499a913ec25bb677d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59391272ecbe48b0aa736cb43807be1d', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:45:17.974028 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1ae942-5315-42f2-b82e-600c744660c6 service nova] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:45:17.974303 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1ae942-5315-42f2-b82e-600c744660c6 service nova] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:45:17.974579 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1ae942-5315-42f2-b82e-600c744660c6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:45:17.976260 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-4b1ae942-5315-42f2-b82e-600c744660c6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:45:18.001709 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=100 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:45:18.074818 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1ae942-5315-42f2-b82e-600c744660c6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:45:18.076705 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1ae942-5315-42f2-b82e-600c744660c6 service nova] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:45:18.097018 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 682/1363] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jul 14 10:45:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 448 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:45:20.528308 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e569de1a-ce2b-4d57-a2d2-3ed34fcd48a9 None None] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:45:20.528967 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e569de1a-ce2b-4d57-a2d2-3ed34fcd48a9 None None] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:45:20.529156 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e569de1a-ce2b-4d57-a2d2-3ed34fcd48a9 None None] PATH_INFO: `/` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:45:20.531071 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 682/1364] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jul 14 10:45:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:45:20.536108 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe06367-732d-46d7-8607-f8f3aa7bb69b None None] REQUEST_METHOD: `POST` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:45:20.536919 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe06367-732d-46d7-8607-f8f3aa7bb69b None None] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:45:20.537204 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe06367-732d-46d7-8607-f8f3aa7bb69b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:45:20.620484 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.auth.core [None req-dbe06367-732d-46d7-8607-f8f3aa7bb69b None None] MFA Rules not processed for user `ae4bcdd8106d4bebbdcae96be33505bc`. Rule list: `[]` (Enabled: `True`). {{(pid=86656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:45:20.622009 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-dbe06367-732d-46d7-8607-f8f3aa7bb69b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:45:20.725156 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=100 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:45:20.728230 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 683/1365] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jul 14 10:45:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:45:20.773335 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705517a4-7d85-40a2-9e3a-30ee16c850fc None None] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:45:20.774114 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705517a4-7d85-40a2-9e3a-30ee16c850fc None None] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:45:20.774849 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705517a4-7d85-40a2-9e3a-30ee16c850fc None None] PATH_INFO: `/` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:45:20.783094 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 683/1366] 10.222.0.16 () {54 vars in 961 bytes} [Thu Jul 14 10:45:20 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:45:20.783224 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f118497-8def-4ad0-b0f8-a020a363f4c8 None None] REQUEST_METHOD: `POST` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:45:20.783483 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f118497-8def-4ad0-b0f8-a020a363f4c8 None None] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:45:20.783780 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f118497-8def-4ad0-b0f8-a020a363f4c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:45:20.867213 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.auth.core [None req-6f118497-8def-4ad0-b0f8-a020a363f4c8 None None] MFA Rules not processed for user `26aa294c913c408499a913ec25bb677d`. Rule list: `[]` (Enabled: `True`). {{(pid=86656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:45:20.868589 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-6f118497-8def-4ad0-b0f8-a020a363f4c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:45:20.999548 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 684/1367] 10.222.0.16 () {58 vars in 1058 bytes} [Thu Jul 14 10:45:20 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 10:45:21.007151 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705517a4-7d85-40a2-9e3a-30ee16c850fc None None] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:45:21.008677 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-705517a4-7d85-40a2-9e3a-30ee16c850fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:45:21.169862 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705517a4-7d85-40a2-9e3a-30ee16c850fc None None] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:45:21.191905 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=100 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:45:21.296183 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b662bf-0897-4ce9-8135-bcb42100bb2c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26aa294c913c408499a913ec25bb677d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59391272ecbe48b0aa736cb43807be1d', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:45:21.296755 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b662bf-0897-4ce9-8135-bcb42100bb2c service nova] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:45:21.297068 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b662bf-0897-4ce9-8135-bcb42100bb2c service nova] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:45:21.297346 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b662bf-0897-4ce9-8135-bcb42100bb2c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:45:21.299111 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-63b662bf-0897-4ce9-8135-bcb42100bb2c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:45:21.399582 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b662bf-0897-4ce9-8135-bcb42100bb2c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:45:21.401232 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b662bf-0897-4ce9-8135-bcb42100bb2c service nova] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:45:21.422954 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 684/1368] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jul 14 10:45:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 416 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:45:22.459630 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425dde7a-165f-41c2-a964-00d7f76768c5 None None] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:45:22.460174 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425dde7a-165f-41c2-a964-00d7f76768c5 None None] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:45:22.460482 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425dde7a-165f-41c2-a964-00d7f76768c5 None None] PATH_INFO: `/` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:45:22.462136 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 685/1369] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jul 14 10:45:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:45:22.467081 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505eb54e-12eb-4d0c-bd3e-319e1c4e98e7 None None] REQUEST_METHOD: `POST` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:45:22.467511 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505eb54e-12eb-4d0c-bd3e-319e1c4e98e7 None None] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:45:22.467702 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505eb54e-12eb-4d0c-bd3e-319e1c4e98e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:45:22.498841 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=100 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:45:22.537029 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.auth.core [None req-505eb54e-12eb-4d0c-bd3e-319e1c4e98e7 None None] MFA Rules not processed for user `ae4bcdd8106d4bebbdcae96be33505bc`. Rule list: `[]` (Enabled: `True`). {{(pid=86655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:45:22.538237 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-505eb54e-12eb-4d0c-bd3e-319e1c4e98e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:45:22.640571 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 685/1370] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jul 14 10:45:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:45:22.977999 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44327780-eecf-4d54-a329-2c8fd9fda544 None None] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:45:22.978174 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44327780-eecf-4d54-a329-2c8fd9fda544 None None] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:45:22.978329 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44327780-eecf-4d54-a329-2c8fd9fda544 None None] PATH_INFO: `/` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:45:22.980803 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 686/1371] 10.222.0.16 () {54 vars in 963 bytes} [Thu Jul 14 10:45:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:45:22.986208 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a299a9c-dbb5-45b8-926f-528ee55dc4d4 None None] REQUEST_METHOD: `POST` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:45:22.986523 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a299a9c-dbb5-45b8-926f-528ee55dc4d4 None None] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:45:22.986805 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a299a9c-dbb5-45b8-926f-528ee55dc4d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:45:23.065702 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.auth.core [None req-3a299a9c-dbb5-45b8-926f-528ee55dc4d4 None None] MFA Rules not processed for user `68382432147a48c3b62271fd2a2eab04`. Rule list: `[]` (Enabled: `True`). {{(pid=86655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:45:23.066908 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-3a299a9c-dbb5-45b8-926f-528ee55dc4d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:45:23.117721 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=100 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:45:23.152132 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 686/1372] 10.222.0.16 () {58 vars in 1060 bytes} [Thu Jul 14 10:45:22 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 10:45:23.159920 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44327780-eecf-4d54-a329-2c8fd9fda544 None None] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:45:23.161485 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-44327780-eecf-4d54-a329-2c8fd9fda544 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:45:23.214309 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=100 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:45:23.270730 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44327780-eecf-4d54-a329-2c8fd9fda544 None None] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:45:23.346492 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2ebb69-44b4-4b03-ae17-5f070929c21c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68382432147a48c3b62271fd2a2eab04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59391272ecbe48b0aa736cb43807be1d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:45:23.347149 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2ebb69-44b4-4b03-ae17-5f070929c21c service cinder] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:45:23.347434 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2ebb69-44b4-4b03-ae17-5f070929c21c service cinder] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:45:23.347712 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2ebb69-44b4-4b03-ae17-5f070929c21c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:45:23.349447 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-9f2ebb69-44b4-4b03-ae17-5f070929c21c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:45:23.449566 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=100 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:45:23.464487 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2ebb69-44b4-4b03-ae17-5f070929c21c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:45:23.465960 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2ebb69-44b4-4b03-ae17-5f070929c21c service cinder] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:45:23.485859 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 687/1373] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jul 14 10:45:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:45:23.541486 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1427a4f0-6f0a-40b3-bfa0-54511b4d979a None None] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:45:23.542017 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1427a4f0-6f0a-40b3-bfa0-54511b4d979a None None] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:45:23.542125 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1427a4f0-6f0a-40b3-bfa0-54511b4d979a None None] PATH_INFO: `/` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:45:23.544965 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 687/1374] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jul 14 10:45:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:45:23.549288 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2db421-771b-42f7-97d3-350d977289bc None None] REQUEST_METHOD: `POST` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:45:23.549587 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2db421-771b-42f7-97d3-350d977289bc None None] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:45:23.549874 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2db421-771b-42f7-97d3-350d977289bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:45:23.619985 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.auth.core [None req-2c2db421-771b-42f7-97d3-350d977289bc None None] MFA Rules not processed for user `ae4bcdd8106d4bebbdcae96be33505bc`. Rule list: `[]` (Enabled: `True`). {{(pid=86656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:45:23.621353 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-2c2db421-771b-42f7-97d3-350d977289bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:45:23.741362 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 688/1375] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jul 14 10:45:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:45:23.787527 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1427a4f0-6f0a-40b3-bfa0-54511b4d979a None None] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:45:23.789211 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-1427a4f0-6f0a-40b3-bfa0-54511b4d979a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:45:23.961462 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1427a4f0-6f0a-40b3-bfa0-54511b4d979a None None] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:45:24.032759 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=100 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:45:24.096680 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc49728-4152-427c-b908-801dd7d0a2cb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26aa294c913c408499a913ec25bb677d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59391272ecbe48b0aa736cb43807be1d', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:45:24.097286 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc49728-4152-427c-b908-801dd7d0a2cb service nova] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:45:24.097576 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc49728-4152-427c-b908-801dd7d0a2cb service nova] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:45:24.097854 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc49728-4152-427c-b908-801dd7d0a2cb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:45:24.099528 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-4cc49728-4152-427c-b908-801dd7d0a2cb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:45:24.192384 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc49728-4152-427c-b908-801dd7d0a2cb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:45:24.194097 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc49728-4152-427c-b908-801dd7d0a2cb service nova] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:45:24.212539 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 688/1376] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jul 14 10:45:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 425 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:45:26.303567 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791540bb-360a-4b73-ad75-719c8829f6db None None] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:45:26.304112 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791540bb-360a-4b73-ad75-719c8829f6db None None] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:45:26.304226 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791540bb-360a-4b73-ad75-719c8829f6db None None] PATH_INFO: `/` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:45:26.305619 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 689/1377] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jul 14 10:45:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:45:26.310943 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665b9431-990b-4fa8-97a9-3c58edc6639d None None] REQUEST_METHOD: `POST` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:45:26.311355 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665b9431-990b-4fa8-97a9-3c58edc6639d None None] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:45:26.311540 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665b9431-990b-4fa8-97a9-3c58edc6639d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:45:26.381824 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.auth.core [None req-665b9431-990b-4fa8-97a9-3c58edc6639d None None] MFA Rules not processed for user `ae4bcdd8106d4bebbdcae96be33505bc`. Rule list: `[]` (Enabled: `True`). {{(pid=86655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:45:26.383248 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-665b9431-990b-4fa8-97a9-3c58edc6639d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:45:26.391751 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=100 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:45:26.509302 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 689/1378] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jul 14 10:45:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 10:45:26.542495 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791540bb-360a-4b73-ad75-719c8829f6db None None] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:45:26.544017 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-791540bb-360a-4b73-ad75-719c8829f6db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:45:26.605005 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=100 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:45:26.689516 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791540bb-360a-4b73-ad75-719c8829f6db None None] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:45:26.805965 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a544e085-2bc8-45cd-bef4-7844a5512375 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26aa294c913c408499a913ec25bb677d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59391272ecbe48b0aa736cb43807be1d', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:45:26.806623 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a544e085-2bc8-45cd-bef4-7844a5512375 service nova] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:45:26.806909 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a544e085-2bc8-45cd-bef4-7844a5512375 service nova] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:45:26.807187 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a544e085-2bc8-45cd-bef4-7844a5512375 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:45:26.808894 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-a544e085-2bc8-45cd-bef4-7844a5512375 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:45:26.834526 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=100 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:45:26.929764 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a544e085-2bc8-45cd-bef4-7844a5512375 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:45:26.931530 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a544e085-2bc8-45cd-bef4-7844a5512375 service nova] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:45:26.958017 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 690/1379] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jul 14 10:45:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 416 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:45:29.083678 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b5b56c-d689-4ca9-ba45-06dd23cc8861 None None] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:45:29.084238 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b5b56c-d689-4ca9-ba45-06dd23cc8861 None None] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:45:29.084238 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b5b56c-d689-4ca9-ba45-06dd23cc8861 None None] PATH_INFO: `/` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:45:29.085859 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 690/1380] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jul 14 10:45:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:45:29.090917 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5e846d-a977-4aef-9b56-d31754a579a3 None None] REQUEST_METHOD: `POST` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:45:29.091951 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5e846d-a977-4aef-9b56-d31754a579a3 None None] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:45:29.092191 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5e846d-a977-4aef-9b56-d31754a579a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:45:29.170881 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.auth.core [None req-1e5e846d-a977-4aef-9b56-d31754a579a3 None None] MFA Rules not processed for user `ae4bcdd8106d4bebbdcae96be33505bc`. Rule list: `[]` (Enabled: `True`). {{(pid=86656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:45:29.172294 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-1e5e846d-a977-4aef-9b56-d31754a579a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:45:29.270508 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=100 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:45:29.278313 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 691/1381] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jul 14 10:45:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:45:29.322580 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b5b56c-d689-4ca9-ba45-06dd23cc8861 None None] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:45:29.324221 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-72b5b56c-d689-4ca9-ba45-06dd23cc8861 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:45:29.476744 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=100 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:45:29.488381 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b5b56c-d689-4ca9-ba45-06dd23cc8861 None None] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:45:29.608955 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ccadf9-82a1-4d8a-a57e-4a634b6e4af5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26aa294c913c408499a913ec25bb677d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59391272ecbe48b0aa736cb43807be1d', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:45:29.609969 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ccadf9-82a1-4d8a-a57e-4a634b6e4af5 service nova] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:45:29.610443 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ccadf9-82a1-4d8a-a57e-4a634b6e4af5 service nova] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:45:29.610936 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ccadf9-82a1-4d8a-a57e-4a634b6e4af5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:45:29.613156 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-49ccadf9-82a1-4d8a-a57e-4a634b6e4af5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:45:29.707820 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ccadf9-82a1-4d8a-a57e-4a634b6e4af5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:45:29.709473 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ccadf9-82a1-4d8a-a57e-4a634b6e4af5 service nova] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:45:29.720250 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=100 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:45:29.729296 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 691/1382] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jul 14 10:45:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 407 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:45:32.018100 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af26060-c360-4b3a-bbc3-8e7db0542c15 None None] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:45:32.018609 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af26060-c360-4b3a-bbc3-8e7db0542c15 None None] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:45:32.018609 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af26060-c360-4b3a-bbc3-8e7db0542c15 None None] PATH_INFO: `/` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:45:32.020030 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 692/1383] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jul 14 10:45:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:45:32.025643 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a80d8c6-f261-49c5-afb4-307e97db3857 None None] REQUEST_METHOD: `POST` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:45:32.026138 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a80d8c6-f261-49c5-afb4-307e97db3857 None None] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:45:32.026263 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a80d8c6-f261-49c5-afb4-307e97db3857 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:45:32.094579 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.auth.core [None req-6a80d8c6-f261-49c5-afb4-307e97db3857 None None] MFA Rules not processed for user `ae4bcdd8106d4bebbdcae96be33505bc`. Rule list: `[]` (Enabled: `True`). {{(pid=86655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:45:32.095795 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-6a80d8c6-f261-49c5-afb4-307e97db3857 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:45:32.193404 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 692/1384] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jul 14 10:45:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:45:32.246820 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af26060-c360-4b3a-bbc3-8e7db0542c15 None None] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:45:32.248885 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-2af26060-c360-4b3a-bbc3-8e7db0542c15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:45:32.397703 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af26060-c360-4b3a-bbc3-8e7db0542c15 None None] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:45:32.468397 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=100 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:45:32.651446 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bd6dbf-d427-47fc-ad92-909bfe9eca30 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26aa294c913c408499a913ec25bb677d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59391272ecbe48b0aa736cb43807be1d', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:45:32.652226 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bd6dbf-d427-47fc-ad92-909bfe9eca30 service nova] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:45:32.652611 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bd6dbf-d427-47fc-ad92-909bfe9eca30 service nova] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:45:32.653001 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bd6dbf-d427-47fc-ad92-909bfe9eca30 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:45:32.655974 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-85bd6dbf-d427-47fc-ad92-909bfe9eca30 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:45:32.765998 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85bd6dbf-d427-47fc-ad92-909bfe9eca30 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:45:32.768358 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85bd6dbf-d427-47fc-ad92-909bfe9eca30 service nova] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:45:32.792028 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 693/1385] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jul 14 10:45:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 546 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:45:34.854852 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf88a6c-5622-46ee-b8c1-dbc41eabf302 None None] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:45:34.855543 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf88a6c-5622-46ee-b8c1-dbc41eabf302 None None] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:45:34.855543 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf88a6c-5622-46ee-b8c1-dbc41eabf302 None None] PATH_INFO: `/` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:45:34.857785 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 693/1386] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jul 14 10:45:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 14 10:45:34.863473 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a8eda0-c3c2-4917-9ee6-b621ff111d1c None None] REQUEST_METHOD: `POST` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:45:34.863907 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a8eda0-c3c2-4917-9ee6-b621ff111d1c None None] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:45:34.864385 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a8eda0-c3c2-4917-9ee6-b621ff111d1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:45:34.947064 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.auth.core [None req-36a8eda0-c3c2-4917-9ee6-b621ff111d1c None None] MFA Rules not processed for user `ae4bcdd8106d4bebbdcae96be33505bc`. Rule list: `[]` (Enabled: `True`). {{(pid=86656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:45:34.948328 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-36a8eda0-c3c2-4917-9ee6-b621ff111d1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:45:34.983007 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=100 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:45:35.057210 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 694/1387] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jul 14 10:45:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:45:35.102414 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf88a6c-5622-46ee-b8c1-dbc41eabf302 None None] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:45:35.103964 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-ecf88a6c-5622-46ee-b8c1-dbc41eabf302 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:45:35.187314 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=100 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:45:35.257762 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf88a6c-5622-46ee-b8c1-dbc41eabf302 None None] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:45:35.384825 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edcc2d0-4f06-4f2b-999e-3b216f3469b2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26aa294c913c408499a913ec25bb677d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59391272ecbe48b0aa736cb43807be1d', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:45:35.385366 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edcc2d0-4f06-4f2b-999e-3b216f3469b2 service nova] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:45:35.385705 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edcc2d0-4f06-4f2b-999e-3b216f3469b2 service nova] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:45:35.385930 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edcc2d0-4f06-4f2b-999e-3b216f3469b2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:45:35.388111 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-8edcc2d0-4f06-4f2b-999e-3b216f3469b2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:45:35.427341 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=100 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:45:35.482103 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8edcc2d0-4f06-4f2b-999e-3b216f3469b2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:45:35.483735 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8edcc2d0-4f06-4f2b-999e-3b216f3469b2 service nova] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:45:35.502566 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 694/1388] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jul 14 10:45:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 10:45:37.571465 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb8db2b-d2b6-429d-84f8-f0384e26874d None None] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:45:37.571949 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb8db2b-d2b6-429d-84f8-f0384e26874d None None] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:45:37.572045 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb8db2b-d2b6-429d-84f8-f0384e26874d None None] PATH_INFO: `/` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:45:37.573594 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 695/1389] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jul 14 10:45:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:45:37.579385 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3bddee-c689-4719-b324-4b63e2078c36 None None] REQUEST_METHOD: `POST` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:45:37.579821 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3bddee-c689-4719-b324-4b63e2078c36 None None] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:45:37.579948 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3bddee-c689-4719-b324-4b63e2078c36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:45:37.646122 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.auth.core [None req-7c3bddee-c689-4719-b324-4b63e2078c36 None None] MFA Rules not processed for user `ae4bcdd8106d4bebbdcae96be33505bc`. Rule list: `[]` (Enabled: `True`). {{(pid=86655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:45:37.647325 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-7c3bddee-c689-4719-b324-4b63e2078c36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:45:37.743314 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 695/1390] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jul 14 10:45:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 10:45:37.788641 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb8db2b-d2b6-429d-84f8-f0384e26874d None None] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:45:37.790196 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-8cb8db2b-d2b6-429d-84f8-f0384e26874d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:45:37.934826 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb8db2b-d2b6-429d-84f8-f0384e26874d None None] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:45:37.951043 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=100 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:45:38.054404 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92345b65-1c01-47be-98ef-fb4362061afb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26aa294c913c408499a913ec25bb677d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59391272ecbe48b0aa736cb43807be1d', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:45:38.055052 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92345b65-1c01-47be-98ef-fb4362061afb service nova] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:45:38.055331 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92345b65-1c01-47be-98ef-fb4362061afb service nova] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:45:38.055605 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92345b65-1c01-47be-98ef-fb4362061afb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:45:38.057296 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-92345b65-1c01-47be-98ef-fb4362061afb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:45:38.145483 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92345b65-1c01-47be-98ef-fb4362061afb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:45:38.147106 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92345b65-1c01-47be-98ef-fb4362061afb service nova] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:45:38.166469 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 696/1391] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jul 14 10:45:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:45:39.344466 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe35486-644f-4cbd-84da-d59bc0e326b0 None None] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:45:39.345062 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe35486-644f-4cbd-84da-d59bc0e326b0 None None] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:45:39.345062 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe35486-644f-4cbd-84da-d59bc0e326b0 None None] PATH_INFO: `/` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:45:39.346460 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 696/1392] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jul 14 10:45:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:45:39.351692 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02891d7b-4810-4ead-928e-d4dcd131902c None None] REQUEST_METHOD: `POST` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:45:39.352098 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02891d7b-4810-4ead-928e-d4dcd131902c None None] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:45:39.352248 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02891d7b-4810-4ead-928e-d4dcd131902c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:45:39.378637 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=100 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:45:39.420847 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.auth.core [None req-02891d7b-4810-4ead-928e-d4dcd131902c None None] MFA Rules not processed for user `ae4bcdd8106d4bebbdcae96be33505bc`. Rule list: `[]` (Enabled: `True`). {{(pid=86656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:45:39.422060 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-02891d7b-4810-4ead-928e-d4dcd131902c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:45:39.518353 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 697/1393] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jul 14 10:45:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:45:39.574378 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1bc43d-81d7-42ed-8553-9d7f2eaa367a None None] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:45:39.574671 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1bc43d-81d7-42ed-8553-9d7f2eaa367a None None] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:45:39.575513 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1bc43d-81d7-42ed-8553-9d7f2eaa367a None None] PATH_INFO: `/` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:45:39.576903 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 697/1394] 10.222.0.16 () {54 vars in 962 bytes} [Thu Jul 14 10:45:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:45:39.581932 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2620f2-b3ab-420f-a066-f2a337838dea None None] REQUEST_METHOD: `POST` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:45:39.582230 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2620f2-b3ab-420f-a066-f2a337838dea None None] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:45:39.582510 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2620f2-b3ab-420f-a066-f2a337838dea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:45:39.656626 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.auth.core [None req-2d2620f2-b3ab-420f-a066-f2a337838dea None None] MFA Rules not processed for user `4cb877bf3f8241dcb2ecbb612c7f4f69`. Rule list: `[]` (Enabled: `True`). {{(pid=86656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:45:39.657870 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-2d2620f2-b3ab-420f-a066-f2a337838dea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:45:39.699158 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=100 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:45:39.737169 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 698/1395] 10.222.0.16 () {58 vars in 1059 bytes} [Thu Jul 14 10:45:39 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:45:39.744651 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1bc43d-81d7-42ed-8553-9d7f2eaa367a None None] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:45:39.746280 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-1d1bc43d-81d7-42ed-8553-9d7f2eaa367a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:45:39.759976 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=100 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:45:39.854336 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1bc43d-81d7-42ed-8553-9d7f2eaa367a None None] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:45:39.927460 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0afdbe3-d020-4d18-87c6-b73b9f387155 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cb877bf3f8241dcb2ecbb612c7f4f69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59391272ecbe48b0aa736cb43807be1d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:45:39.928298 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0afdbe3-d020-4d18-87c6-b73b9f387155 service glance] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:45:39.928587 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0afdbe3-d020-4d18-87c6-b73b9f387155 service glance] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:45:39.928905 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0afdbe3-d020-4d18-87c6-b73b9f387155 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:45:39.930645 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-f0afdbe3-d020-4d18-87c6-b73b9f387155 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:45:40.001324 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=100 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:45:40.044009 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0afdbe3-d020-4d18-87c6-b73b9f387155 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:45:40.045634 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0afdbe3-d020-4d18-87c6-b73b9f387155 service glance] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:45:40.065009 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 698/1396] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jul 14 10:45:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:45:40.233539 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e58832f-08be-4339-a912-4bd4a2d17234 None None] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:45:40.233817 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e58832f-08be-4339-a912-4bd4a2d17234 None None] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:45:40.234094 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e58832f-08be-4339-a912-4bd4a2d17234 None None] PATH_INFO: `/` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:45:40.235503 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 699/1397] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jul 14 10:45:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:45:40.240840 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a9255b-fa3b-4432-84d4-f4bfd9a4f6af None None] REQUEST_METHOD: `POST` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:45:40.241142 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a9255b-fa3b-4432-84d4-f4bfd9a4f6af None None] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:45:40.241420 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a9255b-fa3b-4432-84d4-f4bfd9a4f6af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:45:40.319653 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.auth.core [None req-90a9255b-fa3b-4432-84d4-f4bfd9a4f6af None None] MFA Rules not processed for user `ae4bcdd8106d4bebbdcae96be33505bc`. Rule list: `[]` (Enabled: `True`). {{(pid=86655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:45:40.320935 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-90a9255b-fa3b-4432-84d4-f4bfd9a4f6af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:45:40.428567 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 699/1398] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jul 14 10:45:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:45:40.474483 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e58832f-08be-4339-a912-4bd4a2d17234 None None] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:45:40.476082 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-7e58832f-08be-4339-a912-4bd4a2d17234 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:45:40.636751 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e58832f-08be-4339-a912-4bd4a2d17234 None None] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:45:40.692116 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=100 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:45:40.762554 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8d8e43-0b87-44b2-a514-cc7c87b2e5fd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26aa294c913c408499a913ec25bb677d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59391272ecbe48b0aa736cb43807be1d', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:45:40.763280 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8d8e43-0b87-44b2-a514-cc7c87b2e5fd service nova] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:45:40.763570 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8d8e43-0b87-44b2-a514-cc7c87b2e5fd service nova] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:45:40.763848 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8d8e43-0b87-44b2-a514-cc7c87b2e5fd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:45:40.765604 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-5a8d8e43-0b87-44b2-a514-cc7c87b2e5fd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:45:40.785533 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8554f34-7e3b-4811-84c9-650319883b10 None None] REQUEST_METHOD: `POST` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:45:40.785828 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8554f34-7e3b-4811-84c9-650319883b10 None None] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:45:40.786143 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8554f34-7e3b-4811-84c9-650319883b10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:45:40.815711 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=100 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:45:40.857879 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.auth.core [None req-f8554f34-7e3b-4811-84c9-650319883b10 None None] MFA Rules not processed for user `0dfc7cd9c05e4f268d2ce316d531c4bd`. Rule list: `[]` (Enabled: `True`). {{(pid=86655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:45:40.859181 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-f8554f34-7e3b-4811-84c9-650319883b10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:45:40.863140 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8d8e43-0b87-44b2-a514-cc7c87b2e5fd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:45:40.864801 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8d8e43-0b87-44b2-a514-cc7c87b2e5fd service nova] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:45:40.883035 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 700/1399] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jul 14 10:45:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:45:40.949381 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 700/1400] 10.222.0.16 () {58 vars in 1009 bytes} [Thu Jul 14 10:45:40 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 10:45:40.998099 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1781f15c-caeb-4b0e-9b5e-5dd328eece89 None None] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:45:40.998389 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1781f15c-caeb-4b0e-9b5e-5dd328eece89 None None] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:45:40.998669 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1781f15c-caeb-4b0e-9b5e-5dd328eece89 None None] PATH_INFO: `/` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:45:41.000190 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 701/1401] 10.222.0.16 () {54 vars in 942 bytes} [Thu Jul 14 10:45:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:45:41.007407 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd219ad2-67b0-4efe-bf4b-2d9be76e172d None None] REQUEST_METHOD: `POST` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:45:41.007727 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd219ad2-67b0-4efe-bf4b-2d9be76e172d None None] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:45:41.008017 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd219ad2-67b0-4efe-bf4b-2d9be76e172d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:45:41.094426 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.auth.core [None req-bd219ad2-67b0-4efe-bf4b-2d9be76e172d None None] MFA Rules not processed for user `8a23de49b80643eaab7a212f2884d62e`. Rule list: `[]` (Enabled: `True`). {{(pid=86655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:45:41.095663 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-bd219ad2-67b0-4efe-bf4b-2d9be76e172d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:45:41.150339 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=100 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:45:41.206433 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 701/1402] 10.222.0.16 () {58 vars in 1039 bytes} [Thu Jul 14 10:45:41 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:45:41.216378 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1781f15c-caeb-4b0e-9b5e-5dd328eece89 None None] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:45:41.217986 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-1781f15c-caeb-4b0e-9b5e-5dd328eece89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:45:41.287564 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=100 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:45:41.367822 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1781f15c-caeb-4b0e-9b5e-5dd328eece89 None None] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:45:41.472955 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3a30f1-0cfe-46e3-85b7-87b63db6eb0d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a23de49b80643eaab7a212f2884d62e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59391272ecbe48b0aa736cb43807be1d', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:45:41.473526 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3a30f1-0cfe-46e3-85b7-87b63db6eb0d service swift] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:45:41.473811 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3a30f1-0cfe-46e3-85b7-87b63db6eb0d service swift] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:45:41.474090 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3a30f1-0cfe-46e3-85b7-87b63db6eb0d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:45:41.475766 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-3e3a30f1-0cfe-46e3-85b7-87b63db6eb0d service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:45:41.513715 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=100 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:45:41.563582 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3a30f1-0cfe-46e3-85b7-87b63db6eb0d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:45:41.565259 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3a30f1-0cfe-46e3-85b7-87b63db6eb0d service swift] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:45:41.573438 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 702/1403] 10.222.0.16 () {60 vars in 1384 bytes} [Thu Jul 14 10:45:41 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 14 10:45:43.021331 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a82c531-7cd5-43f5-8394-46d735a63d03 None None] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:45:43.021926 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a82c531-7cd5-43f5-8394-46d735a63d03 None None] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:45:43.021926 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a82c531-7cd5-43f5-8394-46d735a63d03 None None] PATH_INFO: `/` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:45:43.023284 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 702/1404] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jul 14 10:45:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:45:43.028590 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059e6e30-3098-4382-8128-5b56e84d9ee6 None None] REQUEST_METHOD: `POST` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:45:43.029150 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059e6e30-3098-4382-8128-5b56e84d9ee6 None None] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:45:43.029150 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059e6e30-3098-4382-8128-5b56e84d9ee6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:45:43.113860 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.auth.core [None req-059e6e30-3098-4382-8128-5b56e84d9ee6 None None] MFA Rules not processed for user `ae4bcdd8106d4bebbdcae96be33505bc`. Rule list: `[]` (Enabled: `True`). {{(pid=86656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:45:43.115166 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-059e6e30-3098-4382-8128-5b56e84d9ee6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:45:43.221720 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 703/1405] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jul 14 10:45:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:45:43.266440 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a82c531-7cd5-43f5-8394-46d735a63d03 None None] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:45:43.268109 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-1a82c531-7cd5-43f5-8394-46d735a63d03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:45:43.426096 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a82c531-7cd5-43f5-8394-46d735a63d03 None None] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:45:43.456234 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=100 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:45:43.546691 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737dbb1c-c3ce-42e5-9f02-dbe1990627a2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26aa294c913c408499a913ec25bb677d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59391272ecbe48b0aa736cb43807be1d', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:45:43.547386 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737dbb1c-c3ce-42e5-9f02-dbe1990627a2 service nova] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:45:43.547673 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737dbb1c-c3ce-42e5-9f02-dbe1990627a2 service nova] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:45:43.547947 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737dbb1c-c3ce-42e5-9f02-dbe1990627a2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:45:43.549654 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-737dbb1c-c3ce-42e5-9f02-dbe1990627a2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:45:43.645931 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737dbb1c-c3ce-42e5-9f02-dbe1990627a2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:45:43.647827 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737dbb1c-c3ce-42e5-9f02-dbe1990627a2 service nova] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:45:43.670463 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 703/1406] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jul 14 10:45:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:45:45.834650 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cf3287-f23e-4de3-b3c3-9a1213a2cfd0 None None] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:45:45.835218 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cf3287-f23e-4de3-b3c3-9a1213a2cfd0 None None] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:45:45.835218 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cf3287-f23e-4de3-b3c3-9a1213a2cfd0 None None] PATH_INFO: `/` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:45:45.836582 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 704/1407] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jul 14 10:45:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:45:45.844023 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7861c4f5-89a2-4559-9a97-56782021f853 None None] REQUEST_METHOD: `POST` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:45:45.844556 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7861c4f5-89a2-4559-9a97-56782021f853 None None] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:45:45.844556 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7861c4f5-89a2-4559-9a97-56782021f853 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:45:45.890629 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=100 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:45:45.919660 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.auth.core [None req-7861c4f5-89a2-4559-9a97-56782021f853 None None] MFA Rules not processed for user `ae4bcdd8106d4bebbdcae96be33505bc`. Rule list: `[]` (Enabled: `True`). {{(pid=86655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:45:45.920915 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-7861c4f5-89a2-4559-9a97-56782021f853 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:45:46.032596 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 704/1408] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jul 14 10:45:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:45:46.077293 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cf3287-f23e-4de3-b3c3-9a1213a2cfd0 None None] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:45:46.079510 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-63cf3287-f23e-4de3-b3c3-9a1213a2cfd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:45:46.112686 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=100 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:45:46.241626 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cf3287-f23e-4de3-b3c3-9a1213a2cfd0 None None] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:45:46.361715 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=100 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:45:46.374568 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce92200-0cc9-43fc-bb55-0336818716a9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26aa294c913c408499a913ec25bb677d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59391272ecbe48b0aa736cb43807be1d', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:45:46.375230 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce92200-0cc9-43fc-bb55-0336818716a9 service nova] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:45:46.375520 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce92200-0cc9-43fc-bb55-0336818716a9 service nova] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:45:46.375802 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce92200-0cc9-43fc-bb55-0336818716a9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:45:46.377533 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-0ce92200-0cc9-43fc-bb55-0336818716a9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:45:46.478022 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce92200-0cc9-43fc-bb55-0336818716a9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:45:46.481894 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce92200-0cc9-43fc-bb55-0336818716a9 service nova] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:45:46.502041 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 705/1409] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jul 14 10:45:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 425 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:45:56.030675 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=51 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:45:56.499445 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=49 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:46:03.714964 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993d12d4-6a47-44c6-8dc3-9f452f06519f None None] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:46:03.715540 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993d12d4-6a47-44c6-8dc3-9f452f06519f None None] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:46:03.715656 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993d12d4-6a47-44c6-8dc3-9f452f06519f None None] PATH_INFO: `/` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:46:03.717038 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 705/1410] 10.222.0.16 () {54 vars in 918 bytes} [Thu Jul 14 10:46:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:46:03.722192 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8e8787-5172-4d56-8a8b-bf1600acf10b None None] REQUEST_METHOD: `POST` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:46:03.722659 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8e8787-5172-4d56-8a8b-bf1600acf10b None None] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:46:03.722764 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8e8787-5172-4d56-8a8b-bf1600acf10b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:46:03.798525 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.auth.core [None req-9e8e8787-5172-4d56-8a8b-bf1600acf10b None None] MFA Rules not processed for user `16846111ee2a42dd99c3052d40980f72`. Rule list: `[]` (Enabled: `True`). {{(pid=86656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:46:03.800407 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-9e8e8787-5172-4d56-8a8b-bf1600acf10b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:46:03.905198 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 706/1411] 10.222.0.16 () {58 vars in 1015 bytes} [Thu Jul 14 10:46:03 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:46:03.919687 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7489beae-507c-4db1-9544-19edd8e71aef None None] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:46:03.919919 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7489beae-507c-4db1-9544-19edd8e71aef None None] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:46:03.920197 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7489beae-507c-4db1-9544-19edd8e71aef None None] PATH_INFO: `/` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:46:03.921602 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 706/1412] 10.222.0.16 () {54 vars in 918 bytes} [Thu Jul 14 10:46:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:46:03.926036 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f0cc81-2e34-4953-8654-01efd9e6662d None None] REQUEST_METHOD: `POST` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:46:03.926331 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f0cc81-2e34-4953-8654-01efd9e6662d None None] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:46:03.926609 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f0cc81-2e34-4953-8654-01efd9e6662d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:46:03.997055 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=100 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:46:03.999890 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.auth.core [None req-19f0cc81-2e34-4953-8654-01efd9e6662d None None] MFA Rules not processed for user `26aa294c913c408499a913ec25bb677d`. Rule list: `[]` (Enabled: `True`). {{(pid=86656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:46:04.001714 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-19f0cc81-2e34-4953-8654-01efd9e6662d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:46:04.117154 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 707/1413] 10.222.0.16 () {58 vars in 1015 bytes} [Thu Jul 14 10:46:03 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:46:06.589392 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342064c7-0909-4d17-ae99-44f3963d7831 None None] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:46:06.590459 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342064c7-0909-4d17-ae99-44f3963d7831 None None] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:46:06.590459 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342064c7-0909-4d17-ae99-44f3963d7831 None None] PATH_INFO: `/` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:46:06.591821 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 707/1414] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 14 10:46:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:46:06.597110 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a15641a-a4c4-4142-934f-f655860354b5 None None] REQUEST_METHOD: `POST` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:46:06.597533 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a15641a-a4c4-4142-934f-f655860354b5 None None] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:46:06.597672 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a15641a-a4c4-4142-934f-f655860354b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:46:06.661202 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.auth.core [None req-4a15641a-a4c4-4142-934f-f655860354b5 None None] MFA Rules not processed for user `ae4bcdd8106d4bebbdcae96be33505bc`. Rule list: `[]` (Enabled: `True`). {{(pid=86656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:46:06.662393 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-4a15641a-a4c4-4142-934f-f655860354b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:46:06.716111 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=100 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:46:06.757342 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 708/1415] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 14 10:46:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 10:46:06.800901 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342064c7-0909-4d17-ae99-44f3963d7831 None None] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:46:06.802446 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-342064c7-0909-4d17-ae99-44f3963d7831 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:46:06.945408 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342064c7-0909-4d17-ae99-44f3963d7831 None None] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:46:07.017277 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=100 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:46:07.057180 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11f7b2b-fb23-43f4-bc92-7f6603373231 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26aa294c913c408499a913ec25bb677d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59391272ecbe48b0aa736cb43807be1d', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:46:07.057828 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11f7b2b-fb23-43f4-bc92-7f6603373231 service nova] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:46:07.058112 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11f7b2b-fb23-43f4-bc92-7f6603373231 service nova] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:46:07.058389 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11f7b2b-fb23-43f4-bc92-7f6603373231 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:46:07.060057 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-f11f7b2b-fb23-43f4-bc92-7f6603373231 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:46:07.147250 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11f7b2b-fb23-43f4-bc92-7f6603373231 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:46:07.148865 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11f7b2b-fb23-43f4-bc92-7f6603373231 service nova] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:46:07.167194 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 708/1416] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jul 14 10:46:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:46:08.071905 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df95505-62be-492f-8788-d880e331822e None None] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:46:08.072488 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df95505-62be-492f-8788-d880e331822e None None] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:46:08.072488 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df95505-62be-492f-8788-d880e331822e None None] PATH_INFO: `/` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:46:08.073873 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 709/1417] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 14 10:46:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:46:08.078932 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525ef199-b667-4d93-a421-3feb641e28a7 None None] REQUEST_METHOD: `POST` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:46:08.079392 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525ef199-b667-4d93-a421-3feb641e28a7 None None] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:46:08.079501 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525ef199-b667-4d93-a421-3feb641e28a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:46:08.155307 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.auth.core [None req-525ef199-b667-4d93-a421-3feb641e28a7 None None] MFA Rules not processed for user `ae4bcdd8106d4bebbdcae96be33505bc`. Rule list: `[]` (Enabled: `True`). {{(pid=86655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:46:08.156567 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-525ef199-b667-4d93-a421-3feb641e28a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:46:08.188008 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=100 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:46:08.257039 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 709/1418] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 14 10:46:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:46:08.409073 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df95505-62be-492f-8788-d880e331822e None None] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:46:08.410560 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-4df95505-62be-492f-8788-d880e331822e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:46:08.559870 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df95505-62be-492f-8788-d880e331822e None None] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:46:08.600524 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=100 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:46:08.672632 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2712939c-30c0-4f7a-8692-9e6f5fcd2102 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26aa294c913c408499a913ec25bb677d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59391272ecbe48b0aa736cb43807be1d', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:46:08.673217 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2712939c-30c0-4f7a-8692-9e6f5fcd2102 service nova] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:46:08.673505 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2712939c-30c0-4f7a-8692-9e6f5fcd2102 service nova] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:46:08.673778 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2712939c-30c0-4f7a-8692-9e6f5fcd2102 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:46:08.675428 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-2712939c-30c0-4f7a-8692-9e6f5fcd2102 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:46:08.764389 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2712939c-30c0-4f7a-8692-9e6f5fcd2102 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:46:08.766025 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2712939c-30c0-4f7a-8692-9e6f5fcd2102 service nova] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:46:08.783983 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 710/1419] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jul 14 10:46:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:46:09.670315 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa78be8-f8d7-4627-a0a8-6028d48ce534 None None] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:46:09.670719 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa78be8-f8d7-4627-a0a8-6028d48ce534 None None] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:46:09.670926 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa78be8-f8d7-4627-a0a8-6028d48ce534 None None] PATH_INFO: `/` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:46:09.672273 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 710/1420] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 14 10:46:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:46:09.677387 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405744c2-f8a8-4c31-8614-3de63302db0e None None] REQUEST_METHOD: `POST` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:46:09.677819 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405744c2-f8a8-4c31-8614-3de63302db0e None None] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:46:09.677953 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405744c2-f8a8-4c31-8614-3de63302db0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:46:09.730741 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=100 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:46:09.752488 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.auth.core [None req-405744c2-f8a8-4c31-8614-3de63302db0e None None] MFA Rules not processed for user `ae4bcdd8106d4bebbdcae96be33505bc`. Rule list: `[]` (Enabled: `True`). {{(pid=86656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:46:09.753732 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-405744c2-f8a8-4c31-8614-3de63302db0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:46:09.858926 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 711/1421] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 14 10:46:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:46:10.010718 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa78be8-f8d7-4627-a0a8-6028d48ce534 None None] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:46:10.013192 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-2fa78be8-f8d7-4627-a0a8-6028d48ce534 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:46:10.163116 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa78be8-f8d7-4627-a0a8-6028d48ce534 None None] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:46:10.175919 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=100 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:46:10.278756 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07346098-2b6c-4f2a-82d1-09ee6325cb41 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26aa294c913c408499a913ec25bb677d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59391272ecbe48b0aa736cb43807be1d', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:46:10.279330 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07346098-2b6c-4f2a-82d1-09ee6325cb41 service nova] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:46:10.279620 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07346098-2b6c-4f2a-82d1-09ee6325cb41 service nova] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:46:10.279904 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07346098-2b6c-4f2a-82d1-09ee6325cb41 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:46:10.281632 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-07346098-2b6c-4f2a-82d1-09ee6325cb41 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:46:10.374388 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07346098-2b6c-4f2a-82d1-09ee6325cb41 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:46:10.376019 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07346098-2b6c-4f2a-82d1-09ee6325cb41 service nova] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:46:10.394581 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 711/1422] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jul 14 10:46:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 10:46:11.261506 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc97a93-cdba-4b4c-995b-59a335f64ff3 None None] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:46:11.262078 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc97a93-cdba-4b4c-995b-59a335f64ff3 None None] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:46:11.262078 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc97a93-cdba-4b4c-995b-59a335f64ff3 None None] PATH_INFO: `/` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:46:11.263476 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 712/1423] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 14 10:46:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:46:11.269256 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17eaddf4-0a5e-4602-b7ad-f895f0d69fa3 None None] REQUEST_METHOD: `POST` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:46:11.269722 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17eaddf4-0a5e-4602-b7ad-f895f0d69fa3 None None] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:46:11.269851 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17eaddf4-0a5e-4602-b7ad-f895f0d69fa3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:46:11.288896 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=100 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:46:11.346208 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.auth.core [None req-17eaddf4-0a5e-4602-b7ad-f895f0d69fa3 None None] MFA Rules not processed for user `ae4bcdd8106d4bebbdcae96be33505bc`. Rule list: `[]` (Enabled: `True`). {{(pid=86655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:46:11.347440 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-17eaddf4-0a5e-4602-b7ad-f895f0d69fa3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:46:11.443834 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 712/1424] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 14 10:46:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:46:11.595999 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc97a93-cdba-4b4c-995b-59a335f64ff3 None None] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:46:11.597605 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-6cc97a93-cdba-4b4c-995b-59a335f64ff3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:46:11.708010 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=100 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:46:11.744416 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc97a93-cdba-4b4c-995b-59a335f64ff3 None None] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:46:11.856669 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effbb18b-3e9c-4106-976f-70d4b3e1fdc0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26aa294c913c408499a913ec25bb677d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59391272ecbe48b0aa736cb43807be1d', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:46:11.857269 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effbb18b-3e9c-4106-976f-70d4b3e1fdc0 service nova] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:46:11.857562 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effbb18b-3e9c-4106-976f-70d4b3e1fdc0 service nova] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:46:11.857839 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effbb18b-3e9c-4106-976f-70d4b3e1fdc0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:46:11.859576 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-effbb18b-3e9c-4106-976f-70d4b3e1fdc0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:46:11.936157 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=100 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:46:11.949883 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-effbb18b-3e9c-4106-976f-70d4b3e1fdc0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:46:11.951648 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-effbb18b-3e9c-4106-976f-70d4b3e1fdc0 service nova] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:46:11.970049 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 713/1425] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jul 14 10:46:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:46:12.838762 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad7bcff-f8e2-446d-9cda-0b6faf8fb25f None None] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:46:12.839273 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad7bcff-f8e2-446d-9cda-0b6faf8fb25f None None] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:46:12.839402 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad7bcff-f8e2-446d-9cda-0b6faf8fb25f None None] PATH_INFO: `/` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:46:12.841395 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 713/1426] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 14 10:46:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:46:12.846225 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535963c8-baea-4ad0-8464-0714fbfdca10 None None] REQUEST_METHOD: `POST` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:46:12.846662 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535963c8-baea-4ad0-8464-0714fbfdca10 None None] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:46:12.846769 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535963c8-baea-4ad0-8464-0714fbfdca10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:46:12.920027 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.auth.core [None req-535963c8-baea-4ad0-8464-0714fbfdca10 None None] MFA Rules not processed for user `ae4bcdd8106d4bebbdcae96be33505bc`. Rule list: `[]` (Enabled: `True`). {{(pid=86656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:46:12.921281 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-535963c8-baea-4ad0-8464-0714fbfdca10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:46:13.017897 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 714/1427] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 14 10:46:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:46:13.169706 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad7bcff-f8e2-446d-9cda-0b6faf8fb25f None None] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:46:13.171249 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-7ad7bcff-f8e2-446d-9cda-0b6faf8fb25f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:46:13.261618 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=100 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:46:13.326851 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad7bcff-f8e2-446d-9cda-0b6faf8fb25f None None] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:46:13.440659 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a237585-bb50-48f4-961b-f7881de3d068 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26aa294c913c408499a913ec25bb677d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59391272ecbe48b0aa736cb43807be1d', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:46:13.441274 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a237585-bb50-48f4-961b-f7881de3d068 service nova] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:46:13.441560 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a237585-bb50-48f4-961b-f7881de3d068 service nova] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:46:13.441836 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a237585-bb50-48f4-961b-f7881de3d068 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:46:13.443502 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-1a237585-bb50-48f4-961b-f7881de3d068 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:46:13.493135 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=100 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:46:13.534417 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a237585-bb50-48f4-961b-f7881de3d068 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:46:13.536015 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a237585-bb50-48f4-961b-f7881de3d068 service nova] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:46:13.555526 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 714/1428] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jul 14 10:46:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:46:14.364430 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2562ed60-998c-4faf-a72a-b1ff72169c53 None None] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:46:14.365056 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2562ed60-998c-4faf-a72a-b1ff72169c53 None None] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:46:14.365056 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2562ed60-998c-4faf-a72a-b1ff72169c53 None None] PATH_INFO: `/` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:46:14.366399 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 715/1429] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 14 10:46:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:46:14.371195 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488b1587-9c28-47b0-8c06-d1986c790384 None None] REQUEST_METHOD: `POST` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:46:14.371673 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488b1587-9c28-47b0-8c06-d1986c790384 None None] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:46:14.372334 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488b1587-9c28-47b0-8c06-d1986c790384 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:46:14.445989 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.auth.core [None req-488b1587-9c28-47b0-8c06-d1986c790384 None None] MFA Rules not processed for user `ae4bcdd8106d4bebbdcae96be33505bc`. Rule list: `[]` (Enabled: `True`). {{(pid=86655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:46:14.447201 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-488b1587-9c28-47b0-8c06-d1986c790384 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:46:14.540718 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 715/1430] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 14 10:46:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:46:14.691748 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2562ed60-998c-4faf-a72a-b1ff72169c53 None None] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:46:14.693278 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-2562ed60-998c-4faf-a72a-b1ff72169c53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:46:14.744139 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=100 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:46:14.849925 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2562ed60-998c-4faf-a72a-b1ff72169c53 None None] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:46:14.963266 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468d4442-8783-4ddc-93bd-01bc84728049 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26aa294c913c408499a913ec25bb677d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59391272ecbe48b0aa736cb43807be1d', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:46:14.963837 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468d4442-8783-4ddc-93bd-01bc84728049 service nova] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:46:14.964124 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468d4442-8783-4ddc-93bd-01bc84728049 service nova] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:46:14.964402 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468d4442-8783-4ddc-93bd-01bc84728049 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:46:14.966759 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-468d4442-8783-4ddc-93bd-01bc84728049 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:46:14.973557 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=100 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:46:15.056869 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468d4442-8783-4ddc-93bd-01bc84728049 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:46:15.058454 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468d4442-8783-4ddc-93bd-01bc84728049 service nova] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:46:15.076607 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 716/1431] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jul 14 10:46:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:46:15.879556 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b747f4-fee2-47a5-adc8-a1d43aeb1b02 None None] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:46:15.880063 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b747f4-fee2-47a5-adc8-a1d43aeb1b02 None None] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:46:15.880063 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b747f4-fee2-47a5-adc8-a1d43aeb1b02 None None] PATH_INFO: `/` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:46:15.881435 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 716/1432] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 14 10:46:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:46:15.886403 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0944f7c-65cf-4dce-aa47-7dbff032d4b7 None None] REQUEST_METHOD: `POST` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:46:15.886855 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0944f7c-65cf-4dce-aa47-7dbff032d4b7 None None] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:46:15.886956 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0944f7c-65cf-4dce-aa47-7dbff032d4b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:46:15.960173 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.auth.core [None req-e0944f7c-65cf-4dce-aa47-7dbff032d4b7 None None] MFA Rules not processed for user `ae4bcdd8106d4bebbdcae96be33505bc`. Rule list: `[]` (Enabled: `True`). {{(pid=86656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:46:15.961397 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-e0944f7c-65cf-4dce-aa47-7dbff032d4b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:46:16.028385 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=100 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:46:16.057995 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 717/1433] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 14 10:46:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 10:46:16.211303 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b747f4-fee2-47a5-adc8-a1d43aeb1b02 None None] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:46:16.212766 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-07b747f4-fee2-47a5-adc8-a1d43aeb1b02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:46:16.230646 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=100 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:46:16.361885 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b747f4-fee2-47a5-adc8-a1d43aeb1b02 None None] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:46:16.449654 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=100 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:46:16.476041 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ddafb3-dba8-4c71-aa91-3a3840dd909a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26aa294c913c408499a913ec25bb677d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59391272ecbe48b0aa736cb43807be1d', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:46:16.476803 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ddafb3-dba8-4c71-aa91-3a3840dd909a service nova] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:46:16.477102 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ddafb3-dba8-4c71-aa91-3a3840dd909a service nova] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:46:16.477384 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ddafb3-dba8-4c71-aa91-3a3840dd909a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:46:16.479044 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-79ddafb3-dba8-4c71-aa91-3a3840dd909a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:46:16.567218 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ddafb3-dba8-4c71-aa91-3a3840dd909a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:46:16.568856 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ddafb3-dba8-4c71-aa91-3a3840dd909a service nova] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:46:16.587289 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 717/1434] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jul 14 10:46:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:46:17.388743 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a551807-7e90-4e0d-9533-9a219cf6caf9 None None] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:46:17.389361 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a551807-7e90-4e0d-9533-9a219cf6caf9 None None] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:46:17.389361 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a551807-7e90-4e0d-9533-9a219cf6caf9 None None] PATH_INFO: `/` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:46:17.390696 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 718/1435] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 14 10:46:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:46:17.395458 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce53a6f-56a1-4d16-bca2-61f8f982d90e None None] REQUEST_METHOD: `POST` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:46:17.395855 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce53a6f-56a1-4d16-bca2-61f8f982d90e None None] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:46:17.396014 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce53a6f-56a1-4d16-bca2-61f8f982d90e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:46:17.471845 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.auth.core [None req-6ce53a6f-56a1-4d16-bca2-61f8f982d90e None None] MFA Rules not processed for user `ae4bcdd8106d4bebbdcae96be33505bc`. Rule list: `[]` (Enabled: `True`). {{(pid=86655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:46:17.473106 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-6ce53a6f-56a1-4d16-bca2-61f8f982d90e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:46:17.514804 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=100 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:46:17.572210 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 718/1436] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 14 10:46:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:46:17.727627 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a551807-7e90-4e0d-9533-9a219cf6caf9 None None] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:46:17.729190 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-9a551807-7e90-4e0d-9533-9a219cf6caf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:46:17.875171 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a551807-7e90-4e0d-9533-9a219cf6caf9 None None] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:46:17.929854 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=100 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:46:17.990393 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b23f694-1963-40a2-8dbb-c4dde4bbddce service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26aa294c913c408499a913ec25bb677d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59391272ecbe48b0aa736cb43807be1d', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:46:17.991046 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b23f694-1963-40a2-8dbb-c4dde4bbddce service nova] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:46:17.991337 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b23f694-1963-40a2-8dbb-c4dde4bbddce service nova] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:46:17.991619 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b23f694-1963-40a2-8dbb-c4dde4bbddce service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:46:17.993310 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-6b23f694-1963-40a2-8dbb-c4dde4bbddce service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:46:18.084918 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b23f694-1963-40a2-8dbb-c4dde4bbddce service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:46:18.086516 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b23f694-1963-40a2-8dbb-c4dde4bbddce service nova] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:46:18.105755 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 719/1437] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jul 14 10:46:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:46:18.904834 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d3af6d-f998-42d1-a927-6b11c267bfb2 None None] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:46:18.905396 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d3af6d-f998-42d1-a927-6b11c267bfb2 None None] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:46:18.905396 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d3af6d-f998-42d1-a927-6b11c267bfb2 None None] PATH_INFO: `/` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:46:18.906770 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 719/1438] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 14 10:46:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:46:18.911592 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98e161d-c50e-4eb6-91c1-8b0464c2592f None None] REQUEST_METHOD: `POST` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:46:18.912044 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98e161d-c50e-4eb6-91c1-8b0464c2592f None None] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:46:18.912147 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98e161d-c50e-4eb6-91c1-8b0464c2592f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:46:18.985918 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.auth.core [None req-b98e161d-c50e-4eb6-91c1-8b0464c2592f None None] MFA Rules not processed for user `ae4bcdd8106d4bebbdcae96be33505bc`. Rule list: `[]` (Enabled: `True`). {{(pid=86656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:46:18.987054 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-b98e161d-c50e-4eb6-91c1-8b0464c2592f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:46:18.989039 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=100 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:46:19.081917 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 720/1439] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 14 10:46:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:46:19.233004 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d3af6d-f998-42d1-a927-6b11c267bfb2 None None] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:46:19.234558 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-f3d3af6d-f998-42d1-a927-6b11c267bfb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:46:19.381136 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d3af6d-f998-42d1-a927-6b11c267bfb2 None None] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:46:19.408374 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=100 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:46:19.494755 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4113349-0e1a-4833-9ab4-c4965183248e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26aa294c913c408499a913ec25bb677d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59391272ecbe48b0aa736cb43807be1d', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:46:19.495408 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4113349-0e1a-4833-9ab4-c4965183248e service nova] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:46:19.495690 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4113349-0e1a-4833-9ab4-c4965183248e service nova] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:46:19.495970 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4113349-0e1a-4833-9ab4-c4965183248e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:46:19.498380 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-f4113349-0e1a-4833-9ab4-c4965183248e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:46:19.586739 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4113349-0e1a-4833-9ab4-c4965183248e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:46:19.588344 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4113349-0e1a-4833-9ab4-c4965183248e service nova] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:46:19.606871 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 720/1440] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jul 14 10:46:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:46:21.637281 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1d85e0-c39d-486f-8646-ca765e71a53f None None] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:46:21.638479 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1d85e0-c39d-486f-8646-ca765e71a53f None None] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:46:21.638827 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1d85e0-c39d-486f-8646-ca765e71a53f None None] PATH_INFO: `/` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:46:21.640228 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 721/1441] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 14 10:46:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:46:21.645508 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5150bf15-4fb8-45ee-91f5-f700e6b7e700 None None] REQUEST_METHOD: `POST` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:46:21.645932 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5150bf15-4fb8-45ee-91f5-f700e6b7e700 None None] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:46:21.646067 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5150bf15-4fb8-45ee-91f5-f700e6b7e700 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:46:21.685332 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=100 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:46:21.711097 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.auth.core [None req-5150bf15-4fb8-45ee-91f5-f700e6b7e700 None None] MFA Rules not processed for user `ae4bcdd8106d4bebbdcae96be33505bc`. Rule list: `[]` (Enabled: `True`). {{(pid=86655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:46:21.712295 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-5150bf15-4fb8-45ee-91f5-f700e6b7e700 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:46:21.810499 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 721/1442] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 14 10:46:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 10:46:21.847789 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1d85e0-c39d-486f-8646-ca765e71a53f None None] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:46:21.849365 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-ad1d85e0-c39d-486f-8646-ca765e71a53f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:46:21.958461 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1d85e0-c39d-486f-8646-ca765e71a53f None None] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:46:21.990390 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=100 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:46:22.033970 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26a060b-365d-4ac7-9722-3e94b3772a0f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dddf93691844886982c91fea974385d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59391272ecbe48b0aa736cb43807be1d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:46:22.034629 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26a060b-365d-4ac7-9722-3e94b3772a0f service neutron] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:46:22.034919 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26a060b-365d-4ac7-9722-3e94b3772a0f service neutron] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:46:22.035202 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26a060b-365d-4ac7-9722-3e94b3772a0f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:46:22.036903 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-a26a060b-365d-4ac7-9722-3e94b3772a0f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:46:22.145362 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26a060b-365d-4ac7-9722-3e94b3772a0f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:46:22.146724 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26a060b-365d-4ac7-9722-3e94b3772a0f service neutron] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:46:22.165899 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 722/1443] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jul 14 10:46:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:46:24.327995 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec51420-efb2-4aa0-b6c4-10248278e128 None None] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:46:24.328567 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec51420-efb2-4aa0-b6c4-10248278e128 None None] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:46:24.328567 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec51420-efb2-4aa0-b6c4-10248278e128 None None] PATH_INFO: `/` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:46:24.329964 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 722/1444] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 14 10:46:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:46:24.335215 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b45188b-60e2-4593-8a87-1dcc2ff9f9d5 None None] REQUEST_METHOD: `POST` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:46:24.335627 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b45188b-60e2-4593-8a87-1dcc2ff9f9d5 None None] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:46:24.335769 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b45188b-60e2-4593-8a87-1dcc2ff9f9d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:46:24.398581 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.auth.core [None req-9b45188b-60e2-4593-8a87-1dcc2ff9f9d5 None None] MFA Rules not processed for user `ae4bcdd8106d4bebbdcae96be33505bc`. Rule list: `[]` (Enabled: `True`). {{(pid=86656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:46:24.399783 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-9b45188b-60e2-4593-8a87-1dcc2ff9f9d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:46:24.413048 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=100 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:46:24.496370 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 723/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 14 10:46:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:46:24.535845 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec51420-efb2-4aa0-b6c4-10248278e128 None None] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:46:24.537422 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-0ec51420-efb2-4aa0-b6c4-10248278e128 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:46:24.640896 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec51420-efb2-4aa0-b6c4-10248278e128 None None] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:46:24.652559 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=100 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:46:24.712953 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6581c39b-29dc-4c15-b217-0dea572395b1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dddf93691844886982c91fea974385d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59391272ecbe48b0aa736cb43807be1d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:46:24.713609 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6581c39b-29dc-4c15-b217-0dea572395b1 service neutron] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:46:24.713889 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6581c39b-29dc-4c15-b217-0dea572395b1 service neutron] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:46:24.714162 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6581c39b-29dc-4c15-b217-0dea572395b1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:46:24.715849 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-6581c39b-29dc-4c15-b217-0dea572395b1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:46:24.829800 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6581c39b-29dc-4c15-b217-0dea572395b1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:46:24.831236 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6581c39b-29dc-4c15-b217-0dea572395b1 service neutron] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:46:24.849416 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 723/1446] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jul 14 10:46:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:46:27.250668 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362c9c70-38b6-47f2-b6ea-570477fc845d None None] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:46:27.251230 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362c9c70-38b6-47f2-b6ea-570477fc845d None None] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:46:27.251230 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362c9c70-38b6-47f2-b6ea-570477fc845d None None] PATH_INFO: `/` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:46:27.252630 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 724/1447] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 14 10:46:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:46:27.257935 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf9b3ec-321e-448d-9ec5-adaf0ea92b7e None None] REQUEST_METHOD: `POST` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:46:27.258334 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf9b3ec-321e-448d-9ec5-adaf0ea92b7e None None] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:46:27.258520 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf9b3ec-321e-448d-9ec5-adaf0ea92b7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:46:27.306140 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=100 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:46:27.324238 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.auth.core [None req-eaf9b3ec-321e-448d-9ec5-adaf0ea92b7e None None] MFA Rules not processed for user `ae4bcdd8106d4bebbdcae96be33505bc`. Rule list: `[]` (Enabled: `True`). {{(pid=86655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:46:27.325592 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-eaf9b3ec-321e-448d-9ec5-adaf0ea92b7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:46:27.421266 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 724/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 14 10:46:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:46:27.459549 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362c9c70-38b6-47f2-b6ea-570477fc845d None None] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:46:27.461179 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-362c9c70-38b6-47f2-b6ea-570477fc845d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:46:27.569968 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362c9c70-38b6-47f2-b6ea-570477fc845d None None] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:46:27.610141 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=100 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:46:27.644849 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc0b741-4a24-481b-8ecb-091039cfa743 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dddf93691844886982c91fea974385d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59391272ecbe48b0aa736cb43807be1d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:46:27.645493 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc0b741-4a24-481b-8ecb-091039cfa743 service neutron] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:46:27.645775 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc0b741-4a24-481b-8ecb-091039cfa743 service neutron] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:46:27.646051 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc0b741-4a24-481b-8ecb-091039cfa743 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:46:27.647695 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-4dc0b741-4a24-481b-8ecb-091039cfa743 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:46:27.754827 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc0b741-4a24-481b-8ecb-091039cfa743 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:46:27.756297 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc0b741-4a24-481b-8ecb-091039cfa743 service neutron] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:46:27.775196 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 725/1449] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jul 14 10:46:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:46:29.895954 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5355693-9bef-4a01-8d25-578bb9e6d3a5 None None] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:46:29.896483 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5355693-9bef-4a01-8d25-578bb9e6d3a5 None None] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:46:29.896673 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5355693-9bef-4a01-8d25-578bb9e6d3a5 None None] PATH_INFO: `/` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:46:29.898175 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 725/1450] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 14 10:46:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:46:29.903999 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553b546a-24ca-486f-8d7a-b626019eec83 None None] REQUEST_METHOD: `POST` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:46:29.904628 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553b546a-24ca-486f-8d7a-b626019eec83 None None] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:46:29.904628 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553b546a-24ca-486f-8d7a-b626019eec83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:46:29.969244 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.auth.core [None req-553b546a-24ca-486f-8d7a-b626019eec83 None None] MFA Rules not processed for user `ae4bcdd8106d4bebbdcae96be33505bc`. Rule list: `[]` (Enabled: `True`). {{(pid=86656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:46:29.970391 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-553b546a-24ca-486f-8d7a-b626019eec83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:46:29.990415 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=100 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:46:30.066593 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 726/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 14 10:46:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:46:30.104646 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5355693-9bef-4a01-8d25-578bb9e6d3a5 None None] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:46:30.106249 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-f5355693-9bef-4a01-8d25-578bb9e6d3a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:46:30.209733 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5355693-9bef-4a01-8d25-578bb9e6d3a5 None None] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:46:30.230892 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=100 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:46:30.283979 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac05e41-cc24-4ca2-b93d-481e11779a16 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dddf93691844886982c91fea974385d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59391272ecbe48b0aa736cb43807be1d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:46:30.284629 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac05e41-cc24-4ca2-b93d-481e11779a16 service neutron] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:46:30.284946 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac05e41-cc24-4ca2-b93d-481e11779a16 service neutron] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:46:30.285228 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac05e41-cc24-4ca2-b93d-481e11779a16 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:46:30.286884 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-bac05e41-cc24-4ca2-b93d-481e11779a16 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:46:30.396015 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac05e41-cc24-4ca2-b93d-481e11779a16 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:46:30.397501 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac05e41-cc24-4ca2-b93d-481e11779a16 service neutron] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:46:30.415303 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 726/1452] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jul 14 10:46:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:46:32.503142 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e77e1e3-d4e1-489f-8cce-f810b8544070 None None] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:46:32.503683 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e77e1e3-d4e1-489f-8cce-f810b8544070 None None] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:46:32.503683 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e77e1e3-d4e1-489f-8cce-f810b8544070 None None] PATH_INFO: `/` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:46:32.505110 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 727/1453] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 14 10:46:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:46:32.510216 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81789876-811f-4517-9124-9f20cbe33b9b None None] REQUEST_METHOD: `POST` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:46:32.510617 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81789876-811f-4517-9124-9f20cbe33b9b None None] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:46:32.510790 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81789876-811f-4517-9124-9f20cbe33b9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:46:32.573069 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=100 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:46:32.576275 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.auth.core [None req-81789876-811f-4517-9124-9f20cbe33b9b None None] MFA Rules not processed for user `ae4bcdd8106d4bebbdcae96be33505bc`. Rule list: `[]` (Enabled: `True`). {{(pid=86655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:46:32.578098 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-81789876-811f-4517-9124-9f20cbe33b9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:46:32.673741 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 727/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 14 10:46:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:46:32.711789 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e77e1e3-d4e1-489f-8cce-f810b8544070 None None] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:46:32.713346 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-0e77e1e3-d4e1-489f-8cce-f810b8544070 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:46:32.816955 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e77e1e3-d4e1-489f-8cce-f810b8544070 None None] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:46:32.864504 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=100 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:46:32.890949 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e07daf3-e9e1-4c89-8b30-48ec29bbfca0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dddf93691844886982c91fea974385d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59391272ecbe48b0aa736cb43807be1d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:46:32.891601 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e07daf3-e9e1-4c89-8b30-48ec29bbfca0 service neutron] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:46:32.891886 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e07daf3-e9e1-4c89-8b30-48ec29bbfca0 service neutron] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:46:32.892166 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e07daf3-e9e1-4c89-8b30-48ec29bbfca0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:46:32.893862 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-7e07daf3-e9e1-4c89-8b30-48ec29bbfca0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:46:33.000688 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e07daf3-e9e1-4c89-8b30-48ec29bbfca0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:46:33.002163 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e07daf3-e9e1-4c89-8b30-48ec29bbfca0 service neutron] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:46:33.020920 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 728/1455] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jul 14 10:46:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:46:35.095451 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8521f5-5c64-4484-bffa-79797b7426d0 None None] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:46:35.096007 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8521f5-5c64-4484-bffa-79797b7426d0 None None] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:46:35.096198 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8521f5-5c64-4484-bffa-79797b7426d0 None None] PATH_INFO: `/` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:46:35.097728 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 728/1456] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 14 10:46:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:46:35.103151 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a37452-71bd-4707-bd87-539605ceff55 None None] REQUEST_METHOD: `POST` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:46:35.103609 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a37452-71bd-4707-bd87-539605ceff55 None None] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:46:35.103706 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a37452-71bd-4707-bd87-539605ceff55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:46:35.168822 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.auth.core [None req-82a37452-71bd-4707-bd87-539605ceff55 None None] MFA Rules not processed for user `ae4bcdd8106d4bebbdcae96be33505bc`. Rule list: `[]` (Enabled: `True`). {{(pid=86656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:46:35.170077 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-82a37452-71bd-4707-bd87-539605ceff55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:46:35.199296 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=100 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:46:35.266759 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 729/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 14 10:46:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:46:35.304828 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8521f5-5c64-4484-bffa-79797b7426d0 None None] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:46:35.306652 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-4a8521f5-5c64-4484-bffa-79797b7426d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:46:35.409568 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8521f5-5c64-4484-bffa-79797b7426d0 None None] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:46:35.438416 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=100 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:46:35.483418 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db6444f-a0ff-4915-87ad-5d05ef670a0e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dddf93691844886982c91fea974385d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59391272ecbe48b0aa736cb43807be1d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:46:35.484060 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db6444f-a0ff-4915-87ad-5d05ef670a0e service neutron] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:46:35.484348 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db6444f-a0ff-4915-87ad-5d05ef670a0e service neutron] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:46:35.484628 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db6444f-a0ff-4915-87ad-5d05ef670a0e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:46:35.486315 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-8db6444f-a0ff-4915-87ad-5d05ef670a0e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:46:35.593404 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db6444f-a0ff-4915-87ad-5d05ef670a0e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:46:35.594840 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db6444f-a0ff-4915-87ad-5d05ef670a0e service neutron] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:46:35.612867 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 729/1458] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jul 14 10:46:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:46:37.714444 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b1d746-3fab-4bea-8ef0-fcf6785a70b7 None None] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:46:37.714922 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b1d746-3fab-4bea-8ef0-fcf6785a70b7 None None] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:46:37.715026 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b1d746-3fab-4bea-8ef0-fcf6785a70b7 None None] PATH_INFO: `/` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:46:37.716429 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 730/1459] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 14 10:46:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:46:37.722248 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75908361-ad12-4c65-99b2-58ab8b039d10 None None] REQUEST_METHOD: `POST` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:46:37.722652 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75908361-ad12-4c65-99b2-58ab8b039d10 None None] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:46:37.722817 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75908361-ad12-4c65-99b2-58ab8b039d10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:46:37.786805 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.auth.core [None req-75908361-ad12-4c65-99b2-58ab8b039d10 None None] MFA Rules not processed for user `ae4bcdd8106d4bebbdcae96be33505bc`. Rule list: `[]` (Enabled: `True`). {{(pid=86655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:46:37.788019 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-75908361-ad12-4c65-99b2-58ab8b039d10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:46:37.796462 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=100 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:46:37.884066 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 730/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 14 10:46:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:46:37.921520 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b1d746-3fab-4bea-8ef0-fcf6785a70b7 None None] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:46:37.923086 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-55b1d746-3fab-4bea-8ef0-fcf6785a70b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:46:38.025923 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b1d746-3fab-4bea-8ef0-fcf6785a70b7 None None] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:46:38.080994 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=100 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:46:38.099304 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7bc220-9deb-40cc-92c0-746f9fa0529d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dddf93691844886982c91fea974385d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59391272ecbe48b0aa736cb43807be1d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:46:38.099950 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7bc220-9deb-40cc-92c0-746f9fa0529d service neutron] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:46:38.100234 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7bc220-9deb-40cc-92c0-746f9fa0529d service neutron] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:46:38.100508 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7bc220-9deb-40cc-92c0-746f9fa0529d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:46:38.102193 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-fc7bc220-9deb-40cc-92c0-746f9fa0529d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:46:38.209156 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7bc220-9deb-40cc-92c0-746f9fa0529d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:46:38.210592 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7bc220-9deb-40cc-92c0-746f9fa0529d service neutron] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:46:38.229488 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 731/1461] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jul 14 10:46:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:46:40.324034 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6510cde6-55cc-4585-b3ac-8945cdd22d39 None None] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:46:40.324600 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6510cde6-55cc-4585-b3ac-8945cdd22d39 None None] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:46:40.324600 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6510cde6-55cc-4585-b3ac-8945cdd22d39 None None] PATH_INFO: `/` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:46:40.326052 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 731/1462] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 14 10:46:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:46:40.331402 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4040bdf6-e497-4ed8-a5c6-8e3b35412053 None None] REQUEST_METHOD: `POST` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:46:40.331885 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4040bdf6-e497-4ed8-a5c6-8e3b35412053 None None] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:46:40.331973 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4040bdf6-e497-4ed8-a5c6-8e3b35412053 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:46:40.395604 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.auth.core [None req-4040bdf6-e497-4ed8-a5c6-8e3b35412053 None None] MFA Rules not processed for user `ae4bcdd8106d4bebbdcae96be33505bc`. Rule list: `[]` (Enabled: `True`). {{(pid=86656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:46:40.396866 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-4040bdf6-e497-4ed8-a5c6-8e3b35412053 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:46:40.437166 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=100 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:46:40.495699 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 732/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 14 10:46:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:46:40.533428 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6510cde6-55cc-4585-b3ac-8945cdd22d39 None None] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:46:40.535014 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-6510cde6-55cc-4585-b3ac-8945cdd22d39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:46:40.637699 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6510cde6-55cc-4585-b3ac-8945cdd22d39 None None] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:46:40.681601 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=100 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:46:40.718147 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5479f5ec-3a92-4497-8ee6-d305677b4cb1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dddf93691844886982c91fea974385d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59391272ecbe48b0aa736cb43807be1d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:46:40.718804 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5479f5ec-3a92-4497-8ee6-d305677b4cb1 service neutron] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:46:40.719090 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5479f5ec-3a92-4497-8ee6-d305677b4cb1 service neutron] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:46:40.719367 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5479f5ec-3a92-4497-8ee6-d305677b4cb1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:46:40.721062 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-5479f5ec-3a92-4497-8ee6-d305677b4cb1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:46:40.830177 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5479f5ec-3a92-4497-8ee6-d305677b4cb1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:46:40.831632 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5479f5ec-3a92-4497-8ee6-d305677b4cb1 service neutron] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:46:40.849981 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 732/1464] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jul 14 10:46:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:46:42.886896 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5385a2-47ad-4393-816a-234b64e79a9d None None] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:46:42.887467 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5385a2-47ad-4393-816a-234b64e79a9d None None] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:46:42.887467 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5385a2-47ad-4393-816a-234b64e79a9d None None] PATH_INFO: `/` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:46:42.889400 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 733/1465] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 14 10:46:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:46:42.894871 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20001f35-60fc-4fef-bd82-f98c8445394e None None] REQUEST_METHOD: `POST` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:46:42.895269 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20001f35-60fc-4fef-bd82-f98c8445394e None None] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:46:42.895444 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20001f35-60fc-4fef-bd82-f98c8445394e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:46:42.959997 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.auth.core [None req-20001f35-60fc-4fef-bd82-f98c8445394e None None] MFA Rules not processed for user `ae4bcdd8106d4bebbdcae96be33505bc`. Rule list: `[]` (Enabled: `True`). {{(pid=86655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:46:42.961235 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-20001f35-60fc-4fef-bd82-f98c8445394e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:46:42.980501 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=100 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:46:43.060903 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 733/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 14 10:46:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:46:43.097178 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5385a2-47ad-4393-816a-234b64e79a9d None None] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:46:43.098716 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-0f5385a2-47ad-4393-816a-234b64e79a9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:46:43.202586 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5385a2-47ad-4393-816a-234b64e79a9d None None] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:46:43.269725 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=100 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:46:43.279062 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12668af9-92e6-4132-b02b-9e953be70e0e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dddf93691844886982c91fea974385d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59391272ecbe48b0aa736cb43807be1d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:46:43.280257 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12668af9-92e6-4132-b02b-9e953be70e0e service neutron] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:46:43.280544 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12668af9-92e6-4132-b02b-9e953be70e0e service neutron] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:46:43.280853 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12668af9-92e6-4132-b02b-9e953be70e0e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:46:43.282537 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-12668af9-92e6-4132-b02b-9e953be70e0e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:46:43.389268 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12668af9-92e6-4132-b02b-9e953be70e0e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:46:43.390626 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12668af9-92e6-4132-b02b-9e953be70e0e service neutron] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:46:43.409133 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 734/1467] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jul 14 10:46:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:46:45.456785 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2691e945-7eb7-4870-ae06-e291e8c4aa4e None None] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:46:45.457414 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2691e945-7eb7-4870-ae06-e291e8c4aa4e None None] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:46:45.457414 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2691e945-7eb7-4870-ae06-e291e8c4aa4e None None] PATH_INFO: `/` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:46:45.458719 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 734/1468] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 14 10:46:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:46:45.464151 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc3e681-84ff-4fb7-b951-1f31500a703c None None] REQUEST_METHOD: `POST` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:46:45.464560 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc3e681-84ff-4fb7-b951-1f31500a703c None None] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:46:45.464748 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc3e681-84ff-4fb7-b951-1f31500a703c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:46:45.528838 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.auth.core [None req-1cc3e681-84ff-4fb7-b951-1f31500a703c None None] MFA Rules not processed for user `ae4bcdd8106d4bebbdcae96be33505bc`. Rule list: `[]` (Enabled: `True`). {{(pid=86656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:46:45.530784 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-1cc3e681-84ff-4fb7-b951-1f31500a703c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:46:45.579035 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=100 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:46:45.635022 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 735/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 14 10:46:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:46:45.674022 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2691e945-7eb7-4870-ae06-e291e8c4aa4e None None] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:46:45.675608 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-2691e945-7eb7-4870-ae06-e291e8c4aa4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:46:45.780484 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2691e945-7eb7-4870-ae06-e291e8c4aa4e None None] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:46:45.829066 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=100 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:46:45.854347 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8746e5c7-71ff-4d46-aa2b-f05625af724b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dddf93691844886982c91fea974385d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59391272ecbe48b0aa736cb43807be1d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:46:45.855006 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8746e5c7-71ff-4d46-aa2b-f05625af724b service neutron] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:46:45.855300 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8746e5c7-71ff-4d46-aa2b-f05625af724b service neutron] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:46:45.855575 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8746e5c7-71ff-4d46-aa2b-f05625af724b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:46:45.857254 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-8746e5c7-71ff-4d46-aa2b-f05625af724b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:46:45.964135 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8746e5c7-71ff-4d46-aa2b-f05625af724b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:46:45.965604 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8746e5c7-71ff-4d46-aa2b-f05625af724b service neutron] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:46:45.984247 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 735/1470] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jul 14 10:46:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:46:55.631752 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=22 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:46:55.981309 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=66 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:47:05.738818 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64d7000-1007-439e-9eed-d8fbfa3a5839 None None] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:47:05.739284 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64d7000-1007-439e-9eed-d8fbfa3a5839 None None] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:47:05.739394 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64d7000-1007-439e-9eed-d8fbfa3a5839 None None] PATH_INFO: `/` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:47:05.740803 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 736/1471] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jul 14 10:47:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:47:05.745848 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18dbd21d-ceed-48da-96d8-4ffd9aff80a9 None None] REQUEST_METHOD: `POST` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:47:05.746295 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18dbd21d-ceed-48da-96d8-4ffd9aff80a9 None None] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:47:05.746422 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18dbd21d-ceed-48da-96d8-4ffd9aff80a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:47:05.814153 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.auth.core [None req-18dbd21d-ceed-48da-96d8-4ffd9aff80a9 None None] MFA Rules not processed for user `ae4bcdd8106d4bebbdcae96be33505bc`. Rule list: `[]` (Enabled: `True`). {{(pid=86655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:47:05.815380 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-18dbd21d-ceed-48da-96d8-4ffd9aff80a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:47:05.910270 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 736/1472] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jul 14 10:47:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:47:05.993188 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea748d4-43d8-42a5-b943-2f9351897135 None None] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:47:05.993480 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea748d4-43d8-42a5-b943-2f9351897135 None None] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:47:05.993759 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea748d4-43d8-42a5-b943-2f9351897135 None None] PATH_INFO: `/` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:47:05.995115 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 737/1473] 10.222.0.16 () {54 vars in 962 bytes} [Thu Jul 14 10:47:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:47:06.000694 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73af6f3f-5756-48e2-b00f-aad2cebaaa91 None None] REQUEST_METHOD: `POST` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:47:06.001022 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73af6f3f-5756-48e2-b00f-aad2cebaaa91 None None] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:47:06.001305 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73af6f3f-5756-48e2-b00f-aad2cebaaa91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:47:06.077869 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.auth.core [None req-73af6f3f-5756-48e2-b00f-aad2cebaaa91 None None] MFA Rules not processed for user `4cb877bf3f8241dcb2ecbb612c7f4f69`. Rule list: `[]` (Enabled: `True`). {{(pid=86655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:47:06.079241 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-73af6f3f-5756-48e2-b00f-aad2cebaaa91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:47:06.100307 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=100 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:47:06.155808 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 737/1474] 10.222.0.16 () {58 vars in 1059 bytes} [Thu Jul 14 10:47:05 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:47:06.163325 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea748d4-43d8-42a5-b943-2f9351897135 None None] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:47:06.164872 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-1ea748d4-43d8-42a5-b943-2f9351897135 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:47:06.266558 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea748d4-43d8-42a5-b943-2f9351897135 None None] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:47:06.337428 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8c0327-0d6f-450a-9c78-77abf6f96278 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cb877bf3f8241dcb2ecbb612c7f4f69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59391272ecbe48b0aa736cb43807be1d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:47:06.338076 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8c0327-0d6f-450a-9c78-77abf6f96278 service glance] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:47:06.338362 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8c0327-0d6f-450a-9c78-77abf6f96278 service glance] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:47:06.338636 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8c0327-0d6f-450a-9c78-77abf6f96278 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:47:06.340277 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-cf8c0327-0d6f-450a-9c78-77abf6f96278 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:47:06.398596 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=100 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:47:06.454552 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8c0327-0d6f-450a-9c78-77abf6f96278 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:47:06.455993 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8c0327-0d6f-450a-9c78-77abf6f96278 service glance] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:47:06.474201 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 738/1475] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jul 14 10:47:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:47:08.570082 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07bee70-834f-492e-ae2a-970c942d1ff5 None None] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:47:08.570979 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07bee70-834f-492e-ae2a-970c942d1ff5 None None] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:47:08.571273 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07bee70-834f-492e-ae2a-970c942d1ff5 None None] PATH_INFO: `/` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:47:08.572699 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 738/1476] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jul 14 10:47:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:47:08.578430 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89a4d0f-b075-4e4e-b802-e31a8f3c385c None None] REQUEST_METHOD: `POST` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:47:08.578829 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89a4d0f-b075-4e4e-b802-e31a8f3c385c None None] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:47:08.578989 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89a4d0f-b075-4e4e-b802-e31a8f3c385c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:47:08.642469 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.auth.core [None req-f89a4d0f-b075-4e4e-b802-e31a8f3c385c None None] MFA Rules not processed for user `ae4bcdd8106d4bebbdcae96be33505bc`. Rule list: `[]` (Enabled: `True`). {{(pid=86656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:47:08.643670 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-f89a4d0f-b075-4e4e-b802-e31a8f3c385c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:47:08.739799 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 739/1477] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jul 14 10:47:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:47:08.762361 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07bee70-834f-492e-ae2a-970c942d1ff5 None None] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:47:08.763894 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-e07bee70-834f-492e-ae2a-970c942d1ff5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:47:08.889773 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07bee70-834f-492e-ae2a-970c942d1ff5 None None] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:47:08.938543 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=100 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:47:08.983003 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43baa5cb-3cc9-4457-93dd-e2a03783bdad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:47:08.983778 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43baa5cb-3cc9-4457-93dd-e2a03783bdad admin admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:47:08.984060 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43baa5cb-3cc9-4457-93dd-e2a03783bdad admin admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:47:08.984331 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43baa5cb-3cc9-4457-93dd-e2a03783bdad admin admin] PATH_INFO: `/v3/projects` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:47:08.985100 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43baa5cb-3cc9-4457-93dd-e2a03783bdad admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:47:08.986980 dv-cinder-846146-7-smb devstack@keystone.service[86655]: WARNING py.warnings [None req-43baa5cb-3cc9-4457-93dd-e2a03783bdad admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 14 10:47:08.986980 dv-cinder-846146-7-smb devstack@keystone.service[86655]: warnings.warn(msg) Jul 14 10:47:08.986980 dv-cinder-846146-7-smb devstack@keystone.service[86655]: Jul 14 10:47:08.988615 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43baa5cb-3cc9-4457-93dd-e2a03783bdad admin admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:47:09.007426 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 739/1478] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Jul 14 10:47:08 2022] GET /identity/v3/projects => generated 2553 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:47:11.056466 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6bd494-c424-44cc-b37e-5f3f421bb6ed None None] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:47:11.057012 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6bd494-c424-44cc-b37e-5f3f421bb6ed None None] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:47:11.057133 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6bd494-c424-44cc-b37e-5f3f421bb6ed None None] PATH_INFO: `/` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:47:11.058684 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 740/1479] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jul 14 10:47:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:47:11.063800 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ab976e-037e-49c2-88ea-3dee4dc9bc28 None None] REQUEST_METHOD: `POST` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:47:11.064203 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ab976e-037e-49c2-88ea-3dee4dc9bc28 None None] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:47:11.064361 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ab976e-037e-49c2-88ea-3dee4dc9bc28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:47:11.128336 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.auth.core [None req-c4ab976e-037e-49c2-88ea-3dee4dc9bc28 None None] MFA Rules not processed for user `ae4bcdd8106d4bebbdcae96be33505bc`. Rule list: `[]` (Enabled: `True`). {{(pid=86655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:47:11.129593 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-c4ab976e-037e-49c2-88ea-3dee4dc9bc28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:47:11.225371 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 740/1480] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jul 14 10:47:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:47:11.268316 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6bd494-c424-44cc-b37e-5f3f421bb6ed None None] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:47:11.270073 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-af6bd494-c424-44cc-b37e-5f3f421bb6ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:47:11.279796 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=100 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:47:11.416389 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6bd494-c424-44cc-b37e-5f3f421bb6ed None None] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:47:11.494013 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=100 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:47:11.526680 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261f9468-e2e6-449a-9180-8940ff1c4b4d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26aa294c913c408499a913ec25bb677d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59391272ecbe48b0aa736cb43807be1d', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:47:11.527327 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261f9468-e2e6-449a-9180-8940ff1c4b4d service nova] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:47:11.527607 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261f9468-e2e6-449a-9180-8940ff1c4b4d service nova] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:47:11.527881 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261f9468-e2e6-449a-9180-8940ff1c4b4d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:47:11.529560 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-261f9468-e2e6-449a-9180-8940ff1c4b4d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:47:11.617939 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261f9468-e2e6-449a-9180-8940ff1c4b4d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:47:11.619528 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261f9468-e2e6-449a-9180-8940ff1c4b4d service nova] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:47:11.637466 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 741/1481] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jul 14 10:47:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:47:13.860129 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521172ba-4dd6-491b-a681-845d006fc987 None None] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:47:13.860687 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521172ba-4dd6-491b-a681-845d006fc987 None None] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:47:13.860898 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521172ba-4dd6-491b-a681-845d006fc987 None None] PATH_INFO: `/` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:47:13.862408 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 741/1482] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jul 14 10:47:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:47:13.867608 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c1181f-f4eb-4026-a6cf-3c7053e2b578 None None] REQUEST_METHOD: `POST` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:47:13.868244 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c1181f-f4eb-4026-a6cf-3c7053e2b578 None None] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:47:13.868244 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c1181f-f4eb-4026-a6cf-3c7053e2b578 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:47:13.932656 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.auth.core [None req-58c1181f-f4eb-4026-a6cf-3c7053e2b578 None None] MFA Rules not processed for user `ae4bcdd8106d4bebbdcae96be33505bc`. Rule list: `[]` (Enabled: `True`). {{(pid=86656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:47:13.934156 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-58c1181f-f4eb-4026-a6cf-3c7053e2b578 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:47:13.980372 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=100 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:47:14.030679 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 742/1483] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jul 14 10:47:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:47:14.067419 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521172ba-4dd6-491b-a681-845d006fc987 None None] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:47:14.069014 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-521172ba-4dd6-491b-a681-845d006fc987 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:47:14.092717 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=100 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:47:14.178871 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521172ba-4dd6-491b-a681-845d006fc987 None None] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:47:14.252728 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624a1072-da42-43a2-b9b9-c8eedc4e858a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dddf93691844886982c91fea974385d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59391272ecbe48b0aa736cb43807be1d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:47:14.253328 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624a1072-da42-43a2-b9b9-c8eedc4e858a service neutron] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:47:14.253610 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624a1072-da42-43a2-b9b9-c8eedc4e858a service neutron] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:47:14.253885 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624a1072-da42-43a2-b9b9-c8eedc4e858a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:47:14.255527 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-624a1072-da42-43a2-b9b9-c8eedc4e858a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:47:14.328541 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=100 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:47:14.362811 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624a1072-da42-43a2-b9b9-c8eedc4e858a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:47:14.364234 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624a1072-da42-43a2-b9b9-c8eedc4e858a service neutron] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:47:14.384052 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 742/1484] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jul 14 10:47:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:47:16.473258 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9531560-a9ca-4a5a-b037-1ab21bae38d1 None None] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:47:16.473864 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9531560-a9ca-4a5a-b037-1ab21bae38d1 None None] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:47:16.473864 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9531560-a9ca-4a5a-b037-1ab21bae38d1 None None] PATH_INFO: `/` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:47:16.475191 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 743/1485] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jul 14 10:47:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:47:16.480353 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fc70c9-839e-4af6-9e8b-5a154621b692 None None] REQUEST_METHOD: `POST` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:47:16.480759 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fc70c9-839e-4af6-9e8b-5a154621b692 None None] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:47:16.480949 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fc70c9-839e-4af6-9e8b-5a154621b692 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:47:16.550639 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.auth.core [None req-00fc70c9-839e-4af6-9e8b-5a154621b692 None None] MFA Rules not processed for user `ae4bcdd8106d4bebbdcae96be33505bc`. Rule list: `[]` (Enabled: `True`). {{(pid=86655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:47:16.551862 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-00fc70c9-839e-4af6-9e8b-5a154621b692 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:47:16.647905 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 743/1486] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jul 14 10:47:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:47:16.685592 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9531560-a9ca-4a5a-b037-1ab21bae38d1 None None] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:47:16.687107 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-a9531560-a9ca-4a5a-b037-1ab21bae38d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:47:16.790444 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9531560-a9ca-4a5a-b037-1ab21bae38d1 None None] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:47:16.863322 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=100 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:47:16.865378 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babeaa07-eabd-47eb-beae-0c77737c25d0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dddf93691844886982c91fea974385d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59391272ecbe48b0aa736cb43807be1d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:47:16.866140 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babeaa07-eabd-47eb-beae-0c77737c25d0 service neutron] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:47:16.866718 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babeaa07-eabd-47eb-beae-0c77737c25d0 service neutron] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:47:16.867008 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babeaa07-eabd-47eb-beae-0c77737c25d0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:47:16.869989 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-babeaa07-eabd-47eb-beae-0c77737c25d0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:47:16.985574 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-babeaa07-eabd-47eb-beae-0c77737c25d0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:47:16.987020 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-babeaa07-eabd-47eb-beae-0c77737c25d0 service neutron] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:47:17.005704 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 744/1487] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jul 14 10:47:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:47:19.119104 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a11b3a-b574-48b7-ba08-e161bef1b4ff None None] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:47:19.119664 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a11b3a-b574-48b7-ba08-e161bef1b4ff None None] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:47:19.119664 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a11b3a-b574-48b7-ba08-e161bef1b4ff None None] PATH_INFO: `/` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:47:19.121084 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 744/1488] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jul 14 10:47:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:47:19.127033 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898660e8-a8aa-443a-8f03-01f5b86e3070 None None] REQUEST_METHOD: `POST` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:47:19.127478 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898660e8-a8aa-443a-8f03-01f5b86e3070 None None] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:47:19.127581 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898660e8-a8aa-443a-8f03-01f5b86e3070 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:47:19.192053 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.auth.core [None req-898660e8-a8aa-443a-8f03-01f5b86e3070 None None] MFA Rules not processed for user `ae4bcdd8106d4bebbdcae96be33505bc`. Rule list: `[]` (Enabled: `True`). {{(pid=86656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:47:19.193300 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-898660e8-a8aa-443a-8f03-01f5b86e3070 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:47:19.245841 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=100 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:47:19.289892 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 745/1489] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jul 14 10:47:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:47:19.330538 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a11b3a-b574-48b7-ba08-e161bef1b4ff None None] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:47:19.332084 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-91a11b3a-b574-48b7-ba08-e161bef1b4ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:47:19.368488 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=100 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:47:19.436482 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a11b3a-b574-48b7-ba08-e161bef1b4ff None None] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:47:19.508612 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0d2032-ae50-4af5-9fe4-d0a8dd4a3af5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dddf93691844886982c91fea974385d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59391272ecbe48b0aa736cb43807be1d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:47:19.509284 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0d2032-ae50-4af5-9fe4-d0a8dd4a3af5 service neutron] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:47:19.509568 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0d2032-ae50-4af5-9fe4-d0a8dd4a3af5 service neutron] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:47:19.509842 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0d2032-ae50-4af5-9fe4-d0a8dd4a3af5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:47:19.511485 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-6a0d2032-ae50-4af5-9fe4-d0a8dd4a3af5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:47:19.594931 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=100 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:47:19.624997 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0d2032-ae50-4af5-9fe4-d0a8dd4a3af5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:47:19.626566 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0d2032-ae50-4af5-9fe4-d0a8dd4a3af5 service neutron] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:47:19.648268 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 745/1490] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jul 14 10:47:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:47:21.964074 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c1fbc7-41a8-4dd8-9332-16d7fe243db6 None None] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:47:21.964597 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c1fbc7-41a8-4dd8-9332-16d7fe243db6 None None] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:47:21.964597 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c1fbc7-41a8-4dd8-9332-16d7fe243db6 None None] PATH_INFO: `/` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:47:21.965988 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 746/1491] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jul 14 10:47:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:47:21.971808 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0317d52-e559-4903-98bd-b5af8b1a257d None None] REQUEST_METHOD: `POST` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:47:21.972290 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0317d52-e559-4903-98bd-b5af8b1a257d None None] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:47:21.972392 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0317d52-e559-4903-98bd-b5af8b1a257d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:47:22.041130 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.auth.core [None req-b0317d52-e559-4903-98bd-b5af8b1a257d None None] MFA Rules not processed for user `ae4bcdd8106d4bebbdcae96be33505bc`. Rule list: `[]` (Enabled: `True`). {{(pid=86655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:47:22.042351 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-b0317d52-e559-4903-98bd-b5af8b1a257d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:47:22.141821 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 746/1492] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jul 14 10:47:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:47:22.181822 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c1fbc7-41a8-4dd8-9332-16d7fe243db6 None None] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:47:22.183352 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-70c1fbc7-41a8-4dd8-9332-16d7fe243db6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:47:22.286920 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c1fbc7-41a8-4dd8-9332-16d7fe243db6 None None] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:47:22.360278 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b490c9c-11f4-4a07-b212-6652b44a0341 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dddf93691844886982c91fea974385d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59391272ecbe48b0aa736cb43807be1d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:47:22.360959 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b490c9c-11f4-4a07-b212-6652b44a0341 service neutron] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:47:22.361252 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b490c9c-11f4-4a07-b212-6652b44a0341 service neutron] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:47:22.361532 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b490c9c-11f4-4a07-b212-6652b44a0341 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:47:22.363191 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-3b490c9c-11f4-4a07-b212-6652b44a0341 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:47:22.372061 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=100 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:47:22.471586 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b490c9c-11f4-4a07-b212-6652b44a0341 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:47:22.473058 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b490c9c-11f4-4a07-b212-6652b44a0341 service neutron] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:47:22.490813 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 747/1493] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jul 14 10:47:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:47:32.139286 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=82 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:47:32.488645 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=50 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:48:55.456028 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3a7f50-2bf0-481d-8748-f021fa81aa47 None None] REQUEST_METHOD: `POST` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:48:55.456658 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3a7f50-2bf0-481d-8748-f021fa81aa47 None None] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:48:55.456658 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3a7f50-2bf0-481d-8748-f021fa81aa47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:48:55.536551 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.auth.core [None req-6b3a7f50-2bf0-481d-8748-f021fa81aa47 None None] MFA Rules not processed for user `ae4bcdd8106d4bebbdcae96be33505bc`. Rule list: `[]` (Enabled: `True`). {{(pid=86655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:48:55.537848 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-6b3a7f50-2bf0-481d-8748-f021fa81aa47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:48:55.633024 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 747/1494] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jul 14 10:48:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:48:55.641803 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8319654f-f7f8-4b14-84ef-06182d4aed4a None None] REQUEST_METHOD: `POST` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:48:55.642457 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8319654f-f7f8-4b14-84ef-06182d4aed4a None None] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:48:55.642457 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8319654f-f7f8-4b14-84ef-06182d4aed4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:48:55.715311 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.auth.core [None req-8319654f-f7f8-4b14-84ef-06182d4aed4a None None] MFA Rules not processed for user `ae4bcdd8106d4bebbdcae96be33505bc`. Rule list: `[]` (Enabled: `True`). {{(pid=86656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:48:55.716434 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-8319654f-f7f8-4b14-84ef-06182d4aed4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:48:55.812704 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 748/1495] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jul 14 10:48:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:48:55.817839 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3a7f50-2bf0-481d-8748-f021fa81aa47 None None] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:48:55.819105 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-6b3a7f50-2bf0-481d-8748-f021fa81aa47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:48:55.831228 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3a7f50-2bf0-481d-8748-f021fa81aa47 None None] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:48:55.892573 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=100 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:48:55.926896 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344cc233-c08e-42fb-87c6-158021ffdcff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:48:55.927562 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344cc233-c08e-42fb-87c6-158021ffdcff admin admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:48:55.927849 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344cc233-c08e-42fb-87c6-158021ffdcff admin admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:48:55.928124 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344cc233-c08e-42fb-87c6-158021ffdcff admin admin] PATH_INFO: `/v3/domains` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:48:55.928887 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344cc233-c08e-42fb-87c6-158021ffdcff admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:48:55.929195 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344cc233-c08e-42fb-87c6-158021ffdcff admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:48:55.930205 dv-cinder-846146-7-smb devstack@keystone.service[86655]: WARNING py.warnings [None req-344cc233-c08e-42fb-87c6-158021ffdcff admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 10:48:55.930205 dv-cinder-846146-7-smb devstack@keystone.service[86655]: warnings.warn(msg) Jul 14 10:48:55.930205 dv-cinder-846146-7-smb devstack@keystone.service[86655]: Jul 14 10:48:55.931120 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344cc233-c08e-42fb-87c6-158021ffdcff admin admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:48:55.942770 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 748/1496] 10.222.0.16 () {58 vars in 1152 bytes} [Thu Jul 14 10:48:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:48:55.951055 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8319654f-f7f8-4b14-84ef-06182d4aed4a None None] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:48:55.961024 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8319654f-f7f8-4b14-84ef-06182d4aed4a None None] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:48:56.021762 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=100 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:48:56.055356 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15f7372-5247-4118-a81b-57603c76356b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:48:56.056023 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15f7372-5247-4118-a81b-57603c76356b admin admin] REQUEST_METHOD: `POST` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:48:56.056311 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15f7372-5247-4118-a81b-57603c76356b admin admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:48:56.056595 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15f7372-5247-4118-a81b-57603c76356b admin admin] PATH_INFO: `/v3/projects` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:48:56.057334 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15f7372-5247-4118-a81b-57603c76356b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:48:56.059130 dv-cinder-846146-7-smb devstack@keystone.service[86656]: WARNING py.warnings [None req-e15f7372-5247-4118-a81b-57603c76356b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 14 10:48:56.059130 dv-cinder-846146-7-smb devstack@keystone.service[86656]: warnings.warn(msg) Jul 14 10:48:56.059130 dv-cinder-846146-7-smb devstack@keystone.service[86656]: Jul 14 10:48:56.060343 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15f7372-5247-4118-a81b-57603c76356b admin admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:48:56.117672 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 749/1497] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Jul 14 10:48:55 2022] POST /identity/v3/projects => generated 377 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:48:56.121928 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344cc233-c08e-42fb-87c6-158021ffdcff admin admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:48:56.123449 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-344cc233-c08e-42fb-87c6-158021ffdcff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:48:56.157665 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344cc233-c08e-42fb-87c6-158021ffdcff admin admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:48:56.256380 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7f4fb8-f361-4de1-9d28-95ca0f1811bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:48:56.257086 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7f4fb8-f361-4de1-9d28-95ca0f1811bc admin admin] REQUEST_METHOD: `POST` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:48:56.257370 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7f4fb8-f361-4de1-9d28-95ca0f1811bc admin admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:48:56.257643 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7f4fb8-f361-4de1-9d28-95ca0f1811bc admin admin] PATH_INFO: `/v3/users` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:48:56.258374 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7f4fb8-f361-4de1-9d28-95ca0f1811bc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:48:56.259393 dv-cinder-846146-7-smb devstack@keystone.service[86655]: WARNING py.warnings [None req-1f7f4fb8-f361-4de1-9d28-95ca0f1811bc admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 14 10:48:56.259393 dv-cinder-846146-7-smb devstack@keystone.service[86655]: warnings.warn(msg) Jul 14 10:48:56.259393 dv-cinder-846146-7-smb devstack@keystone.service[86655]: Jul 14 10:48:56.260591 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7f4fb8-f361-4de1-9d28-95ca0f1811bc admin admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:48:56.302619 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 749/1498] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Jul 14 10:48:56 2022] POST /identity/v3/users => generated 289 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:48:56.306806 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15f7372-5247-4118-a81b-57603c76356b admin admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:48:56.308347 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-e15f7372-5247-4118-a81b-57603c76356b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:48:56.370008 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15f7372-5247-4118-a81b-57603c76356b admin admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:48:56.452843 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:48:56.464172 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765e91bc-ffbc-4307-9efa-bfea8d7c279d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:48:56.464872 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765e91bc-ffbc-4307-9efa-bfea8d7c279d admin admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:48:56.465159 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765e91bc-ffbc-4307-9efa-bfea8d7c279d admin admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:48:56.465437 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765e91bc-ffbc-4307-9efa-bfea8d7c279d admin admin] PATH_INFO: `/v3/roles` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:48:56.466168 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765e91bc-ffbc-4307-9efa-bfea8d7c279d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:48:56.467176 dv-cinder-846146-7-smb devstack@keystone.service[86656]: WARNING py.warnings [None req-765e91bc-ffbc-4307-9efa-bfea8d7c279d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 10:48:56.467176 dv-cinder-846146-7-smb devstack@keystone.service[86656]: warnings.warn(msg) Jul 14 10:48:56.467176 dv-cinder-846146-7-smb devstack@keystone.service[86656]: Jul 14 10:48:56.468065 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765e91bc-ffbc-4307-9efa-bfea8d7c279d admin admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:48:56.480852 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 750/1499] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jul 14 10:48:56 2022] GET /identity/v3/roles => generated 1420 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:48:56.484948 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7f4fb8-f361-4de1-9d28-95ca0f1811bc admin admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:48:56.487301 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-1f7f4fb8-f361-4de1-9d28-95ca0f1811bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:48:56.498593 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7f4fb8-f361-4de1-9d28-95ca0f1811bc admin admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:48:56.523608 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:48:56.597815 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38dcec95-ee35-4958-bb77-5b2e08481505 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:48:56.598412 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38dcec95-ee35-4958-bb77-5b2e08481505 admin admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:48:56.598701 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38dcec95-ee35-4958-bb77-5b2e08481505 admin admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:48:56.598984 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38dcec95-ee35-4958-bb77-5b2e08481505 admin admin] PATH_INFO: `/v3/roles` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:48:56.599717 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38dcec95-ee35-4958-bb77-5b2e08481505 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:48:56.600728 dv-cinder-846146-7-smb devstack@keystone.service[86655]: WARNING py.warnings [None req-38dcec95-ee35-4958-bb77-5b2e08481505 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 10:48:56.600728 dv-cinder-846146-7-smb devstack@keystone.service[86655]: warnings.warn(msg) Jul 14 10:48:56.600728 dv-cinder-846146-7-smb devstack@keystone.service[86655]: Jul 14 10:48:56.601652 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38dcec95-ee35-4958-bb77-5b2e08481505 admin admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:48:56.614589 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 750/1500] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jul 14 10:48:56 2022] GET /identity/v3/roles => generated 1420 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:48:56.618786 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765e91bc-ffbc-4307-9efa-bfea8d7c279d admin admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:48:56.620365 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-765e91bc-ffbc-4307-9efa-bfea8d7c279d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:48:56.652929 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765e91bc-ffbc-4307-9efa-bfea8d7c279d admin admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:48:56.745708 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14cfde4-5b72-4f77-9289-b886711234e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:48:56.746595 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14cfde4-5b72-4f77-9289-b886711234e0 admin admin] REQUEST_METHOD: `PUT` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:48:56.746884 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14cfde4-5b72-4f77-9289-b886711234e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:48:56.747164 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14cfde4-5b72-4f77-9289-b886711234e0 admin admin] PATH_INFO: `/v3/projects/e2a9ff7f0fbe43faad250f699f82561a/users/5a13e0476f174b598f9192d3f55337b6/roles/0da46c267d354cce81495dfdd56c1ec2` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:48:56.769249 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14cfde4-5b72-4f77-9289-b886711234e0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e2a9ff7f0fbe43faad250f699f82561a, user_id=5a13e0476f174b598f9192d3f55337b6, role_id=0da46c267d354cce81495dfdd56c1ec2)` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:48:56.770280 dv-cinder-846146-7-smb devstack@keystone.service[86656]: WARNING py.warnings [None req-e14cfde4-5b72-4f77-9289-b886711234e0 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 14 10:48:56.770280 dv-cinder-846146-7-smb devstack@keystone.service[86656]: warnings.warn(msg) Jul 14 10:48:56.770280 dv-cinder-846146-7-smb devstack@keystone.service[86656]: Jul 14 10:48:56.772208 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14cfde4-5b72-4f77-9289-b886711234e0 admin admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:48:56.797192 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 751/1501] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Jul 14 10:48:56 2022] PUT /identity/v3/projects/e2a9ff7f0fbe43faad250f699f82561a/users/5a13e0476f174b598f9192d3f55337b6/roles/0da46c267d354cce81495dfdd56c1ec2 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:48:56.810306 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc93141-c66d-4a9f-93b8-463e4d8f42ca None None] REQUEST_METHOD: `POST` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:48:56.810595 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc93141-c66d-4a9f-93b8-463e4d8f42ca None None] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:48:56.810871 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc93141-c66d-4a9f-93b8-463e4d8f42ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:48:56.866094 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.auth.core [None req-ecc93141-c66d-4a9f-93b8-463e4d8f42ca None None] MFA Rules not processed for user `5a13e0476f174b598f9192d3f55337b6`. Rule list: `[]` (Enabled: `True`). {{(pid=86655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:48:56.867286 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-ecc93141-c66d-4a9f-93b8-463e4d8f42ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:48:56.944397 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 751/1502] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jul 14 10:48:56 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:48:56.957661 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a447d8c1-6d41-4d79-b56e-32646ac03e13 None None] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:48:56.957960 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a447d8c1-6d41-4d79-b56e-32646ac03e13 None None] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:48:56.958244 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a447d8c1-6d41-4d79-b56e-32646ac03e13 None None] PATH_INFO: `/` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:48:56.959660 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 752/1503] 10.222.0.16 () {54 vars in 963 bytes} [Thu Jul 14 10:48:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:48:56.964490 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f379f68-a7cc-4858-82d1-4c486ac04376 None None] REQUEST_METHOD: `POST` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:48:56.964796 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f379f68-a7cc-4858-82d1-4c486ac04376 None None] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:48:56.965090 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f379f68-a7cc-4858-82d1-4c486ac04376 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:48:56.996518 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=100 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:48:57.041516 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.auth.core [None req-4f379f68-a7cc-4858-82d1-4c486ac04376 None None] MFA Rules not processed for user `68382432147a48c3b62271fd2a2eab04`. Rule list: `[]` (Enabled: `True`). {{(pid=86655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:48:57.042728 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-4f379f68-a7cc-4858-82d1-4c486ac04376 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:48:57.119973 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 752/1504] 10.222.0.16 () {58 vars in 1060 bytes} [Thu Jul 14 10:48:56 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:48:57.128218 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a447d8c1-6d41-4d79-b56e-32646ac03e13 None None] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:48:57.129792 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-a447d8c1-6d41-4d79-b56e-32646ac03e13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:48:57.180794 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:48:57.235751 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a447d8c1-6d41-4d79-b56e-32646ac03e13 None None] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:48:57.311855 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1070f216-d1e4-4dd7-a1d5-ed09bdf6b030 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68382432147a48c3b62271fd2a2eab04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59391272ecbe48b0aa736cb43807be1d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:48:57.312523 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1070f216-d1e4-4dd7-a1d5-ed09bdf6b030 service cinder] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:48:57.312837 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1070f216-d1e4-4dd7-a1d5-ed09bdf6b030 service cinder] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:48:57.313113 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1070f216-d1e4-4dd7-a1d5-ed09bdf6b030 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:48:57.315746 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-1070f216-d1e4-4dd7-a1d5-ed09bdf6b030 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:48:57.410360 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1070f216-d1e4-4dd7-a1d5-ed09bdf6b030 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:48:57.411716 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1070f216-d1e4-4dd7-a1d5-ed09bdf6b030 service cinder] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:48:57.415268 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=100 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:48:57.430522 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 753/1505] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jul 14 10:48:57 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 10:48:57.472861 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202a0065-da9c-4fc4-b8d1-34bd7f7de80d None None] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:48:57.473158 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202a0065-da9c-4fc4-b8d1-34bd7f7de80d None None] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:48:57.473437 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202a0065-da9c-4fc4-b8d1-34bd7f7de80d None None] PATH_INFO: `/` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:48:57.474764 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 753/1506] 10.222.0.16 () {52 vars in 829 bytes} [Thu Jul 14 10:48:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:48:57.478401 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1070f216-d1e4-4dd7-a1d5-ed09bdf6b030 service cinder] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:48:57.479615 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-1070f216-d1e4-4dd7-a1d5-ed09bdf6b030 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:48:57.578181 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1070f216-d1e4-4dd7-a1d5-ed09bdf6b030 service cinder] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:48:57.669396 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e14bc3-584e-4e74-bc0f-0ec985305945 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:48:57.670181 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e14bc3-584e-4e74-bc0f-0ec985305945 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:48:57.670465 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e14bc3-584e-4e74-bc0f-0ec985305945 admin admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:48:57.670737 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e14bc3-584e-4e74-bc0f-0ec985305945 admin admin] PATH_INFO: `/v3/users/5a13e0476f174b598f9192d3f55337b6` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:48:57.683237 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e14bc3-584e-4e74-bc0f-0ec985305945 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5a13e0476f174b598f9192d3f55337b6)` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:48:57.684253 dv-cinder-846146-7-smb devstack@keystone.service[86656]: WARNING py.warnings [None req-20e14bc3-584e-4e74-bc0f-0ec985305945 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 14 10:48:57.684253 dv-cinder-846146-7-smb devstack@keystone.service[86656]: warnings.warn(msg) Jul 14 10:48:57.684253 dv-cinder-846146-7-smb devstack@keystone.service[86656]: Jul 14 10:48:57.685487 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e14bc3-584e-4e74-bc0f-0ec985305945 admin admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:48:57.695210 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=100 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:48:57.746754 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-20e14bc3-584e-4e74-bc0f-0ec985305945 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5a13e0476f174b598f9192d3f55337b6'} {{(pid=86656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:48:57.756021 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-20e14bc3-584e-4e74-bc0f-0ec985305945 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5a13e0476f174b598f9192d3f55337b6'} {{(pid=86656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:48:57.756477 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-20e14bc3-584e-4e74-bc0f-0ec985305945 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5a13e0476f174b598f9192d3f55337b6'} {{(pid=86656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:48:57.768672 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-20e14bc3-584e-4e74-bc0f-0ec985305945 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5a13e0476f174b598f9192d3f55337b6'} {{(pid=86656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:48:57.769288 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-20e14bc3-584e-4e74-bc0f-0ec985305945 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5a13e0476f174b598f9192d3f55337b6'} {{(pid=86656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:48:57.793521 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 754/1507] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Jul 14 10:48:57 2022] DELETE /identity/v3/users/5a13e0476f174b598f9192d3f55337b6 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:48:57.798774 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad40d62-0ff9-42e4-8065-aafa725794a5 None None] REQUEST_METHOD: `POST` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:48:57.799271 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad40d62-0ff9-42e4-8065-aafa725794a5 None None] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:48:57.799364 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad40d62-0ff9-42e4-8065-aafa725794a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:48:57.859952 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.auth.core [None req-aad40d62-0ff9-42e4-8065-aafa725794a5 None None] MFA Rules not processed for user `ae4bcdd8106d4bebbdcae96be33505bc`. Rule list: `[]` (Enabled: `True`). {{(pid=86655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:48:57.861767 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-aad40d62-0ff9-42e4-8065-aafa725794a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:48:57.937407 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=100 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:48:57.951194 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 754/1508] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jul 14 10:48:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:48:57.961252 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e14bc3-584e-4e74-bc0f-0ec985305945 admin admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:48:57.962511 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-20e14bc3-584e-4e74-bc0f-0ec985305945 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:48:58.061351 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e14bc3-584e-4e74-bc0f-0ec985305945 admin admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:48:58.115209 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:48:58.135531 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d720c3af-3818-4b0e-99b9-26fc46b00c08 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dddf93691844886982c91fea974385d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59391272ecbe48b0aa736cb43807be1d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:48:58.136185 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d720c3af-3818-4b0e-99b9-26fc46b00c08 service neutron] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:48:58.136463 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d720c3af-3818-4b0e-99b9-26fc46b00c08 service neutron] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:48:58.136734 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d720c3af-3818-4b0e-99b9-26fc46b00c08 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:48:58.138398 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-d720c3af-3818-4b0e-99b9-26fc46b00c08 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:48:58.247083 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d720c3af-3818-4b0e-99b9-26fc46b00c08 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:48:58.248454 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d720c3af-3818-4b0e-99b9-26fc46b00c08 service neutron] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:48:58.267732 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 755/1509] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jul 14 10:48:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:48:58.620667 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad40d62-0ff9-42e4-8065-aafa725794a5 None None] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:48:58.622003 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-aad40d62-0ff9-42e4-8065-aafa725794a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:48:58.634110 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad40d62-0ff9-42e4-8065-aafa725794a5 None None] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:48:58.730738 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1c4f04-75d3-4e80-bbf0-66b9c2820e6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:48:58.731606 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1c4f04-75d3-4e80-bbf0-66b9c2820e6a admin admin] REQUEST_METHOD: `DELETE` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:48:58.731895 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1c4f04-75d3-4e80-bbf0-66b9c2820e6a admin admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:48:58.732176 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1c4f04-75d3-4e80-bbf0-66b9c2820e6a admin admin] PATH_INFO: `/v3/projects/e2a9ff7f0fbe43faad250f699f82561a` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:48:58.742489 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1c4f04-75d3-4e80-bbf0-66b9c2820e6a admin admin] RBAC: Authorizing `identity:delete_project(project_id=e2a9ff7f0fbe43faad250f699f82561a)` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:48:58.743530 dv-cinder-846146-7-smb devstack@keystone.service[86655]: WARNING py.warnings [None req-1a1c4f04-75d3-4e80-bbf0-66b9c2820e6a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 14 10:48:58.743530 dv-cinder-846146-7-smb devstack@keystone.service[86655]: warnings.warn(msg) Jul 14 10:48:58.743530 dv-cinder-846146-7-smb devstack@keystone.service[86655]: Jul 14 10:48:58.744737 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1c4f04-75d3-4e80-bbf0-66b9c2820e6a admin admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:48:58.801821 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-1a1c4f04-75d3-4e80-bbf0-66b9c2820e6a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e2a9ff7f0fbe43faad250f699f82561a', 'request_id': 'req-1a1c4f04-75d3-4e80-bbf0-66b9c2820e6a'} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:48:58.807767 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-1a1c4f04-75d3-4e80-bbf0-66b9c2820e6a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e2a9ff7f0fbe43faad250f699f82561a', 'request_id': 'req-1a1c4f04-75d3-4e80-bbf0-66b9c2820e6a'} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:48:58.818039 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-1a1c4f04-75d3-4e80-bbf0-66b9c2820e6a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e2a9ff7f0fbe43faad250f699f82561a', 'request_id': 'req-1a1c4f04-75d3-4e80-bbf0-66b9c2820e6a'} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:48:58.848167 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-1a1c4f04-75d3-4e80-bbf0-66b9c2820e6a admin admin] The token cache is being invalidate because project e2a9ff7f0fbe43faad250f699f82561a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86655) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 10:48:58.848463 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-1a1c4f04-75d3-4e80-bbf0-66b9c2820e6a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:48:58.849023 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-1a1c4f04-75d3-4e80-bbf0-66b9c2820e6a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:48:58.850400 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 755/1510] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Jul 14 10:48:58 2022] DELETE /identity/v3/projects/e2a9ff7f0fbe43faad250f699f82561a => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:49:08.264738 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=62 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:49:08.846159 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:50:43.403594 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d43143-ca6b-4c02-bcc0-de2b200a4682 None None] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:50:43.404194 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d43143-ca6b-4c02-bcc0-de2b200a4682 None None] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:50:43.404194 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d43143-ca6b-4c02-bcc0-de2b200a4682 None None] PATH_INFO: `/` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:50:43.405597 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 756/1511] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 14 10:50:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:50:43.410368 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90c4508-d87d-48ee-b80c-af8fc6e023fd None None] REQUEST_METHOD: `POST` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:50:43.410808 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90c4508-d87d-48ee-b80c-af8fc6e023fd None None] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:50:43.410914 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90c4508-d87d-48ee-b80c-af8fc6e023fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:50:43.495709 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.auth.core [None req-e90c4508-d87d-48ee-b80c-af8fc6e023fd None None] MFA Rules not processed for user `ae4bcdd8106d4bebbdcae96be33505bc`. Rule list: `[]` (Enabled: `True`). {{(pid=86655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:50:43.496962 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-e90c4508-d87d-48ee-b80c-af8fc6e023fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:50:43.723755 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 756/1512] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 14 10:50:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 314 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:50:43.879936 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d43143-ca6b-4c02-bcc0-de2b200a4682 None None] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:50:43.882716 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-a7d43143-ca6b-4c02-bcc0-de2b200a4682 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:50:44.007933 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d43143-ca6b-4c02-bcc0-de2b200a4682 None None] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:50:44.013229 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35839fe7-4b99-46ae-bdfc-4514d6f65d72 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26aa294c913c408499a913ec25bb677d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59391272ecbe48b0aa736cb43807be1d', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:50:44.013875 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35839fe7-4b99-46ae-bdfc-4514d6f65d72 service nova] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:50:44.014161 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35839fe7-4b99-46ae-bdfc-4514d6f65d72 service nova] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:50:44.014439 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35839fe7-4b99-46ae-bdfc-4514d6f65d72 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:50:44.022548 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35839fe7-4b99-46ae-bdfc-4514d6f65d72 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:50:44.024272 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35839fe7-4b99-46ae-bdfc-4514d6f65d72 service nova] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:50:44.033759 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 757/1513] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jul 14 10:50:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:50:44.868861 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093c4fe3-aeed-4c1c-8b94-af8939caacfc None None] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:50:44.869593 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093c4fe3-aeed-4c1c-8b94-af8939caacfc None None] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:50:44.869593 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093c4fe3-aeed-4c1c-8b94-af8939caacfc None None] PATH_INFO: `/` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:50:44.870787 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 757/1514] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 14 10:50:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:50:44.875893 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917ccca0-2285-414a-a516-7bf1105fa9e2 None None] REQUEST_METHOD: `POST` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:50:44.876299 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917ccca0-2285-414a-a516-7bf1105fa9e2 None None] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:50:44.876517 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917ccca0-2285-414a-a516-7bf1105fa9e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:50:44.894922 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.auth.core [None req-917ccca0-2285-414a-a516-7bf1105fa9e2 None None] MFA Rules not processed for user `ae4bcdd8106d4bebbdcae96be33505bc`. Rule list: `[]` (Enabled: `True`). {{(pid=86656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:50:44.896114 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-917ccca0-2285-414a-a516-7bf1105fa9e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:50:44.904181 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 758/1515] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 14 10:50:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 10:50:45.063777 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093c4fe3-aeed-4c1c-8b94-af8939caacfc None None] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:50:45.079080 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093c4fe3-aeed-4c1c-8b94-af8939caacfc None None] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:50:45.084624 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585d7d84-23c7-4a9d-afea-bbbb8c827c2f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26aa294c913c408499a913ec25bb677d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59391272ecbe48b0aa736cb43807be1d', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:50:45.085741 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585d7d84-23c7-4a9d-afea-bbbb8c827c2f service nova] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:50:45.086025 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585d7d84-23c7-4a9d-afea-bbbb8c827c2f service nova] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:50:45.086483 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585d7d84-23c7-4a9d-afea-bbbb8c827c2f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:50:45.096404 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585d7d84-23c7-4a9d-afea-bbbb8c827c2f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:50:45.098141 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585d7d84-23c7-4a9d-afea-bbbb8c827c2f service nova] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:50:45.110461 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 758/1516] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jul 14 10:50:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:50:45.568508 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7070a6e-9d98-4310-92d7-d98543a1b29c None None] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:50:45.568830 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7070a6e-9d98-4310-92d7-d98543a1b29c None None] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:50:45.569155 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7070a6e-9d98-4310-92d7-d98543a1b29c None None] PATH_INFO: `/v3` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:50:45.570439 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 759/1517] 10.222.0.73 () {54 vars in 925 bytes} [Thu Jul 14 10:50:45 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:50:45.576620 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b385de-5544-43e7-a02b-7907af6b773a None None] REQUEST_METHOD: `POST` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:50:45.576931 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b385de-5544-43e7-a02b-7907af6b773a None None] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:50:45.577209 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b385de-5544-43e7-a02b-7907af6b773a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:50:45.634066 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.auth.core [None req-a6b385de-5544-43e7-a02b-7907af6b773a None None] MFA Rules not processed for user `16846111ee2a42dd99c3052d40980f72`. Rule list: `[]` (Enabled: `True`). {{(pid=86655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:50:45.635286 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-a6b385de-5544-43e7-a02b-7907af6b773a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:50:45.651927 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=100 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:50:45.705314 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 759/1518] 10.222.0.73 () {58 vars in 1015 bytes} [Thu Jul 14 10:50:45 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:50:49.565329 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4630c67f-b428-41fe-918f-97ce5524cada None None] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:50:49.565888 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4630c67f-b428-41fe-918f-97ce5524cada None None] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:50:49.565888 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4630c67f-b428-41fe-918f-97ce5524cada None None] PATH_INFO: `/` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:50:49.567493 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 760/1519] 10.222.0.16 () {54 vars in 960 bytes} [Thu Jul 14 10:50:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:50:49.572413 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437223ac-c0be-49f7-88de-e9c45ca7dd35 None None] REQUEST_METHOD: `POST` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:50:49.572840 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437223ac-c0be-49f7-88de-e9c45ca7dd35 None None] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:50:49.573114 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437223ac-c0be-49f7-88de-e9c45ca7dd35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:50:49.590699 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.auth.core [None req-437223ac-c0be-49f7-88de-e9c45ca7dd35 None None] MFA Rules not processed for user `16846111ee2a42dd99c3052d40980f72`. Rule list: `[]` (Enabled: `True`). {{(pid=86655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:50:49.591887 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-437223ac-c0be-49f7-88de-e9c45ca7dd35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:50:49.600324 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 760/1520] 10.222.0.16 () {58 vars in 1057 bytes} [Thu Jul 14 10:50:49 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:50:49.608341 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4630c67f-b428-41fe-918f-97ce5524cada None None] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:50:49.622164 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4630c67f-b428-41fe-918f-97ce5524cada None None] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:50:49.627085 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f6d0be-f990-423c-8336-480715be581a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16846111ee2a42dd99c3052d40980f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59391272ecbe48b0aa736cb43807be1d', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:50:49.627719 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f6d0be-f990-423c-8336-480715be581a service placement] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:50:49.628004 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f6d0be-f990-423c-8336-480715be581a service placement] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:50:49.628282 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f6d0be-f990-423c-8336-480715be581a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:50:49.636483 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f6d0be-f990-423c-8336-480715be581a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:50:49.638092 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f6d0be-f990-423c-8336-480715be581a service placement] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:50:49.647586 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 761/1521] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jul 14 10:50:49 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:50:56.367214 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a611c9a-1f89-432c-9e29-bde68b54aaa2 None None] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:50:56.367767 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a611c9a-1f89-432c-9e29-bde68b54aaa2 None None] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:50:56.367767 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a611c9a-1f89-432c-9e29-bde68b54aaa2 None None] PATH_INFO: `/` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:50:56.369091 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 761/1522] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 14 10:50:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:50:56.373744 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54554311-ad7d-4db2-9180-47c670c58296 None None] REQUEST_METHOD: `POST` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:50:56.374170 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54554311-ad7d-4db2-9180-47c670c58296 None None] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:50:56.374318 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54554311-ad7d-4db2-9180-47c670c58296 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:50:56.392571 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.auth.core [None req-54554311-ad7d-4db2-9180-47c670c58296 None None] MFA Rules not processed for user `ae4bcdd8106d4bebbdcae96be33505bc`. Rule list: `[]` (Enabled: `True`). {{(pid=86656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:50:56.393796 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-54554311-ad7d-4db2-9180-47c670c58296 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:50:56.402284 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 762/1523] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 14 10:50:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:50:56.558780 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a611c9a-1f89-432c-9e29-bde68b54aaa2 None None] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:50:56.574035 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a611c9a-1f89-432c-9e29-bde68b54aaa2 None None] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:50:56.579514 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f9fbff-32d4-468f-8d11-0bb682153681 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26aa294c913c408499a913ec25bb677d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59391272ecbe48b0aa736cb43807be1d', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:50:56.580144 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f9fbff-32d4-468f-8d11-0bb682153681 service nova] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:50:56.580428 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f9fbff-32d4-468f-8d11-0bb682153681 service nova] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:50:56.580702 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f9fbff-32d4-468f-8d11-0bb682153681 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:50:56.588790 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f9fbff-32d4-468f-8d11-0bb682153681 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:50:56.590370 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f9fbff-32d4-468f-8d11-0bb682153681 service nova] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:50:56.599617 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 762/1524] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jul 14 10:50:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:50:57.428038 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f89fc7-638a-455d-a3aa-dbe893e33098 None None] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:50:57.428618 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f89fc7-638a-455d-a3aa-dbe893e33098 None None] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:50:57.428618 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f89fc7-638a-455d-a3aa-dbe893e33098 None None] PATH_INFO: `/` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:50:57.430145 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 763/1525] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 14 10:50:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:50:57.434919 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558d105c-d0c4-463c-898d-9abaf301e279 None None] REQUEST_METHOD: `POST` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:50:57.435325 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558d105c-d0c4-463c-898d-9abaf301e279 None None] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:50:57.435471 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558d105c-d0c4-463c-898d-9abaf301e279 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:50:57.453500 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.auth.core [None req-558d105c-d0c4-463c-898d-9abaf301e279 None None] MFA Rules not processed for user `ae4bcdd8106d4bebbdcae96be33505bc`. Rule list: `[]` (Enabled: `True`). {{(pid=86655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:50:57.454687 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-558d105c-d0c4-463c-898d-9abaf301e279 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:50:57.463001 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 763/1526] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 14 10:50:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:50:57.617715 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f89fc7-638a-455d-a3aa-dbe893e33098 None None] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:50:57.631874 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f89fc7-638a-455d-a3aa-dbe893e33098 None None] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:50:57.637368 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b32afa5-1d85-436f-bd20-919113818a0a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26aa294c913c408499a913ec25bb677d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59391272ecbe48b0aa736cb43807be1d', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:50:57.638018 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b32afa5-1d85-436f-bd20-919113818a0a service nova] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:50:57.638308 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b32afa5-1d85-436f-bd20-919113818a0a service nova] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:50:57.638592 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b32afa5-1d85-436f-bd20-919113818a0a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:50:57.646705 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b32afa5-1d85-436f-bd20-919113818a0a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:50:57.648845 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b32afa5-1d85-436f-bd20-919113818a0a service nova] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:50:57.658191 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 764/1527] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jul 14 10:50:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 10:51:01.393658 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d861b8-e4cb-48e3-bb12-f86e735cd19f None None] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:51:01.394312 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d861b8-e4cb-48e3-bb12-f86e735cd19f None None] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:51:01.394312 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d861b8-e4cb-48e3-bb12-f86e735cd19f None None] PATH_INFO: `/` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:51:01.395610 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 764/1528] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 14 10:51:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:51:01.401562 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9ab413-a314-4b27-8ec7-8f1c460c5705 None None] REQUEST_METHOD: `POST` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:51:01.401966 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9ab413-a314-4b27-8ec7-8f1c460c5705 None None] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:51:01.402123 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9ab413-a314-4b27-8ec7-8f1c460c5705 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:51:01.420487 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.auth.core [None req-7d9ab413-a314-4b27-8ec7-8f1c460c5705 None None] MFA Rules not processed for user `ae4bcdd8106d4bebbdcae96be33505bc`. Rule list: `[]` (Enabled: `True`). {{(pid=86656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:51:01.421721 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-7d9ab413-a314-4b27-8ec7-8f1c460c5705 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:51:01.429573 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 765/1529] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 14 10:51:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:51:01.501499 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d861b8-e4cb-48e3-bb12-f86e735cd19f None None] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:51:01.503172 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-67d861b8-e4cb-48e3-bb12-f86e735cd19f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:51:01.582399 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d861b8-e4cb-48e3-bb12-f86e735cd19f None None] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:51:01.585925 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2f324a-33af-473f-aae0-ca3784b0f61b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dddf93691844886982c91fea974385d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59391272ecbe48b0aa736cb43807be1d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:51:01.587191 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2f324a-33af-473f-aae0-ca3784b0f61b service neutron] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:51:01.587476 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2f324a-33af-473f-aae0-ca3784b0f61b service neutron] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:51:01.587757 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2f324a-33af-473f-aae0-ca3784b0f61b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:51:01.596564 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2f324a-33af-473f-aae0-ca3784b0f61b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:51:01.598038 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2f324a-33af-473f-aae0-ca3784b0f61b service neutron] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:51:01.607504 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 765/1530] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jul 14 10:51:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:51:03.630858 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb7b44a-c0e0-455c-8313-db6ea0427adc None None] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:51:03.631383 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb7b44a-c0e0-455c-8313-db6ea0427adc None None] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:51:03.631383 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb7b44a-c0e0-455c-8313-db6ea0427adc None None] PATH_INFO: `/` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:51:03.632724 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 766/1531] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 14 10:51:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:51:03.638001 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9660ec-32f6-48b3-95f3-910e90e731a4 None None] REQUEST_METHOD: `POST` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:51:03.638426 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9660ec-32f6-48b3-95f3-910e90e731a4 None None] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:51:03.638563 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9660ec-32f6-48b3-95f3-910e90e731a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:51:03.656182 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.auth.core [None req-1f9660ec-32f6-48b3-95f3-910e90e731a4 None None] MFA Rules not processed for user `ae4bcdd8106d4bebbdcae96be33505bc`. Rule list: `[]` (Enabled: `True`). {{(pid=86655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:51:03.657410 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-1f9660ec-32f6-48b3-95f3-910e90e731a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:51:03.665956 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 766/1532] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 14 10:51:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:51:03.701790 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb7b44a-c0e0-455c-8313-db6ea0427adc None None] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:51:03.713068 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb7b44a-c0e0-455c-8313-db6ea0427adc None None] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:51:03.716587 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d5d10e-d3f7-4588-bdf5-d361559294c5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dddf93691844886982c91fea974385d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59391272ecbe48b0aa736cb43807be1d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:51:03.717274 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d5d10e-d3f7-4588-bdf5-d361559294c5 service neutron] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:51:03.717560 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d5d10e-d3f7-4588-bdf5-d361559294c5 service neutron] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:51:03.717837 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d5d10e-d3f7-4588-bdf5-d361559294c5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:51:03.726771 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d5d10e-d3f7-4588-bdf5-d361559294c5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:51:03.728333 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d5d10e-d3f7-4588-bdf5-d361559294c5 service neutron] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:51:03.737701 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 767/1533] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jul 14 10:51:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:51:07.216477 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85696c3-1789-40ed-9c02-e04314a2964d None None] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:51:07.217100 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85696c3-1789-40ed-9c02-e04314a2964d None None] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:51:07.217496 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85696c3-1789-40ed-9c02-e04314a2964d None None] PATH_INFO: `/` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:51:07.218880 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 767/1534] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 14 10:51:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:51:07.225159 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6453be9-9a5a-4fe9-b7cb-a19b1e8ac438 None None] REQUEST_METHOD: `POST` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:51:07.225625 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6453be9-9a5a-4fe9-b7cb-a19b1e8ac438 None None] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:51:07.225723 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6453be9-9a5a-4fe9-b7cb-a19b1e8ac438 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:51:07.245591 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.auth.core [None req-a6453be9-9a5a-4fe9-b7cb-a19b1e8ac438 None None] MFA Rules not processed for user `ae4bcdd8106d4bebbdcae96be33505bc`. Rule list: `[]` (Enabled: `True`). {{(pid=86656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:51:07.246811 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-a6453be9-9a5a-4fe9-b7cb-a19b1e8ac438 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:51:07.254753 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 768/1535] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 14 10:51:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:51:07.555079 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85696c3-1789-40ed-9c02-e04314a2964d None None] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:51:07.557640 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-b85696c3-1789-40ed-9c02-e04314a2964d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:51:07.628333 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=100 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:51:07.642274 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85696c3-1789-40ed-9c02-e04314a2964d None None] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:51:07.645881 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d03803-e3c6-4e93-8973-0666b2abd7af service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68382432147a48c3b62271fd2a2eab04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59391272ecbe48b0aa736cb43807be1d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:51:07.646535 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d03803-e3c6-4e93-8973-0666b2abd7af service cinder] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:51:07.646825 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d03803-e3c6-4e93-8973-0666b2abd7af service cinder] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:51:07.647109 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d03803-e3c6-4e93-8973-0666b2abd7af service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:51:07.656641 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d03803-e3c6-4e93-8973-0666b2abd7af service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:51:07.658108 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d03803-e3c6-4e93-8973-0666b2abd7af service cinder] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:51:07.668505 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 768/1536] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jul 14 10:51:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:51:09.716344 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b84df0-3f95-4999-a6d3-de529df0f1f8 None None] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:51:09.716940 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b84df0-3f95-4999-a6d3-de529df0f1f8 None None] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:51:09.716940 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b84df0-3f95-4999-a6d3-de529df0f1f8 None None] PATH_INFO: `/` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:51:09.718339 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 769/1537] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 14 10:51:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:51:09.723573 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43970fe8-c95a-4682-b964-b8d315eb9431 None None] REQUEST_METHOD: `POST` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:51:09.724000 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43970fe8-c95a-4682-b964-b8d315eb9431 None None] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:51:09.724135 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43970fe8-c95a-4682-b964-b8d315eb9431 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:51:09.742827 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.auth.core [None req-43970fe8-c95a-4682-b964-b8d315eb9431 None None] MFA Rules not processed for user `ae4bcdd8106d4bebbdcae96be33505bc`. Rule list: `[]` (Enabled: `True`). {{(pid=86655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:51:09.744098 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-43970fe8-c95a-4682-b964-b8d315eb9431 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:51:09.751873 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 769/1538] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 14 10:51:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 10:51:10.050575 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b84df0-3f95-4999-a6d3-de529df0f1f8 None None] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:51:10.052234 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-53b84df0-3f95-4999-a6d3-de529df0f1f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:51:10.060296 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=84 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:51:10.067043 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b84df0-3f95-4999-a6d3-de529df0f1f8 None None] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:51:10.070535 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7a3828-b20a-4d9d-8d24-77dc513b2e6f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68382432147a48c3b62271fd2a2eab04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59391272ecbe48b0aa736cb43807be1d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:51:10.072074 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7a3828-b20a-4d9d-8d24-77dc513b2e6f service cinder] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:51:10.072368 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7a3828-b20a-4d9d-8d24-77dc513b2e6f service cinder] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:51:10.072649 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7a3828-b20a-4d9d-8d24-77dc513b2e6f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:51:10.081696 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7a3828-b20a-4d9d-8d24-77dc513b2e6f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:51:10.083122 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7a3828-b20a-4d9d-8d24-77dc513b2e6f service cinder] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:51:10.092803 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 770/1539] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jul 14 10:51:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:51:19.736915 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=11 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:51:20.088591 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=5 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:52:46.370612 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6fdc9a-3206-47ca-bbda-6fae153a8f30 None None] REQUEST_METHOD: `POST` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:52:46.372482 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6fdc9a-3206-47ca-bbda-6fae153a8f30 None None] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:52:46.372482 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6fdc9a-3206-47ca-bbda-6fae153a8f30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:52:46.395028 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.auth.core [None req-5a6fdc9a-3206-47ca-bbda-6fae153a8f30 None None] MFA Rules not processed for user `ae4bcdd8106d4bebbdcae96be33505bc`. Rule list: `[]` (Enabled: `True`). {{(pid=86655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:52:46.396270 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-5a6fdc9a-3206-47ca-bbda-6fae153a8f30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:52:46.410308 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 770/1540] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jul 14 10:52:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:52:46.425571 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720e68fd-ca82-4edd-bcb7-6184cc5e6bf9 None None] REQUEST_METHOD: `POST` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:52:46.426646 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720e68fd-ca82-4edd-bcb7-6184cc5e6bf9 None None] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:52:46.427172 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720e68fd-ca82-4edd-bcb7-6184cc5e6bf9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:52:46.460735 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.auth.core [None req-720e68fd-ca82-4edd-bcb7-6184cc5e6bf9 None None] MFA Rules not processed for user `ae4bcdd8106d4bebbdcae96be33505bc`. Rule list: `[]` (Enabled: `True`). {{(pid=86656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:52:46.462232 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-720e68fd-ca82-4edd-bcb7-6184cc5e6bf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:52:46.480002 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 771/1541] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jul 14 10:52:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:52:46.487249 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6fdc9a-3206-47ca-bbda-6fae153a8f30 None None] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:52:46.506732 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6fdc9a-3206-47ca-bbda-6fae153a8f30 None None] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:52:46.515909 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97dadff1-0cbb-4d59-b75b-cd9bde6b9675 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:52:46.517043 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97dadff1-0cbb-4d59-b75b-cd9bde6b9675 admin admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:52:46.517551 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97dadff1-0cbb-4d59-b75b-cd9bde6b9675 admin admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:52:46.518052 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97dadff1-0cbb-4d59-b75b-cd9bde6b9675 admin admin] PATH_INFO: `/v3/domains` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:52:46.519031 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97dadff1-0cbb-4d59-b75b-cd9bde6b9675 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:52:46.520393 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97dadff1-0cbb-4d59-b75b-cd9bde6b9675 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:52:46.522670 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97dadff1-0cbb-4d59-b75b-cd9bde6b9675 admin admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:52:46.549327 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 771/1542] 10.222.0.16 () {58 vars in 1152 bytes} [Thu Jul 14 10:52:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 10:52:46.558117 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720e68fd-ca82-4edd-bcb7-6184cc5e6bf9 None None] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:52:46.574877 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720e68fd-ca82-4edd-bcb7-6184cc5e6bf9 None None] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:52:46.588717 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb0556d-7f0d-4bdf-8a41-527eb2cd6b96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:52:46.589433 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb0556d-7f0d-4bdf-8a41-527eb2cd6b96 admin admin] REQUEST_METHOD: `POST` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:52:46.589721 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb0556d-7f0d-4bdf-8a41-527eb2cd6b96 admin admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:52:46.590001 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb0556d-7f0d-4bdf-8a41-527eb2cd6b96 admin admin] PATH_INFO: `/v3/projects` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:52:46.590729 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb0556d-7f0d-4bdf-8a41-527eb2cd6b96 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:52:46.594288 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb0556d-7f0d-4bdf-8a41-527eb2cd6b96 admin admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:52:46.649656 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 772/1543] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Jul 14 10:52:46 2022] POST /identity/v3/projects => generated 391 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:52:46.654304 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97dadff1-0cbb-4d59-b75b-cd9bde6b9675 admin admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:52:46.672208 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97dadff1-0cbb-4d59-b75b-cd9bde6b9675 admin admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:52:46.750610 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bed9366-ccd9-4594-b751-e997bc93aeea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:52:46.751684 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bed9366-ccd9-4594-b751-e997bc93aeea admin admin] REQUEST_METHOD: `POST` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:52:46.752236 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bed9366-ccd9-4594-b751-e997bc93aeea admin admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:52:46.752728 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bed9366-ccd9-4594-b751-e997bc93aeea admin admin] PATH_INFO: `/v3/users` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:52:46.753686 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bed9366-ccd9-4594-b751-e997bc93aeea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:52:46.755822 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bed9366-ccd9-4594-b751-e997bc93aeea admin admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:52:46.796905 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 772/1544] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Jul 14 10:52:46 2022] POST /identity/v3/users => generated 296 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:52:46.800589 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11ae7f6-0b36-4c0a-b6f9-3182267310f2 None None] REQUEST_METHOD: `POST` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:52:46.801153 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11ae7f6-0b36-4c0a-b6f9-3182267310f2 None None] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:52:46.801689 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11ae7f6-0b36-4c0a-b6f9-3182267310f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:52:46.809927 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bed9366-ccd9-4594-b751-e997bc93aeea admin admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:52:46.822532 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bed9366-ccd9-4594-b751-e997bc93aeea admin admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:52:46.837817 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.auth.core [None req-f11ae7f6-0b36-4c0a-b6f9-3182267310f2 None None] MFA Rules not processed for user `ae4bcdd8106d4bebbdcae96be33505bc`. Rule list: `[]` (Enabled: `True`). {{(pid=86656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:52:46.839603 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-f11ae7f6-0b36-4c0a-b6f9-3182267310f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:52:46.845671 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deca9362-9f9e-4d1c-80ac-065078ad49da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:52:46.846430 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deca9362-9f9e-4d1c-80ac-065078ad49da admin admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:52:46.846720 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deca9362-9f9e-4d1c-80ac-065078ad49da admin admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:52:46.846998 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deca9362-9f9e-4d1c-80ac-065078ad49da admin admin] PATH_INFO: `/v3/roles` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:52:46.847803 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deca9362-9f9e-4d1c-80ac-065078ad49da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:52:46.849617 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deca9362-9f9e-4d1c-80ac-065078ad49da admin admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:52:46.859749 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 773/1545] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jul 14 10:52:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:52:46.861426 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960906ef-228b-41ea-a20f-ce266ff50fa1 None None] REQUEST_METHOD: `POST` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:52:46.862004 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960906ef-228b-41ea-a20f-ce266ff50fa1 None None] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:52:46.862516 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960906ef-228b-41ea-a20f-ce266ff50fa1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:52:46.866227 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 773/1546] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jul 14 10:52:46 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:52:46.870698 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deca9362-9f9e-4d1c-80ac-065078ad49da admin admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:52:46.884683 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deca9362-9f9e-4d1c-80ac-065078ad49da admin admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:52:46.890310 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.auth.core [None req-960906ef-228b-41ea-a20f-ce266ff50fa1 None None] MFA Rules not processed for user `ae4bcdd8106d4bebbdcae96be33505bc`. Rule list: `[]` (Enabled: `True`). {{(pid=86656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:52:46.892234 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-960906ef-228b-41ea-a20f-ce266ff50fa1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:52:46.900487 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9de43d-6491-49af-9104-977abe84f19c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:52:46.901511 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9de43d-6491-49af-9104-977abe84f19c admin admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:52:46.902351 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9de43d-6491-49af-9104-977abe84f19c admin admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:52:46.903545 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9de43d-6491-49af-9104-977abe84f19c admin admin] PATH_INFO: `/v3/roles` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:52:46.906946 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9de43d-6491-49af-9104-977abe84f19c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:52:46.908991 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9de43d-6491-49af-9104-977abe84f19c admin admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:52:46.909507 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 774/1547] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jul 14 10:52:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:52:46.911083 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c32c3b-eb79-4e09-b2a6-31ad8b40c061 None None] REQUEST_METHOD: `POST` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:52:46.912690 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c32c3b-eb79-4e09-b2a6-31ad8b40c061 None None] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:52:46.913606 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c32c3b-eb79-4e09-b2a6-31ad8b40c061 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:52:46.938859 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 774/1548] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jul 14 10:52:46 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:52:46.940580 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621b02f2-c316-4ae2-97cb-7bd23ea11333 None None] REQUEST_METHOD: `POST` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:52:46.943188 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621b02f2-c316-4ae2-97cb-7bd23ea11333 None None] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:52:46.948295 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621b02f2-c316-4ae2-97cb-7bd23ea11333 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:52:46.954075 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.auth.core [None req-e7c32c3b-eb79-4e09-b2a6-31ad8b40c061 None None] MFA Rules not processed for user `ae4bcdd8106d4bebbdcae96be33505bc`. Rule list: `[]` (Enabled: `True`). {{(pid=86656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:52:46.955632 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-e7c32c3b-eb79-4e09-b2a6-31ad8b40c061 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:52:46.975347 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 775/1549] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jul 14 10:52:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:52:46.977149 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b50fdf2-ab73-41f0-bbd9-99193686da77 None None] REQUEST_METHOD: `POST` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:52:46.977618 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b50fdf2-ab73-41f0-bbd9-99193686da77 None None] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:52:46.978682 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b50fdf2-ab73-41f0-bbd9-99193686da77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:52:46.982474 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.auth.core [None req-621b02f2-c316-4ae2-97cb-7bd23ea11333 None None] MFA Rules not processed for user `ae4bcdd8106d4bebbdcae96be33505bc`. Rule list: `[]` (Enabled: `True`). {{(pid=86655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:52:46.985174 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-621b02f2-c316-4ae2-97cb-7bd23ea11333 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:52:46.996047 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 775/1550] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jul 14 10:52:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:52:46.999828 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77c2eb0-edd9-465e-8494-aa3c04b8ca92 None None] REQUEST_METHOD: `POST` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:52:46.999828 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77c2eb0-edd9-465e-8494-aa3c04b8ca92 None None] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:52:46.999828 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77c2eb0-edd9-465e-8494-aa3c04b8ca92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:52:47.002285 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.auth.core [None req-9b50fdf2-ab73-41f0-bbd9-99193686da77 None None] MFA Rules not processed for user `ae4bcdd8106d4bebbdcae96be33505bc`. Rule list: `[]` (Enabled: `True`). {{(pid=86656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:52:47.003512 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-9b50fdf2-ab73-41f0-bbd9-99193686da77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:52:47.012478 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 776/1551] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jul 14 10:52:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:52:47.013178 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b50fdf2-ab73-41f0-bbd9-99193686da77 None None] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:52:47.020118 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.auth.core [None req-e77c2eb0-edd9-465e-8494-aa3c04b8ca92 None None] MFA Rules not processed for user `ae4bcdd8106d4bebbdcae96be33505bc`. Rule list: `[]` (Enabled: `True`). {{(pid=86655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:52:47.021444 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-e77c2eb0-edd9-465e-8494-aa3c04b8ca92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:52:47.023681 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b50fdf2-ab73-41f0-bbd9-99193686da77 None None] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:52:47.028209 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607bdf37-3b07-4a92-9b49-4ce8876f1ca0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:52:47.029124 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607bdf37-3b07-4a92-9b49-4ce8876f1ca0 admin admin] REQUEST_METHOD: `PUT` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:52:47.029413 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607bdf37-3b07-4a92-9b49-4ce8876f1ca0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:52:47.029782 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 776/1552] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jul 14 10:52:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:52:47.029959 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607bdf37-3b07-4a92-9b49-4ce8876f1ca0 admin admin] PATH_INFO: `/v3/projects/d780859dfe7b4a998388a3af7491e7b8/users/fae8e5bd232344cca09294651f4cd93e/roles/0da46c267d354cce81495dfdd56c1ec2` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:52:47.035101 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b641bdbf-70fc-4ce4-b1aa-4aed76f30993 None None] REQUEST_METHOD: `POST` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:52:47.035101 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b641bdbf-70fc-4ce4-b1aa-4aed76f30993 None None] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:52:47.035101 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b641bdbf-70fc-4ce4-b1aa-4aed76f30993 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:52:47.045557 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607bdf37-3b07-4a92-9b49-4ce8876f1ca0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d780859dfe7b4a998388a3af7491e7b8, user_id=fae8e5bd232344cca09294651f4cd93e, role_id=0da46c267d354cce81495dfdd56c1ec2)` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:52:47.048326 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607bdf37-3b07-4a92-9b49-4ce8876f1ca0 admin admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:52:47.052655 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.auth.core [None req-b641bdbf-70fc-4ce4-b1aa-4aed76f30993 None None] MFA Rules not processed for user `ae4bcdd8106d4bebbdcae96be33505bc`. Rule list: `[]` (Enabled: `True`). {{(pid=86655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:52:47.053928 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-b641bdbf-70fc-4ce4-b1aa-4aed76f30993 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:52:47.062268 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 777/1553] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Jul 14 10:52:47 2022] PUT /identity/v3/projects/d780859dfe7b4a998388a3af7491e7b8/users/fae8e5bd232344cca09294651f4cd93e/roles/0da46c267d354cce81495dfdd56c1ec2 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:52:47.063726 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182085e7-7b67-4fa8-b57c-e73342ee3397 None None] REQUEST_METHOD: `POST` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:52:47.064088 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182085e7-7b67-4fa8-b57c-e73342ee3397 None None] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:52:47.064467 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182085e7-7b67-4fa8-b57c-e73342ee3397 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:52:47.084430 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.auth.core [None req-182085e7-7b67-4fa8-b57c-e73342ee3397 None None] MFA Rules not processed for user `ae4bcdd8106d4bebbdcae96be33505bc`. Rule list: `[]` (Enabled: `True`). {{(pid=86656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:52:47.085798 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-182085e7-7b67-4fa8-b57c-e73342ee3397 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:52:47.115165 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 777/1554] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jul 14 10:52:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:52:47.116018 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b641bdbf-70fc-4ce4-b1aa-4aed76f30993 None None] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:52:47.126209 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b641bdbf-70fc-4ce4-b1aa-4aed76f30993 None None] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:52:47.130806 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46066023-38c4-4e62-96c9-ae15a1799d0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:52:47.131546 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46066023-38c4-4e62-96c9-ae15a1799d0b admin admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:52:47.131903 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46066023-38c4-4e62-96c9-ae15a1799d0b admin admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:52:47.132343 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46066023-38c4-4e62-96c9-ae15a1799d0b admin admin] PATH_INFO: `/v3/domains` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:52:47.133136 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46066023-38c4-4e62-96c9-ae15a1799d0b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:52:47.133446 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46066023-38c4-4e62-96c9-ae15a1799d0b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:52:47.135045 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46066023-38c4-4e62-96c9-ae15a1799d0b admin admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:52:47.147564 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 778/1555] 10.222.0.16 () {58 vars in 1152 bytes} [Thu Jul 14 10:52:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:52:47.148620 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46066023-38c4-4e62-96c9-ae15a1799d0b admin admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:52:47.153034 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 778/1556] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jul 14 10:52:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:52:47.154394 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49432b6-91f4-4e9e-a692-7bf4cfdd6dbc None None] REQUEST_METHOD: `POST` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:52:47.154720 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49432b6-91f4-4e9e-a692-7bf4cfdd6dbc None None] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:52:47.155185 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49432b6-91f4-4e9e-a692-7bf4cfdd6dbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:52:47.165484 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46066023-38c4-4e62-96c9-ae15a1799d0b admin admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:52:47.170079 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db5f767-6c73-43fe-b92c-3b4ee5319d1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:52:47.171278 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db5f767-6c73-43fe-b92c-3b4ee5319d1d admin admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:52:47.171554 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db5f767-6c73-43fe-b92c-3b4ee5319d1d admin admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:52:47.171853 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db5f767-6c73-43fe-b92c-3b4ee5319d1d admin admin] PATH_INFO: `/v3/domains` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:52:47.172569 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db5f767-6c73-43fe-b92c-3b4ee5319d1d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:52:47.172890 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db5f767-6c73-43fe-b92c-3b4ee5319d1d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:52:47.174478 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db5f767-6c73-43fe-b92c-3b4ee5319d1d admin admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:52:47.176331 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.auth.core [None req-e49432b6-91f4-4e9e-a692-7bf4cfdd6dbc None None] MFA Rules not processed for user `ae4bcdd8106d4bebbdcae96be33505bc`. Rule list: `[]` (Enabled: `True`). {{(pid=86656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:52:47.177578 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-e49432b6-91f4-4e9e-a692-7bf4cfdd6dbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:52:47.187181 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 779/1557] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jul 14 10:52:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:52:47.188550 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db776005-07fe-4b90-b2dd-be9b45add31b None None] REQUEST_METHOD: `POST` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:52:47.189005 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db776005-07fe-4b90-b2dd-be9b45add31b None None] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:52:47.189389 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db776005-07fe-4b90-b2dd-be9b45add31b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:52:47.194340 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 779/1558] 10.222.0.16 () {58 vars in 1152 bytes} [Thu Jul 14 10:52:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:52:47.195682 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c9a203-ee81-4382-b9a1-a77a21110a53 None None] REQUEST_METHOD: `POST` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:52:47.195974 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c9a203-ee81-4382-b9a1-a77a21110a53 None None] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:52:47.196251 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c9a203-ee81-4382-b9a1-a77a21110a53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:52:47.208561 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.auth.core [None req-db776005-07fe-4b90-b2dd-be9b45add31b None None] MFA Rules not processed for user `ae4bcdd8106d4bebbdcae96be33505bc`. Rule list: `[]` (Enabled: `True`). {{(pid=86656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:52:47.209878 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-db776005-07fe-4b90-b2dd-be9b45add31b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:52:47.214584 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.auth.core [None req-36c9a203-ee81-4382-b9a1-a77a21110a53 None None] MFA Rules not processed for user `ae4bcdd8106d4bebbdcae96be33505bc`. Rule list: `[]` (Enabled: `True`). {{(pid=86655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:52:47.215751 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-36c9a203-ee81-4382-b9a1-a77a21110a53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:52:47.218539 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 780/1559] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jul 14 10:52:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:52:47.219752 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1a70fb-0fb5-47e7-a38a-f42a2609aabc None None] REQUEST_METHOD: `POST` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:52:47.220049 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1a70fb-0fb5-47e7-a38a-f42a2609aabc None None] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:52:47.220332 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1a70fb-0fb5-47e7-a38a-f42a2609aabc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:52:47.224317 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 780/1560] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jul 14 10:52:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:52:47.225553 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa4deda-a9a4-4bd6-9d7b-eaabc9d3ef72 None None] REQUEST_METHOD: `POST` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:52:47.225843 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa4deda-a9a4-4bd6-9d7b-eaabc9d3ef72 None None] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:52:47.226120 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa4deda-a9a4-4bd6-9d7b-eaabc9d3ef72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:52:47.234273 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:52:47.240609 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.auth.core [None req-7a1a70fb-0fb5-47e7-a38a-f42a2609aabc None None] MFA Rules not processed for user `ae4bcdd8106d4bebbdcae96be33505bc`. Rule list: `[]` (Enabled: `True`). {{(pid=86656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:52:47.242599 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-7a1a70fb-0fb5-47e7-a38a-f42a2609aabc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:52:47.247517 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.auth.core [None req-eaa4deda-a9a4-4bd6-9d7b-eaabc9d3ef72 None None] MFA Rules not processed for user `ae4bcdd8106d4bebbdcae96be33505bc`. Rule list: `[]` (Enabled: `True`). {{(pid=86655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:52:47.249495 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-eaa4deda-a9a4-4bd6-9d7b-eaabc9d3ef72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:52:47.251623 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 781/1561] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jul 14 10:52:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:52:47.252398 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1a70fb-0fb5-47e7-a38a-f42a2609aabc None None] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:52:47.257816 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 781/1562] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jul 14 10:52:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:52:47.259060 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da476f73-1312-4911-8d91-3cba9db81385 None None] REQUEST_METHOD: `POST` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:52:47.259347 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da476f73-1312-4911-8d91-3cba9db81385 None None] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:52:47.259619 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da476f73-1312-4911-8d91-3cba9db81385 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:52:47.262254 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1a70fb-0fb5-47e7-a38a-f42a2609aabc None None] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:52:47.267665 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32940d9c-1d1c-41f2-85a1-e6902326853b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:52:47.268330 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32940d9c-1d1c-41f2-85a1-e6902326853b admin admin] REQUEST_METHOD: `POST` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:52:47.268617 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32940d9c-1d1c-41f2-85a1-e6902326853b admin admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:52:47.268932 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32940d9c-1d1c-41f2-85a1-e6902326853b admin admin] PATH_INFO: `/v3/projects` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:52:47.269638 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32940d9c-1d1c-41f2-85a1-e6902326853b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:52:47.271549 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32940d9c-1d1c-41f2-85a1-e6902326853b admin admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:52:47.277809 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.auth.core [None req-da476f73-1312-4911-8d91-3cba9db81385 None None] MFA Rules not processed for user `ae4bcdd8106d4bebbdcae96be33505bc`. Rule list: `[]` (Enabled: `True`). {{(pid=86655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:52:47.279011 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-da476f73-1312-4911-8d91-3cba9db81385 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:52:47.289067 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 782/1563] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jul 14 10:52:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:52:47.290723 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc317d4f-98b7-4e10-a09f-98521c4351cd None None] REQUEST_METHOD: `POST` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:52:47.291077 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc317d4f-98b7-4e10-a09f-98521c4351cd None None] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:52:47.291974 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc317d4f-98b7-4e10-a09f-98521c4351cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:52:47.299916 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 782/1564] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Jul 14 10:52:47 2022] POST /identity/v3/projects => generated 371 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:52:47.300735 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32940d9c-1d1c-41f2-85a1-e6902326853b admin admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:52:47.312564 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.auth.core [None req-fc317d4f-98b7-4e10-a09f-98521c4351cd None None] MFA Rules not processed for user `ae4bcdd8106d4bebbdcae96be33505bc`. Rule list: `[]` (Enabled: `True`). {{(pid=86655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:52:47.313839 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-fc317d4f-98b7-4e10-a09f-98521c4351cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:52:47.333743 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:52:47.364979 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32940d9c-1d1c-41f2-85a1-e6902326853b admin admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:52:47.370048 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a497f920-2260-41d1-9959-b5bf6fb5c003 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:52:47.370699 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a497f920-2260-41d1-9959-b5bf6fb5c003 admin admin] REQUEST_METHOD: `POST` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:52:47.370979 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a497f920-2260-41d1-9959-b5bf6fb5c003 admin admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:52:47.371250 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a497f920-2260-41d1-9959-b5bf6fb5c003 admin admin] PATH_INFO: `/v3/projects` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:52:47.371936 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a497f920-2260-41d1-9959-b5bf6fb5c003 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:52:47.374488 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a497f920-2260-41d1-9959-b5bf6fb5c003 admin admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:52:47.375320 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 783/1565] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jul 14 10:52:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:52:47.376159 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc317d4f-98b7-4e10-a09f-98521c4351cd None None] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:52:47.385566 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc317d4f-98b7-4e10-a09f-98521c4351cd None None] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:52:47.391366 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ef9f88-40b1-4262-8ef0-982bc9aa1d91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:52:47.392048 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ef9f88-40b1-4262-8ef0-982bc9aa1d91 admin admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:52:47.392818 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ef9f88-40b1-4262-8ef0-982bc9aa1d91 admin admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:52:47.393240 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ef9f88-40b1-4262-8ef0-982bc9aa1d91 admin admin] PATH_INFO: `/v3/domains` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:52:47.394185 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ef9f88-40b1-4262-8ef0-982bc9aa1d91 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:52:47.394727 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ef9f88-40b1-4262-8ef0-982bc9aa1d91 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:52:47.396657 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ef9f88-40b1-4262-8ef0-982bc9aa1d91 admin admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:52:47.403827 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 783/1566] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Jul 14 10:52:47 2022] POST /identity/v3/projects => generated 357 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:52:47.404586 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a497f920-2260-41d1-9959-b5bf6fb5c003 admin admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:52:47.419293 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 784/1567] 10.222.0.16 () {58 vars in 1152 bytes} [Thu Jul 14 10:52:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:52:47.419293 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ef9f88-40b1-4262-8ef0-982bc9aa1d91 admin admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:52:47.422685 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ef9f88-40b1-4262-8ef0-982bc9aa1d91 admin admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:52:47.475590 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a497f920-2260-41d1-9959-b5bf6fb5c003 admin admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:52:47.480168 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ece2eb1-d147-4650-a003-09d95629781f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:52:47.480852 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ece2eb1-d147-4650-a003-09d95629781f admin admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:52:47.481139 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ece2eb1-d147-4650-a003-09d95629781f admin admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:52:47.481240 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7b17b3-42c9-4f6d-b698-c5ab8f865c11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:52:47.481416 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ece2eb1-d147-4650-a003-09d95629781f admin admin] PATH_INFO: `/v3/domains` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:52:47.481875 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7b17b3-42c9-4f6d-b698-c5ab8f865c11 admin admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:52:47.482145 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ece2eb1-d147-4650-a003-09d95629781f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:52:47.482251 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7b17b3-42c9-4f6d-b698-c5ab8f865c11 admin admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:52:47.482434 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7b17b3-42c9-4f6d-b698-c5ab8f865c11 admin admin] PATH_INFO: `/v3/domains` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:52:47.482538 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ece2eb1-d147-4650-a003-09d95629781f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:52:47.483254 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7b17b3-42c9-4f6d-b698-c5ab8f865c11 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:52:47.483773 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7b17b3-42c9-4f6d-b698-c5ab8f865c11 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:52:47.483889 dv-cinder-846146-7-smb devstack@keystone.service[86656]: WARNING py.warnings [None req-1ece2eb1-d147-4650-a003-09d95629781f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 10:52:47.483889 dv-cinder-846146-7-smb devstack@keystone.service[86656]: warnings.warn(msg) Jul 14 10:52:47.483889 dv-cinder-846146-7-smb devstack@keystone.service[86656]: Jul 14 10:52:47.484463 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ece2eb1-d147-4650-a003-09d95629781f admin admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:52:47.485264 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7b17b3-42c9-4f6d-b698-c5ab8f865c11 admin admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:52:47.496110 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 784/1568] 10.222.0.16 () {58 vars in 1152 bytes} [Thu Jul 14 10:52:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:52:47.496913 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 785/1569] 10.222.0.16 () {58 vars in 1152 bytes} [Thu Jul 14 10:52:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:52:47.497026 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ece2eb1-d147-4650-a003-09d95629781f admin admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:52:47.497708 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7b17b3-42c9-4f6d-b698-c5ab8f865c11 admin admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:52:47.508212 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7b17b3-42c9-4f6d-b698-c5ab8f865c11 admin admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:52:47.513274 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb1da2f-147b-444f-9220-a10850dc847a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:52:47.513931 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb1da2f-147b-444f-9220-a10850dc847a admin admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:52:47.514220 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb1da2f-147b-444f-9220-a10850dc847a admin admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:52:47.515385 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb1da2f-147b-444f-9220-a10850dc847a admin admin] PATH_INFO: `/v3/domains` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:52:47.516129 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb1da2f-147b-444f-9220-a10850dc847a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:52:47.516439 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb1da2f-147b-444f-9220-a10850dc847a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:52:47.518072 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb1da2f-147b-444f-9220-a10850dc847a admin admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:52:47.530504 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 786/1570] 10.222.0.16 () {58 vars in 1152 bytes} [Thu Jul 14 10:52:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:52:47.531387 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb1da2f-147b-444f-9220-a10850dc847a admin admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:52:47.542396 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb1da2f-147b-444f-9220-a10850dc847a admin admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:52:47.547749 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67a0feb-2d0b-4ad5-82ed-e79785c72e20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:52:47.548413 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67a0feb-2d0b-4ad5-82ed-e79785c72e20 admin admin] REQUEST_METHOD: `POST` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:52:47.548701 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67a0feb-2d0b-4ad5-82ed-e79785c72e20 admin admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:52:47.549011 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67a0feb-2d0b-4ad5-82ed-e79785c72e20 admin admin] PATH_INFO: `/v3/users` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:52:47.549732 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67a0feb-2d0b-4ad5-82ed-e79785c72e20 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:52:47.551659 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67a0feb-2d0b-4ad5-82ed-e79785c72e20 admin admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:52:47.553764 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ece2eb1-d147-4650-a003-09d95629781f admin admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:52:47.557518 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63430ba0-6ad6-44a5-8b5f-3073bd0a3fcc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dddf93691844886982c91fea974385d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59391272ecbe48b0aa736cb43807be1d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:52:47.558169 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63430ba0-6ad6-44a5-8b5f-3073bd0a3fcc service neutron] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:52:47.558453 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63430ba0-6ad6-44a5-8b5f-3073bd0a3fcc service neutron] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:52:47.558731 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63430ba0-6ad6-44a5-8b5f-3073bd0a3fcc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:52:47.569776 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63430ba0-6ad6-44a5-8b5f-3073bd0a3fcc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:52:47.571225 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63430ba0-6ad6-44a5-8b5f-3073bd0a3fcc service neutron] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:52:47.572428 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 787/1571] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Jul 14 10:52:47 2022] POST /identity/v3/users => generated 286 bytes in 41 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:52:47.573359 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67a0feb-2d0b-4ad5-82ed-e79785c72e20 admin admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:52:47.582739 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 785/1572] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jul 14 10:52:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:52:47.583520 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63430ba0-6ad6-44a5-8b5f-3073bd0a3fcc service neutron] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:52:47.585328 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67a0feb-2d0b-4ad5-82ed-e79785c72e20 admin admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:52:47.590280 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa36c80d-089f-40dd-b76c-957657d205bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:52:47.591119 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa36c80d-089f-40dd-b76c-957657d205bd admin admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:52:47.591473 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa36c80d-089f-40dd-b76c-957657d205bd admin admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:52:47.591820 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa36c80d-089f-40dd-b76c-957657d205bd admin admin] PATH_INFO: `/v3/domains` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:52:47.592687 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa36c80d-089f-40dd-b76c-957657d205bd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:52:47.592966 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63430ba0-6ad6-44a5-8b5f-3073bd0a3fcc service neutron] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:52:47.593119 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa36c80d-089f-40dd-b76c-957657d205bd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:52:47.595101 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa36c80d-089f-40dd-b76c-957657d205bd admin admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:52:47.598816 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7866eef-3f2a-4ab4-8041-f498ebaaf42b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:52:47.599173 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7866eef-3f2a-4ab4-8041-f498ebaaf42b admin admin] REQUEST_METHOD: `POST` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:52:47.599520 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7866eef-3f2a-4ab4-8041-f498ebaaf42b admin admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:52:47.599869 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7866eef-3f2a-4ab4-8041-f498ebaaf42b admin admin] PATH_INFO: `/v3/users` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:52:47.600635 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7866eef-3f2a-4ab4-8041-f498ebaaf42b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:52:47.601730 dv-cinder-846146-7-smb devstack@keystone.service[86656]: WARNING py.warnings [None req-d7866eef-3f2a-4ab4-8041-f498ebaaf42b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 14 10:52:47.601730 dv-cinder-846146-7-smb devstack@keystone.service[86656]: warnings.warn(msg) Jul 14 10:52:47.601730 dv-cinder-846146-7-smb devstack@keystone.service[86656]: Jul 14 10:52:47.603205 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7866eef-3f2a-4ab4-8041-f498ebaaf42b admin admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:52:47.613352 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 788/1573] 10.222.0.16 () {58 vars in 1152 bytes} [Thu Jul 14 10:52:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:52:47.613352 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa36c80d-089f-40dd-b76c-957657d205bd admin admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:52:47.625348 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa36c80d-089f-40dd-b76c-957657d205bd admin admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:52:47.630357 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e735d8fb-a4bd-43b5-b2f6-b1781d1be160 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:52:47.630619 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 786/1574] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Jul 14 10:52:47 2022] POST /identity/v3/users => generated 279 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:52:47.631022 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e735d8fb-a4bd-43b5-b2f6-b1781d1be160 admin admin] REQUEST_METHOD: `POST` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:52:47.631372 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e735d8fb-a4bd-43b5-b2f6-b1781d1be160 admin admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:52:47.631671 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e735d8fb-a4bd-43b5-b2f6-b1781d1be160 admin admin] PATH_INFO: `/v3/projects` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:52:47.631784 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7866eef-3f2a-4ab4-8041-f498ebaaf42b admin admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:52:47.632350 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e735d8fb-a4bd-43b5-b2f6-b1781d1be160 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:52:47.633408 dv-cinder-846146-7-smb devstack@keystone.service[86655]: WARNING py.warnings [None req-e735d8fb-a4bd-43b5-b2f6-b1781d1be160 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 14 10:52:47.633408 dv-cinder-846146-7-smb devstack@keystone.service[86655]: warnings.warn(msg) Jul 14 10:52:47.633408 dv-cinder-846146-7-smb devstack@keystone.service[86655]: Jul 14 10:52:47.634583 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e735d8fb-a4bd-43b5-b2f6-b1781d1be160 admin admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:52:47.645672 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7866eef-3f2a-4ab4-8041-f498ebaaf42b admin admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:52:47.651609 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b73345-4efb-4681-86da-49ce7ff7985a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:52:47.652399 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b73345-4efb-4681-86da-49ce7ff7985a admin admin] REQUEST_METHOD: `POST` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:52:47.652668 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b73345-4efb-4681-86da-49ce7ff7985a admin admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:52:47.653053 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b73345-4efb-4681-86da-49ce7ff7985a admin admin] PATH_INFO: `/v3/projects` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:52:47.653689 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b73345-4efb-4681-86da-49ce7ff7985a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:52:47.655905 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b73345-4efb-4681-86da-49ce7ff7985a admin admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:52:47.663356 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 789/1575] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Jul 14 10:52:47 2022] POST /identity/v3/projects => generated 387 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:52:47.664410 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e735d8fb-a4bd-43b5-b2f6-b1781d1be160 admin admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:52:47.674172 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:52:47.690568 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 787/1576] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Jul 14 10:52:47 2022] POST /identity/v3/projects => generated 377 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:52:47.691288 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b73345-4efb-4681-86da-49ce7ff7985a admin admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:52:47.710905 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:52:47.746871 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e735d8fb-a4bd-43b5-b2f6-b1781d1be160 admin admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:52:47.769359 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b73345-4efb-4681-86da-49ce7ff7985a admin admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:52:47.774775 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834225a4-8b20-4a34-8ffa-f45e3b93dc75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:52:47.775565 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834225a4-8b20-4a34-8ffa-f45e3b93dc75 admin admin] REQUEST_METHOD: `POST` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:52:47.775854 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834225a4-8b20-4a34-8ffa-f45e3b93dc75 admin admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:52:47.776133 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834225a4-8b20-4a34-8ffa-f45e3b93dc75 admin admin] PATH_INFO: `/v3/projects` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:52:47.777105 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834225a4-8b20-4a34-8ffa-f45e3b93dc75 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:52:47.779127 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834225a4-8b20-4a34-8ffa-f45e3b93dc75 admin admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:52:47.819958 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 788/1577] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Jul 14 10:52:47 2022] POST /identity/v3/projects => generated 373 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:52:47.820827 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834225a4-8b20-4a34-8ffa-f45e3b93dc75 admin admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:52:47.824512 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07affa35-095e-48fa-81cd-dabddf0a56e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:52:47.825447 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07affa35-095e-48fa-81cd-dabddf0a56e5 admin admin] REQUEST_METHOD: `POST` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:52:47.825906 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07affa35-095e-48fa-81cd-dabddf0a56e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:52:47.826356 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07affa35-095e-48fa-81cd-dabddf0a56e5 admin admin] PATH_INFO: `/v3/projects` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:52:47.827405 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07affa35-095e-48fa-81cd-dabddf0a56e5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:52:47.829754 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07affa35-095e-48fa-81cd-dabddf0a56e5 admin admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:52:47.860569 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 790/1578] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Jul 14 10:52:47 2022] POST /identity/v3/projects => generated 385 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:52:47.864403 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07affa35-095e-48fa-81cd-dabddf0a56e5 admin admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:52:47.893414 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834225a4-8b20-4a34-8ffa-f45e3b93dc75 admin admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:52:47.953622 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07affa35-095e-48fa-81cd-dabddf0a56e5 admin admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:52:47.959554 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70a2259-aa92-497a-acd8-7714df8c9af1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:52:47.960367 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70a2259-aa92-497a-acd8-7714df8c9af1 admin admin] REQUEST_METHOD: `POST` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:52:47.960917 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70a2259-aa92-497a-acd8-7714df8c9af1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:52:47.961071 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70a2259-aa92-497a-acd8-7714df8c9af1 admin admin] PATH_INFO: `/v3/projects` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:52:47.962054 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70a2259-aa92-497a-acd8-7714df8c9af1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:52:47.964673 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70a2259-aa92-497a-acd8-7714df8c9af1 admin admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:52:47.978601 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02c3bfd-9c1b-4867-a7da-2ec442bd60d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:52:47.979967 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02c3bfd-9c1b-4867-a7da-2ec442bd60d3 admin admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:52:47.980456 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02c3bfd-9c1b-4867-a7da-2ec442bd60d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:52:47.980969 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02c3bfd-9c1b-4867-a7da-2ec442bd60d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:52:47.981924 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02c3bfd-9c1b-4867-a7da-2ec442bd60d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:52:47.985345 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02c3bfd-9c1b-4867-a7da-2ec442bd60d3 admin admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:52:47.998457 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 789/1579] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jul 14 10:52:47 2022] GET /identity/v3/roles => generated 1420 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:52:47.999986 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02c3bfd-9c1b-4867-a7da-2ec442bd60d3 admin admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:52:48.003482 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 791/1580] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Jul 14 10:52:47 2022] POST /identity/v3/projects => generated 403 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:52:48.005197 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70a2259-aa92-497a-acd8-7714df8c9af1 admin admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:52:48.012216 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02c3bfd-9c1b-4867-a7da-2ec442bd60d3 admin admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:52:48.041426 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:52:48.066153 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:52:48.088487 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690f3694-0bb3-480d-a7d6-97655246125b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:52:48.089400 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690f3694-0bb3-480d-a7d6-97655246125b admin admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:52:48.089722 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690f3694-0bb3-480d-a7d6-97655246125b admin admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:52:48.090595 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690f3694-0bb3-480d-a7d6-97655246125b admin admin] PATH_INFO: `/v3/roles` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:52:48.091536 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690f3694-0bb3-480d-a7d6-97655246125b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:52:48.091657 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70a2259-aa92-497a-acd8-7714df8c9af1 admin admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:52:48.094203 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690f3694-0bb3-480d-a7d6-97655246125b admin admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:52:48.097069 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e13736-9dd0-49ff-a436-06129b27f0ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:52:48.098139 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e13736-9dd0-49ff-a436-06129b27f0ab admin admin] REQUEST_METHOD: `POST` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:52:48.098139 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e13736-9dd0-49ff-a436-06129b27f0ab admin admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:52:48.098363 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e13736-9dd0-49ff-a436-06129b27f0ab admin admin] PATH_INFO: `/v3/users` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:52:48.099064 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e13736-9dd0-49ff-a436-06129b27f0ab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:52:48.101036 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e13736-9dd0-49ff-a436-06129b27f0ab admin admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:52:48.106375 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 790/1581] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jul 14 10:52:47 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:52:48.107352 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690f3694-0bb3-480d-a7d6-97655246125b admin admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:52:48.119391 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690f3694-0bb3-480d-a7d6-97655246125b admin admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:52:48.127284 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145c6afb-6f36-47fe-a9f8-2f2ba42d54a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:52:48.128300 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145c6afb-6f36-47fe-a9f8-2f2ba42d54a5 admin admin] REQUEST_METHOD: `POST` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:52:48.128747 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145c6afb-6f36-47fe-a9f8-2f2ba42d54a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:52:48.129202 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 792/1582] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Jul 14 10:52:48 2022] POST /identity/v3/users => generated 294 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:52:48.129396 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145c6afb-6f36-47fe-a9f8-2f2ba42d54a5 admin admin] PATH_INFO: `/v3/users` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:52:48.130446 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145c6afb-6f36-47fe-a9f8-2f2ba42d54a5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:52:48.131076 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e13736-9dd0-49ff-a436-06129b27f0ab admin admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:52:48.132987 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145c6afb-6f36-47fe-a9f8-2f2ba42d54a5 admin admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:52:48.141969 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e13736-9dd0-49ff-a436-06129b27f0ab admin admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:52:48.147465 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad8711b-746c-430a-ad4c-b7f9e60ca94f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:52:48.148137 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad8711b-746c-430a-ad4c-b7f9e60ca94f admin admin] REQUEST_METHOD: `POST` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:52:48.148446 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad8711b-746c-430a-ad4c-b7f9e60ca94f admin admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:52:48.148742 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad8711b-746c-430a-ad4c-b7f9e60ca94f admin admin] PATH_INFO: `/v3/users` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:52:48.149428 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad8711b-746c-430a-ad4c-b7f9e60ca94f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:52:48.151344 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad8711b-746c-430a-ad4c-b7f9e60ca94f admin admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:52:48.157733 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 791/1583] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Jul 14 10:52:48 2022] POST /identity/v3/users => generated 289 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:52:48.162335 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145c6afb-6f36-47fe-a9f8-2f2ba42d54a5 admin admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:52:48.174797 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145c6afb-6f36-47fe-a9f8-2f2ba42d54a5 admin admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:52:48.178743 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 793/1584] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Jul 14 10:52:48 2022] POST /identity/v3/users => generated 287 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:52:48.179745 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad8711b-746c-430a-ad4c-b7f9e60ca94f admin admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:52:48.182078 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f40467-ce6e-4d2d-af2c-d90aac5d01af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:52:48.182758 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f40467-ce6e-4d2d-af2c-d90aac5d01af admin admin] REQUEST_METHOD: `POST` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:52:48.183041 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f40467-ce6e-4d2d-af2c-d90aac5d01af admin admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:52:48.183315 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f40467-ce6e-4d2d-af2c-d90aac5d01af admin admin] PATH_INFO: `/v3/users` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:52:48.184013 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f40467-ce6e-4d2d-af2c-d90aac5d01af admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:52:48.186113 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f40467-ce6e-4d2d-af2c-d90aac5d01af admin admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:52:48.197112 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad8711b-746c-430a-ad4c-b7f9e60ca94f admin admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:52:48.203069 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ee7996-d90c-4972-86bf-7bfa9739c3bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:52:48.203761 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ee7996-d90c-4972-86bf-7bfa9739c3bd admin admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:52:48.204052 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ee7996-d90c-4972-86bf-7bfa9739c3bd admin admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:52:48.204333 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ee7996-d90c-4972-86bf-7bfa9739c3bd admin admin] PATH_INFO: `/v3/roles` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:52:48.205133 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ee7996-d90c-4972-86bf-7bfa9739c3bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:52:48.206778 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ee7996-d90c-4972-86bf-7bfa9739c3bd admin admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:52:48.210645 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 792/1585] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Jul 14 10:52:48 2022] POST /identity/v3/users => generated 293 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:52:48.211404 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f40467-ce6e-4d2d-af2c-d90aac5d01af admin admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:52:48.221754 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 794/1586] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jul 14 10:52:48 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:52:48.221754 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ee7996-d90c-4972-86bf-7bfa9739c3bd admin admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:52:48.227176 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f40467-ce6e-4d2d-af2c-d90aac5d01af admin admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:52:48.232387 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ee7996-d90c-4972-86bf-7bfa9739c3bd admin admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:52:48.232603 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ad94ad-fd6a-41e0-8661-1412b18a7866 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:52:48.234030 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ad94ad-fd6a-41e0-8661-1412b18a7866 admin admin] REQUEST_METHOD: `POST` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:52:48.234403 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ad94ad-fd6a-41e0-8661-1412b18a7866 admin admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:52:48.234808 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ad94ad-fd6a-41e0-8661-1412b18a7866 admin admin] PATH_INFO: `/v3/users` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:52:48.235602 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ad94ad-fd6a-41e0-8661-1412b18a7866 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:52:48.237673 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ad94ad-fd6a-41e0-8661-1412b18a7866 admin admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:52:48.238641 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0a4eb9-b4b3-494c-a670-798630610b8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:52:48.239439 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0a4eb9-b4b3-494c-a670-798630610b8c admin admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:52:48.239811 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0a4eb9-b4b3-494c-a670-798630610b8c admin admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:52:48.240249 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0a4eb9-b4b3-494c-a670-798630610b8c admin admin] PATH_INFO: `/v3/roles` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:52:48.241085 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0a4eb9-b4b3-494c-a670-798630610b8c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:52:48.242805 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0a4eb9-b4b3-494c-a670-798630610b8c admin admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:52:48.259475 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 795/1587] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jul 14 10:52:48 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:52:48.259475 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0a4eb9-b4b3-494c-a670-798630610b8c admin admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:52:48.267061 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 793/1588] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Jul 14 10:52:48 2022] POST /identity/v3/users => generated 302 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:52:48.270698 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0a4eb9-b4b3-494c-a670-798630610b8c admin admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:52:48.270887 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ad94ad-fd6a-41e0-8661-1412b18a7866 admin admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:52:48.275546 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b79a14-a966-4436-af0a-cb4be9f9b6ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:52:48.276335 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b79a14-a966-4436-af0a-cb4be9f9b6ab admin admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:52:48.276693 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b79a14-a966-4436-af0a-cb4be9f9b6ab admin admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:52:48.277068 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b79a14-a966-4436-af0a-cb4be9f9b6ab admin admin] PATH_INFO: `/v3/roles` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:52:48.278131 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b79a14-a966-4436-af0a-cb4be9f9b6ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:52:48.279727 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b79a14-a966-4436-af0a-cb4be9f9b6ab admin admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:52:48.282598 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ad94ad-fd6a-41e0-8661-1412b18a7866 admin admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:52:48.287528 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436dad49-9e34-4600-98ec-5a0cfaa89008 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:52:48.288285 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436dad49-9e34-4600-98ec-5a0cfaa89008 admin admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:52:48.288764 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436dad49-9e34-4600-98ec-5a0cfaa89008 admin admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:52:48.289157 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436dad49-9e34-4600-98ec-5a0cfaa89008 admin admin] PATH_INFO: `/v3/roles` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:52:48.289972 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436dad49-9e34-4600-98ec-5a0cfaa89008 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:52:48.291574 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 796/1589] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jul 14 10:52:48 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:52:48.291702 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436dad49-9e34-4600-98ec-5a0cfaa89008 admin admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:52:48.296257 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b79a14-a966-4436-af0a-cb4be9f9b6ab admin admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:52:48.307461 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 794/1590] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jul 14 10:52:48 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:52:48.307461 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436dad49-9e34-4600-98ec-5a0cfaa89008 admin admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:52:48.307760 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b79a14-a966-4436-af0a-cb4be9f9b6ab admin admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:52:48.312091 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0717cd3d-a8ff-4d1d-99dd-883d8d30fdf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:52:48.312870 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0717cd3d-a8ff-4d1d-99dd-883d8d30fdf9 admin admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:52:48.313227 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0717cd3d-a8ff-4d1d-99dd-883d8d30fdf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:52:48.313577 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0717cd3d-a8ff-4d1d-99dd-883d8d30fdf9 admin admin] PATH_INFO: `/v3/roles` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:52:48.314523 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0717cd3d-a8ff-4d1d-99dd-883d8d30fdf9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:52:48.316195 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0717cd3d-a8ff-4d1d-99dd-883d8d30fdf9 admin admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:52:48.318545 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436dad49-9e34-4600-98ec-5a0cfaa89008 admin admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:52:48.323551 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cf7f4c-161a-4eaa-ac2a-3b92e35f5ed8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:52:48.324316 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cf7f4c-161a-4eaa-ac2a-3b92e35f5ed8 admin admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:52:48.324765 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cf7f4c-161a-4eaa-ac2a-3b92e35f5ed8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:52:48.325181 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cf7f4c-161a-4eaa-ac2a-3b92e35f5ed8 admin admin] PATH_INFO: `/v3/roles` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:52:48.326020 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78cf7f4c-161a-4eaa-ac2a-3b92e35f5ed8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:52:48.327907 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 797/1591] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jul 14 10:52:48 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:52:48.328022 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78cf7f4c-161a-4eaa-ac2a-3b92e35f5ed8 admin admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:52:48.328705 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0717cd3d-a8ff-4d1d-99dd-883d8d30fdf9 admin admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:52:48.341523 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0717cd3d-a8ff-4d1d-99dd-883d8d30fdf9 admin admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:52:48.345183 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c195fa-1e29-432f-9b96-1b70957f38cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:52:48.346080 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c195fa-1e29-432f-9b96-1b70957f38cc admin admin] REQUEST_METHOD: `PUT` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:52:48.346374 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c195fa-1e29-432f-9b96-1b70957f38cc admin admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:52:48.346656 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c195fa-1e29-432f-9b96-1b70957f38cc admin admin] PATH_INFO: `/v3/projects/e26660e07515494b8212d32fc0947fba/users/2a4149579fc9422595a8085a70a2ee1d/roles/0da46c267d354cce81495dfdd56c1ec2` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:52:48.350314 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 795/1592] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jul 14 10:52:48 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:52:48.351303 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cf7f4c-161a-4eaa-ac2a-3b92e35f5ed8 admin admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:52:48.362487 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cf7f4c-161a-4eaa-ac2a-3b92e35f5ed8 admin admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:52:48.367381 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c195fa-1e29-432f-9b96-1b70957f38cc admin admin] RBAC: Authorizing `identity:create_grant(project_id=e26660e07515494b8212d32fc0947fba, user_id=2a4149579fc9422595a8085a70a2ee1d, role_id=0da46c267d354cce81495dfdd56c1ec2)` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:52:48.367617 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6889592-98e1-41bd-9f24-3a3ece36c721 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:52:48.368573 dv-cinder-846146-7-smb devstack@keystone.service[86655]: WARNING py.warnings [None req-21c195fa-1e29-432f-9b96-1b70957f38cc admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 14 10:52:48.368573 dv-cinder-846146-7-smb devstack@keystone.service[86655]: warnings.warn(msg) Jul 14 10:52:48.368573 dv-cinder-846146-7-smb devstack@keystone.service[86655]: Jul 14 10:52:48.369073 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6889592-98e1-41bd-9f24-3a3ece36c721 admin admin] REQUEST_METHOD: `PUT` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:52:48.369526 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6889592-98e1-41bd-9f24-3a3ece36c721 admin admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:52:48.369964 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6889592-98e1-41bd-9f24-3a3ece36c721 admin admin] PATH_INFO: `/v3/projects/9c661b9c2c5d4349866ed82cefa1e717/users/54f1bcb7cfb7435b88bfc8eeb5141f64/roles/0da46c267d354cce81495dfdd56c1ec2` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:52:48.371417 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c195fa-1e29-432f-9b96-1b70957f38cc admin admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:52:48.390547 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6889592-98e1-41bd-9f24-3a3ece36c721 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9c661b9c2c5d4349866ed82cefa1e717, user_id=54f1bcb7cfb7435b88bfc8eeb5141f64, role_id=0da46c267d354cce81495dfdd56c1ec2)` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:52:48.394534 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6889592-98e1-41bd-9f24-3a3ece36c721 admin admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:52:48.409741 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 798/1593] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Jul 14 10:52:48 2022] PUT /identity/v3/projects/e26660e07515494b8212d32fc0947fba/users/2a4149579fc9422595a8085a70a2ee1d/roles/0da46c267d354cce81495dfdd56c1ec2 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:52:48.411015 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c195fa-1e29-432f-9b96-1b70957f38cc admin admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:52:48.413761 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 796/1594] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Jul 14 10:52:48 2022] PUT /identity/v3/projects/9c661b9c2c5d4349866ed82cefa1e717/users/54f1bcb7cfb7435b88bfc8eeb5141f64/roles/0da46c267d354cce81495dfdd56c1ec2 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:52:48.415539 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6889592-98e1-41bd-9f24-3a3ece36c721 admin admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:52:48.515802 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6889592-98e1-41bd-9f24-3a3ece36c721 admin admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:52:48.521317 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b235adfc-7082-48e2-8113-a25bf5c38b4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:52:48.522207 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b235adfc-7082-48e2-8113-a25bf5c38b4a admin admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:52:48.522643 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b235adfc-7082-48e2-8113-a25bf5c38b4a admin admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:52:48.523065 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b235adfc-7082-48e2-8113-a25bf5c38b4a admin admin] PATH_INFO: `/v3/roles` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:52:48.524155 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b235adfc-7082-48e2-8113-a25bf5c38b4a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:52:48.526134 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b235adfc-7082-48e2-8113-a25bf5c38b4a admin admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:52:48.528256 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c195fa-1e29-432f-9b96-1b70957f38cc admin admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:52:48.535588 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1656f1-ea22-4793-9ba6-8462422b62ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:52:48.536996 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1656f1-ea22-4793-9ba6-8462422b62ef admin admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:52:48.537380 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1656f1-ea22-4793-9ba6-8462422b62ef admin admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:52:48.537804 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1656f1-ea22-4793-9ba6-8462422b62ef admin admin] PATH_INFO: `/v3/roles` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:52:48.538648 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1656f1-ea22-4793-9ba6-8462422b62ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:52:48.540394 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1656f1-ea22-4793-9ba6-8462422b62ef admin admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:52:48.541492 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 797/1595] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jul 14 10:52:48 2022] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:52:48.542489 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b235adfc-7082-48e2-8113-a25bf5c38b4a admin admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:52:48.552982 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b235adfc-7082-48e2-8113-a25bf5c38b4a admin admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:52:48.557465 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 799/1596] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jul 14 10:52:48 2022] GET /identity/v3/roles => generated 1420 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:52:48.558512 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1656f1-ea22-4793-9ba6-8462422b62ef admin admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:52:48.558698 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a60a266-bf98-4eaa-bf5a-65f1328ac6ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:52:48.559239 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a60a266-bf98-4eaa-bf5a-65f1328ac6ef admin admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:52:48.559540 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a60a266-bf98-4eaa-bf5a-65f1328ac6ef admin admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:52:48.559881 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a60a266-bf98-4eaa-bf5a-65f1328ac6ef admin admin] PATH_INFO: `/v3/roles` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:52:48.560545 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a60a266-bf98-4eaa-bf5a-65f1328ac6ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:52:48.562267 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a60a266-bf98-4eaa-bf5a-65f1328ac6ef admin admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:52:48.570858 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1656f1-ea22-4793-9ba6-8462422b62ef admin admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:52:48.573253 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 798/1597] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jul 14 10:52:48 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:52:48.574136 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a60a266-bf98-4eaa-bf5a-65f1328ac6ef admin admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:52:48.580170 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e065bb56-c834-4a68-aad7-af2fd3715f25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:52:48.580975 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e065bb56-c834-4a68-aad7-af2fd3715f25 admin admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:52:48.581338 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e065bb56-c834-4a68-aad7-af2fd3715f25 admin admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:52:48.581677 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e065bb56-c834-4a68-aad7-af2fd3715f25 admin admin] PATH_INFO: `/v3/roles` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:52:48.582485 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e065bb56-c834-4a68-aad7-af2fd3715f25 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:52:48.584285 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e065bb56-c834-4a68-aad7-af2fd3715f25 admin admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:52:48.589230 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a60a266-bf98-4eaa-bf5a-65f1328ac6ef admin admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:52:48.597423 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9b03bd-49b5-4528-ad25-bd6d6db0e51a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:52:48.598210 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9b03bd-49b5-4528-ad25-bd6d6db0e51a admin admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:52:48.598517 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9b03bd-49b5-4528-ad25-bd6d6db0e51a admin admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:52:48.598760 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 800/1598] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jul 14 10:52:48 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:52:48.598979 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9b03bd-49b5-4528-ad25-bd6d6db0e51a admin admin] PATH_INFO: `/v3/roles` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:52:48.599816 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9b03bd-49b5-4528-ad25-bd6d6db0e51a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:52:48.600079 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63303c71-e2ca-4990-84ba-9cdcef27cd35 None None] REQUEST_METHOD: `POST` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:52:48.600376 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63303c71-e2ca-4990-84ba-9cdcef27cd35 None None] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:52:48.600703 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63303c71-e2ca-4990-84ba-9cdcef27cd35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:52:48.602247 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9b03bd-49b5-4528-ad25-bd6d6db0e51a admin admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:52:48.619374 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 799/1599] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jul 14 10:52:48 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:52:48.619374 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d51a54b-8795-4b0a-af87-09c1856eb25e None None] REQUEST_METHOD: `POST` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:52:48.619374 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d51a54b-8795-4b0a-af87-09c1856eb25e None None] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:52:48.619374 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d51a54b-8795-4b0a-af87-09c1856eb25e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:52:48.623416 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:52:48.633017 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.auth.core [None req-63303c71-e2ca-4990-84ba-9cdcef27cd35 None None] MFA Rules not processed for user `2a4149579fc9422595a8085a70a2ee1d`. Rule list: `[]` (Enabled: `True`). {{(pid=86655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:52:48.634881 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-63303c71-e2ca-4990-84ba-9cdcef27cd35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:52:48.653123 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=90,keystone:INSERT=10 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:52:48.659610 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.auth.core [None req-6d51a54b-8795-4b0a-af87-09c1856eb25e None None] MFA Rules not processed for user `54f1bcb7cfb7435b88bfc8eeb5141f64`. Rule list: `[]` (Enabled: `True`). {{(pid=86656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:52:48.661677 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-6d51a54b-8795-4b0a-af87-09c1856eb25e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:52:48.717548 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 801/1600] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jul 14 10:52:48 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:52:48.718539 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63303c71-e2ca-4990-84ba-9cdcef27cd35 None None] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:52:48.729696 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63303c71-e2ca-4990-84ba-9cdcef27cd35 None None] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:52:48.736257 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a413704-378c-4496-9053-3b7cd9cbb8d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:52:48.737491 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a413704-378c-4496-9053-3b7cd9cbb8d9 admin admin] REQUEST_METHOD: `PUT` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:52:48.737626 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a413704-378c-4496-9053-3b7cd9cbb8d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:52:48.737914 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a413704-378c-4496-9053-3b7cd9cbb8d9 admin admin] PATH_INFO: `/v3/projects/5f9950e88221478d894497f9da700b04/users/11fba34d28ce4520b8f98de6391ef912/roles/0da46c267d354cce81495dfdd56c1ec2` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:52:48.754288 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 800/1601] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jul 14 10:52:48 2022] POST /identity/v3/auth/tokens => generated 3224 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:52:48.755979 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d51a54b-8795-4b0a-af87-09c1856eb25e None None] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:52:48.763809 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a413704-378c-4496-9053-3b7cd9cbb8d9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5f9950e88221478d894497f9da700b04, user_id=11fba34d28ce4520b8f98de6391ef912, role_id=0da46c267d354cce81495dfdd56c1ec2)` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:52:48.767465 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a413704-378c-4496-9053-3b7cd9cbb8d9 admin admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:52:48.776189 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d51a54b-8795-4b0a-af87-09c1856eb25e None None] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:52:48.784984 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49dbb21a-3de3-4d82-ab75-2664ce5c9d5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:52:48.786412 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49dbb21a-3de3-4d82-ab75-2664ce5c9d5b admin admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:52:48.786743 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49dbb21a-3de3-4d82-ab75-2664ce5c9d5b admin admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:52:48.787031 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49dbb21a-3de3-4d82-ab75-2664ce5c9d5b admin admin] PATH_INFO: `/v3/roles` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:52:48.787785 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49dbb21a-3de3-4d82-ab75-2664ce5c9d5b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:52:48.789624 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49dbb21a-3de3-4d82-ab75-2664ce5c9d5b admin admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:52:48.801849 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 801/1602] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jul 14 10:52:48 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:52:48.802808 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49dbb21a-3de3-4d82-ab75-2664ce5c9d5b admin admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:52:48.803617 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 802/1603] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Jul 14 10:52:48 2022] PUT /identity/v3/projects/5f9950e88221478d894497f9da700b04/users/11fba34d28ce4520b8f98de6391ef912/roles/0da46c267d354cce81495dfdd56c1ec2 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:52:48.804444 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a413704-378c-4496-9053-3b7cd9cbb8d9 admin admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:52:48.826235 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49dbb21a-3de3-4d82-ab75-2664ce5c9d5b admin admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:52:48.904406 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575cc9d9-af1f-4aad-9f41-c67498583b91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:52:48.905729 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575cc9d9-af1f-4aad-9f41-c67498583b91 admin admin] REQUEST_METHOD: `PUT` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:52:48.905851 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a413704-378c-4496-9053-3b7cd9cbb8d9 admin admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:52:48.905940 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575cc9d9-af1f-4aad-9f41-c67498583b91 admin admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:52:48.906194 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575cc9d9-af1f-4aad-9f41-c67498583b91 admin admin] PATH_INFO: `/v3/projects/33dbae05ece84d4dbaec126f580a49c1/users/e3b4a13350ec406ab5ca248cf2c06ea4/roles/0da46c267d354cce81495dfdd56c1ec2` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:52:48.913648 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b20fea-173e-4dec-a48e-d86a8c3be941 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:52:48.914631 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b20fea-173e-4dec-a48e-d86a8c3be941 admin admin] REQUEST_METHOD: `PUT` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:52:48.914991 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b20fea-173e-4dec-a48e-d86a8c3be941 admin admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:52:48.915338 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b20fea-173e-4dec-a48e-d86a8c3be941 admin admin] PATH_INFO: `/v3/projects/a9a8d67b0f6f4bedb4887fab80753846/users/1381e3cf93fa446da8747ed91c3f4ed4/roles/0da46c267d354cce81495dfdd56c1ec2` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:52:48.927577 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575cc9d9-af1f-4aad-9f41-c67498583b91 admin admin] RBAC: Authorizing `identity:create_grant(project_id=33dbae05ece84d4dbaec126f580a49c1, user_id=e3b4a13350ec406ab5ca248cf2c06ea4, role_id=0da46c267d354cce81495dfdd56c1ec2)` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:52:48.933414 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575cc9d9-af1f-4aad-9f41-c67498583b91 admin admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:52:48.937828 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b20fea-173e-4dec-a48e-d86a8c3be941 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a9a8d67b0f6f4bedb4887fab80753846, user_id=1381e3cf93fa446da8747ed91c3f4ed4, role_id=0da46c267d354cce81495dfdd56c1ec2)` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:52:48.941481 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b20fea-173e-4dec-a48e-d86a8c3be941 admin admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:52:48.959895 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 802/1604] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Jul 14 10:52:48 2022] PUT /identity/v3/projects/33dbae05ece84d4dbaec126f580a49c1/users/e3b4a13350ec406ab5ca248cf2c06ea4/roles/0da46c267d354cce81495dfdd56c1ec2 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:52:48.960937 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575cc9d9-af1f-4aad-9f41-c67498583b91 admin admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:52:48.966691 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 803/1605] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Jul 14 10:52:48 2022] PUT /identity/v3/projects/a9a8d67b0f6f4bedb4887fab80753846/users/1381e3cf93fa446da8747ed91c3f4ed4/roles/0da46c267d354cce81495dfdd56c1ec2 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:52:48.967662 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b20fea-173e-4dec-a48e-d86a8c3be941 admin admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:52:49.047070 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575cc9d9-af1f-4aad-9f41-c67498583b91 admin admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:52:49.073032 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b20fea-173e-4dec-a48e-d86a8c3be941 admin admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:52:49.074826 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:52:49.080856 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c076e53-6daa-4ad3-a722-0557e0bc7138 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:52:49.081723 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c076e53-6daa-4ad3-a722-0557e0bc7138 admin admin] REQUEST_METHOD: `POST` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:52:49.082108 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c076e53-6daa-4ad3-a722-0557e0bc7138 admin admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:52:49.082481 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c076e53-6daa-4ad3-a722-0557e0bc7138 admin admin] PATH_INFO: `/v3/projects` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:52:49.083452 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c076e53-6daa-4ad3-a722-0557e0bc7138 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:52:49.086511 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c076e53-6daa-4ad3-a722-0557e0bc7138 admin admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:52:49.090344 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:52:49.126349 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 804/1606] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Jul 14 10:52:48 2022] POST /identity/v3/projects => generated 357 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:52:49.128866 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995f1071-a31f-4053-9c27-06c18cd25824 None None] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:52:49.129435 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995f1071-a31f-4053-9c27-06c18cd25824 None None] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:52:49.129753 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995f1071-a31f-4053-9c27-06c18cd25824 None None] PATH_INFO: `/` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:52:49.131252 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 805/1607] 10.222.0.16 () {54 vars in 961 bytes} [Thu Jul 14 10:52:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:52:49.132007 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995f1071-a31f-4053-9c27-06c18cd25824 None None] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:52:49.135686 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c119a2e-b1a1-40a2-9196-e09e981443bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:52:49.136882 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c119a2e-b1a1-40a2-9196-e09e981443bd admin admin] REQUEST_METHOD: `PUT` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:52:49.137316 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c119a2e-b1a1-40a2-9196-e09e981443bd admin admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:52:49.137740 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c119a2e-b1a1-40a2-9196-e09e981443bd admin admin] PATH_INFO: `/v3/projects/a3478f6a9e9249a992564e6034de4459/users/dc87a05afbf245ca9c12b06de07b8840/roles/0da46c267d354cce81495dfdd56c1ec2` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:52:49.159814 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c119a2e-b1a1-40a2-9196-e09e981443bd admin admin] RBAC: Authorizing `identity:create_grant(project_id=a3478f6a9e9249a992564e6034de4459, user_id=dc87a05afbf245ca9c12b06de07b8840, role_id=0da46c267d354cce81495dfdd56c1ec2)` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:52:49.162812 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c119a2e-b1a1-40a2-9196-e09e981443bd admin admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:52:49.193157 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 803/1608] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Jul 14 10:52:48 2022] PUT /identity/v3/projects/a3478f6a9e9249a992564e6034de4459/users/dc87a05afbf245ca9c12b06de07b8840/roles/0da46c267d354cce81495dfdd56c1ec2 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:52:49.194749 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d197d00a-942d-444a-8d7f-cef9e07210b4 None None] REQUEST_METHOD: `POST` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:52:49.195396 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d197d00a-942d-444a-8d7f-cef9e07210b4 None None] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:52:49.195821 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d197d00a-942d-444a-8d7f-cef9e07210b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:52:49.224438 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995f1071-a31f-4053-9c27-06c18cd25824 None None] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:52:49.233486 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.auth.core [None req-d197d00a-942d-444a-8d7f-cef9e07210b4 None None] MFA Rules not processed for user `11fba34d28ce4520b8f98de6391ef912`. Rule list: `[]` (Enabled: `True`). {{(pid=86656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:52:49.235459 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-d197d00a-942d-444a-8d7f-cef9e07210b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:52:49.304677 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe47172-51e9-43c3-9109-5452c1488b82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:52:49.305827 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe47172-51e9-43c3-9109-5452c1488b82 admin admin] REQUEST_METHOD: `PUT` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:52:49.306145 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe47172-51e9-43c3-9109-5452c1488b82 admin admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:52:49.306710 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe47172-51e9-43c3-9109-5452c1488b82 admin admin] PATH_INFO: `/v3/projects/db93acd65a8348249975784e0de4cbd5/users/b3664ed3f27c4cdfba774850be776ad7/roles/0da46c267d354cce81495dfdd56c1ec2` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:52:49.331752 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe47172-51e9-43c3-9109-5452c1488b82 admin admin] RBAC: Authorizing `identity:create_grant(project_id=db93acd65a8348249975784e0de4cbd5, user_id=b3664ed3f27c4cdfba774850be776ad7, role_id=0da46c267d354cce81495dfdd56c1ec2)` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:52:49.339646 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe47172-51e9-43c3-9109-5452c1488b82 admin admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:52:49.341583 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 804/1609] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jul 14 10:52:49 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:52:49.343387 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def08ff8-01e9-4db8-8068-885f8e8519d3 None None] REQUEST_METHOD: `POST` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:52:49.343688 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def08ff8-01e9-4db8-8068-885f8e8519d3 None None] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:52:49.343974 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def08ff8-01e9-4db8-8068-885f8e8519d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:52:49.363813 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 806/1610] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Jul 14 10:52:49 2022] PUT /identity/v3/projects/db93acd65a8348249975784e0de4cbd5/users/b3664ed3f27c4cdfba774850be776ad7/roles/0da46c267d354cce81495dfdd56c1ec2 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:52:49.366684 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.auth.core [None req-def08ff8-01e9-4db8-8068-885f8e8519d3 None None] MFA Rules not processed for user `ae4bcdd8106d4bebbdcae96be33505bc`. Rule list: `[]` (Enabled: `True`). {{(pid=86656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:52:49.368238 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-def08ff8-01e9-4db8-8068-885f8e8519d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:52:49.377306 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199ec3db-441f-433c-b888-6f500a7069b2 None None] REQUEST_METHOD: `POST` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:52:49.377306 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199ec3db-441f-433c-b888-6f500a7069b2 None None] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:52:49.377594 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199ec3db-441f-433c-b888-6f500a7069b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:52:49.409453 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.auth.core [None req-199ec3db-441f-433c-b888-6f500a7069b2 None None] MFA Rules not processed for user `1381e3cf93fa446da8747ed91c3f4ed4`. Rule list: `[]` (Enabled: `True`). {{(pid=86655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:52:49.410687 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-199ec3db-441f-433c-b888-6f500a7069b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:52:49.454820 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 805/1611] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jul 14 10:52:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:52:49.455584 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def08ff8-01e9-4db8-8068-885f8e8519d3 None None] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:52:49.469030 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def08ff8-01e9-4db8-8068-885f8e8519d3 None None] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:52:49.475259 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709f9fe5-d591-4e18-97c7-8dd82e72f17e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:52:49.476023 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709f9fe5-d591-4e18-97c7-8dd82e72f17e admin admin] REQUEST_METHOD: `POST` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:52:49.476320 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709f9fe5-d591-4e18-97c7-8dd82e72f17e admin admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:52:49.476599 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709f9fe5-d591-4e18-97c7-8dd82e72f17e admin admin] PATH_INFO: `/v3/users` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:52:49.477348 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709f9fe5-d591-4e18-97c7-8dd82e72f17e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:52:49.479289 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709f9fe5-d591-4e18-97c7-8dd82e72f17e admin admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:52:49.501856 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 807/1612] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jul 14 10:52:49 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:52:49.503114 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c61d1ca-61e6-4092-aafe-fd8682788b6f None None] REQUEST_METHOD: `POST` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:52:49.503451 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c61d1ca-61e6-4092-aafe-fd8682788b6f None None] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:52:49.503739 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c61d1ca-61e6-4092-aafe-fd8682788b6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:52:49.511401 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:52:49.520684 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 806/1613] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Jul 14 10:52:49 2022] POST /identity/v3/users => generated 285 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:52:49.521414 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97859d38-5ebf-4b49-900b-aa46046615a4 None None] REQUEST_METHOD: `POST` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:52:49.523701 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97859d38-5ebf-4b49-900b-aa46046615a4 None None] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:52:49.524350 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97859d38-5ebf-4b49-900b-aa46046615a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:52:49.632885 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.auth.core [None req-8c61d1ca-61e6-4092-aafe-fd8682788b6f None None] MFA Rules not processed for user `26aa294c913c408499a913ec25bb677d`. Rule list: `[]` (Enabled: `True`). {{(pid=86655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:52:49.635023 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.auth.core [None req-97859d38-5ebf-4b49-900b-aa46046615a4 None None] MFA Rules not processed for user `dc87a05afbf245ca9c12b06de07b8840`. Rule list: `[]` (Enabled: `True`). {{(pid=86656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:52:49.635275 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-8c61d1ca-61e6-4092-aafe-fd8682788b6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:52:49.635387 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-97859d38-5ebf-4b49-900b-aa46046615a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:52:49.635387 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:52:49.672839 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 808/1614] 10.222.0.16 () {58 vars in 1058 bytes} [Thu Jul 14 10:52:49 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:52:49.673959 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c61d1ca-61e6-4092-aafe-fd8682788b6f None None] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:52:49.678787 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 807/1615] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jul 14 10:52:49 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:52:49.680297 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25d77a4-8198-4058-a3cc-f45764c76618 None None] REQUEST_METHOD: `POST` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:52:49.680669 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25d77a4-8198-4058-a3cc-f45764c76618 None None] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:52:49.681173 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25d77a4-8198-4058-a3cc-f45764c76618 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:52:49.697647 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c61d1ca-61e6-4092-aafe-fd8682788b6f None None] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:52:49.705572 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27601144-55f7-49c3-93bb-a4356bed321e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:52:49.706570 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27601144-55f7-49c3-93bb-a4356bed321e admin admin] REQUEST_METHOD: `POST` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:52:49.706868 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27601144-55f7-49c3-93bb-a4356bed321e admin admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:52:49.707152 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27601144-55f7-49c3-93bb-a4356bed321e admin admin] PATH_INFO: `/v3/projects` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:52:49.708529 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27601144-55f7-49c3-93bb-a4356bed321e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:52:49.711051 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27601144-55f7-49c3-93bb-a4356bed321e admin admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:52:49.746568 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.auth.core [None req-d25d77a4-8198-4058-a3cc-f45764c76618 None None] MFA Rules not processed for user `b3664ed3f27c4cdfba774850be776ad7`. Rule list: `[]` (Enabled: `True`). {{(pid=86656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:52:49.748206 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-d25d77a4-8198-4058-a3cc-f45764c76618 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:52:49.751050 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 809/1616] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Jul 14 10:52:49 2022] POST /identity/v3/projects => generated 385 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:52:49.752362 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27601144-55f7-49c3-93bb-a4356bed321e admin admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:52:49.755476 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-27601144-55f7-49c3-93bb-a4356bed321e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:52:49.838152 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 808/1617] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jul 14 10:52:49 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:52:49.838944 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25d77a4-8198-4058-a3cc-f45764c76618 None None] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:52:49.843278 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27601144-55f7-49c3-93bb-a4356bed321e admin admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:52:49.848610 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d164e486-6df2-4c71-b5f3-5af1e4fedfb4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dddf93691844886982c91fea974385d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59391272ecbe48b0aa736cb43807be1d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:52:49.849437 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d164e486-6df2-4c71-b5f3-5af1e4fedfb4 service neutron] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:52:49.849794 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d164e486-6df2-4c71-b5f3-5af1e4fedfb4 service neutron] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:52:49.850140 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d164e486-6df2-4c71-b5f3-5af1e4fedfb4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:52:49.921303 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25d77a4-8198-4058-a3cc-f45764c76618 None None] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:52:49.926386 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1f3cc3-641c-4a04-9923-b40bf2821b8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:52:49.927064 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1f3cc3-641c-4a04-9923-b40bf2821b8c admin admin] REQUEST_METHOD: `POST` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:52:49.927346 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1f3cc3-641c-4a04-9923-b40bf2821b8c admin admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:52:49.927620 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1f3cc3-641c-4a04-9923-b40bf2821b8c admin admin] PATH_INFO: `/v3/projects` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:52:49.928436 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1f3cc3-641c-4a04-9923-b40bf2821b8c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:52:49.930771 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1f3cc3-641c-4a04-9923-b40bf2821b8c admin admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:52:49.934977 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d164e486-6df2-4c71-b5f3-5af1e4fedfb4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:52:49.937417 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d164e486-6df2-4c71-b5f3-5af1e4fedfb4 service neutron] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:52:49.950262 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 810/1618] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jul 14 10:52:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:52:49.951340 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d164e486-6df2-4c71-b5f3-5af1e4fedfb4 service neutron] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:52:49.963289 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d164e486-6df2-4c71-b5f3-5af1e4fedfb4 service neutron] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:52:49.968404 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cea2ab2-288c-4935-962c-718f26d9fd98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:52:49.969372 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cea2ab2-288c-4935-962c-718f26d9fd98 admin admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:52:49.969819 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cea2ab2-288c-4935-962c-718f26d9fd98 admin admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:52:49.970260 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cea2ab2-288c-4935-962c-718f26d9fd98 admin admin] PATH_INFO: `/v3/roles` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:52:49.971093 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cea2ab2-288c-4935-962c-718f26d9fd98 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:52:49.975236 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cea2ab2-288c-4935-962c-718f26d9fd98 admin admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:52:49.976418 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 809/1619] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Jul 14 10:52:49 2022] POST /identity/v3/projects => generated 373 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:52:49.977788 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1f3cc3-641c-4a04-9923-b40bf2821b8c admin admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:52:49.979977 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:52:49.990463 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 811/1620] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jul 14 10:52:49 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:52:49.992286 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc64fd85-94fb-4a49-8250-cd06afde604f None None] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:52:49.993074 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc64fd85-94fb-4a49-8250-cd06afde604f None None] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:52:49.993997 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc64fd85-94fb-4a49-8250-cd06afde604f None None] PATH_INFO: `/` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:52:49.996038 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 812/1621] 10.222.0.16 () {54 vars in 961 bytes} [Thu Jul 14 10:52:49 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:52:50.002402 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc64fd85-94fb-4a49-8250-cd06afde604f None None] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:52:50.021120 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:52:50.100058 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1f3cc3-641c-4a04-9923-b40bf2821b8c admin admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:52:50.112317 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef79be67-5c7b-4709-acc7-582230700ec5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26aa294c913c408499a913ec25bb677d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59391272ecbe48b0aa736cb43807be1d', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:52:50.113017 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef79be67-5c7b-4709-acc7-582230700ec5 service nova] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:52:50.113293 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef79be67-5c7b-4709-acc7-582230700ec5 service nova] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:52:50.114932 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef79be67-5c7b-4709-acc7-582230700ec5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:52:50.143260 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc64fd85-94fb-4a49-8250-cd06afde604f None None] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:52:50.156548 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a155f8-ffaf-41a4-8dd1-029bbd5098e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:52:50.157355 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a155f8-ffaf-41a4-8dd1-029bbd5098e2 admin admin] REQUEST_METHOD: `POST` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:52:50.157548 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a155f8-ffaf-41a4-8dd1-029bbd5098e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:52:50.157907 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a155f8-ffaf-41a4-8dd1-029bbd5098e2 admin admin] PATH_INFO: `/v3/users` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:52:50.158608 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a155f8-ffaf-41a4-8dd1-029bbd5098e2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:52:50.160557 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a155f8-ffaf-41a4-8dd1-029bbd5098e2 admin admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:52:50.202242 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 813/1622] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Jul 14 10:52:49 2022] POST /identity/v3/users => generated 299 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:52:50.203230 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a155f8-ffaf-41a4-8dd1-029bbd5098e2 admin admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:52:50.225940 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a155f8-ffaf-41a4-8dd1-029bbd5098e2 admin admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:52:50.240089 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f979d3d-287c-49cb-bc78-2e06b63c8995 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:52:50.242997 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f979d3d-287c-49cb-bc78-2e06b63c8995 admin admin] REQUEST_METHOD: `POST` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:52:50.243273 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f979d3d-287c-49cb-bc78-2e06b63c8995 admin admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:52:50.243550 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f979d3d-287c-49cb-bc78-2e06b63c8995 admin admin] PATH_INFO: `/v3/projects` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:52:50.247001 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f979d3d-287c-49cb-bc78-2e06b63c8995 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:52:50.250941 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f979d3d-287c-49cb-bc78-2e06b63c8995 admin admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:52:50.254002 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef79be67-5c7b-4709-acc7-582230700ec5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:52:50.255681 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef79be67-5c7b-4709-acc7-582230700ec5 service nova] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:52:50.282255 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 810/1623] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jul 14 10:52:49 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:52:50.283114 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef79be67-5c7b-4709-acc7-582230700ec5 service nova] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:52:50.305365 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef79be67-5c7b-4709-acc7-582230700ec5 service nova] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:52:50.308705 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 814/1624] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Jul 14 10:52:50 2022] POST /identity/v3/projects => generated 403 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:52:50.309758 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f979d3d-287c-49cb-bc78-2e06b63c8995 admin admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:52:50.461921 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b023454a-7130-4ba8-ac7b-af7a760c5542 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:52:50.462620 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b023454a-7130-4ba8-ac7b-af7a760c5542 admin admin] REQUEST_METHOD: `POST` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:52:50.462906 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b023454a-7130-4ba8-ac7b-af7a760c5542 admin admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:52:50.463192 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b023454a-7130-4ba8-ac7b-af7a760c5542 admin admin] PATH_INFO: `/v3/users` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:52:50.463897 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b023454a-7130-4ba8-ac7b-af7a760c5542 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:52:50.465873 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b023454a-7130-4ba8-ac7b-af7a760c5542 admin admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:52:50.476921 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f979d3d-287c-49cb-bc78-2e06b63c8995 admin admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:52:50.489892 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5d4a79-6b8d-4119-9dd4-507e83f8d940 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:52:50.491555 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5d4a79-6b8d-4119-9dd4-507e83f8d940 admin admin] REQUEST_METHOD: `PUT` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:52:50.492029 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5d4a79-6b8d-4119-9dd4-507e83f8d940 admin admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:52:50.493057 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5d4a79-6b8d-4119-9dd4-507e83f8d940 admin admin] PATH_INFO: `/v3/projects/6921f74179ea4910b6e7efa7702d1647/users/71c9d27cacc0467181655afc5a157d41/roles/153539819e5542df99269d2913bbecfb` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:52:50.510815 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 811/1625] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Jul 14 10:52:50 2022] POST /identity/v3/users => generated 293 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:52:50.513381 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68ba9a0-d509-42f5-a972-841a572458b1 None None] REQUEST_METHOD: `POST` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:52:50.513675 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68ba9a0-d509-42f5-a972-841a572458b1 None None] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:52:50.514193 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68ba9a0-d509-42f5-a972-841a572458b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:52:50.526883 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5d4a79-6b8d-4119-9dd4-507e83f8d940 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6921f74179ea4910b6e7efa7702d1647, user_id=71c9d27cacc0467181655afc5a157d41, role_id=153539819e5542df99269d2913bbecfb)` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:52:50.533999 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5d4a79-6b8d-4119-9dd4-507e83f8d940 admin admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:52:50.558762 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 815/1626] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Jul 14 10:52:50 2022] PUT /identity/v3/projects/6921f74179ea4910b6e7efa7702d1647/users/71c9d27cacc0467181655afc5a157d41/roles/153539819e5542df99269d2913bbecfb => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:52:50.560027 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.auth.core [None req-b68ba9a0-d509-42f5-a972-841a572458b1 None None] MFA Rules not processed for user `26aa294c913c408499a913ec25bb677d`. Rule list: `[]` (Enabled: `True`). {{(pid=86656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:52:50.563201 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5d4a79-6b8d-4119-9dd4-507e83f8d940 admin admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:52:50.563837 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-b68ba9a0-d509-42f5-a972-841a572458b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:52:50.657013 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:52:50.672201 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:52:50.685163 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5d4a79-6b8d-4119-9dd4-507e83f8d940 admin admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:52:50.695809 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c96236-66eb-4b51-9a3e-d6c2ff209401 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:52:50.696499 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c96236-66eb-4b51-9a3e-d6c2ff209401 admin admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:52:50.696798 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c96236-66eb-4b51-9a3e-d6c2ff209401 admin admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:52:50.697246 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c96236-66eb-4b51-9a3e-d6c2ff209401 admin admin] PATH_INFO: `/v3/roles` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:52:50.700140 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c96236-66eb-4b51-9a3e-d6c2ff209401 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:52:50.705134 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c96236-66eb-4b51-9a3e-d6c2ff209401 admin admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:52:50.713037 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 812/1627] 10.222.0.16 () {58 vars in 1058 bytes} [Thu Jul 14 10:52:50 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:52:50.713736 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68ba9a0-d509-42f5-a972-841a572458b1 None None] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:52:50.729305 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 816/1628] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jul 14 10:52:50 2022] GET /identity/v3/roles => generated 1420 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:52:50.729305 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c96236-66eb-4b51-9a3e-d6c2ff209401 admin admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:52:50.738855 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68ba9a0-d509-42f5-a972-841a572458b1 None None] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:52:50.741155 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c96236-66eb-4b51-9a3e-d6c2ff209401 admin admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:52:50.747183 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6792980-38ea-4087-8211-d1a4f6be396c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:52:50.749269 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6792980-38ea-4087-8211-d1a4f6be396c admin admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:52:50.749573 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6792980-38ea-4087-8211-d1a4f6be396c admin admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:52:50.749902 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6792980-38ea-4087-8211-d1a4f6be396c admin admin] PATH_INFO: `/v3/roles` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:52:50.750875 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6792980-38ea-4087-8211-d1a4f6be396c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:52:50.752736 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6792980-38ea-4087-8211-d1a4f6be396c admin admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:52:50.753334 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adce7d03-a665-40c9-aa36-95c3e5fe0e53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:52:50.754041 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adce7d03-a665-40c9-aa36-95c3e5fe0e53 admin admin] REQUEST_METHOD: `POST` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:52:50.754332 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adce7d03-a665-40c9-aa36-95c3e5fe0e53 admin admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:52:50.754610 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adce7d03-a665-40c9-aa36-95c3e5fe0e53 admin admin] PATH_INFO: `/v3/users` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:52:50.756998 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adce7d03-a665-40c9-aa36-95c3e5fe0e53 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:52:50.758996 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adce7d03-a665-40c9-aa36-95c3e5fe0e53 admin admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:52:50.766156 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 817/1629] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jul 14 10:52:50 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:52:50.767076 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6792980-38ea-4087-8211-d1a4f6be396c admin admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:52:50.778215 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6792980-38ea-4087-8211-d1a4f6be396c admin admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:52:50.783399 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0476413-3914-40fc-a573-294950cf2f7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:52:50.784240 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0476413-3914-40fc-a573-294950cf2f7c admin admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:52:50.784532 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0476413-3914-40fc-a573-294950cf2f7c admin admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:52:50.784839 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0476413-3914-40fc-a573-294950cf2f7c admin admin] PATH_INFO: `/v3/roles` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:52:50.785760 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0476413-3914-40fc-a573-294950cf2f7c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:52:50.787846 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0476413-3914-40fc-a573-294950cf2f7c admin admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:52:50.801904 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 813/1630] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Jul 14 10:52:50 2022] POST /identity/v3/users => generated 308 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:52:50.803740 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adce7d03-a665-40c9-aa36-95c3e5fe0e53 admin admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:52:50.814251 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 818/1631] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jul 14 10:52:50 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:52:50.815882 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0476413-3914-40fc-a573-294950cf2f7c admin admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:52:50.819843 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adce7d03-a665-40c9-aa36-95c3e5fe0e53 admin admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:52:50.829896 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f11d6c-378b-4db3-95fe-56b2d0108658 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26aa294c913c408499a913ec25bb677d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59391272ecbe48b0aa736cb43807be1d', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:52:50.830134 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0476413-3914-40fc-a573-294950cf2f7c admin admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:52:50.830253 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f11d6c-378b-4db3-95fe-56b2d0108658 service nova] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:52:50.830667 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f11d6c-378b-4db3-95fe-56b2d0108658 service nova] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:52:50.831069 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f11d6c-378b-4db3-95fe-56b2d0108658 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:52:50.834542 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1ab285-dd1d-4639-92a9-c4aa29b6210c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:52:50.835496 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1ab285-dd1d-4639-92a9-c4aa29b6210c admin admin] REQUEST_METHOD: `PUT` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:52:50.835780 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1ab285-dd1d-4639-92a9-c4aa29b6210c admin admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:52:50.836404 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1ab285-dd1d-4639-92a9-c4aa29b6210c admin admin] PATH_INFO: `/v3/projects/19b44d37bb6c45f9bf8ff3c6034be9f0/users/f0e63a7ea8814fb9ba7bc91187529d75/roles/153539819e5542df99269d2913bbecfb` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:52:50.857434 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1ab285-dd1d-4639-92a9-c4aa29b6210c admin admin] RBAC: Authorizing `identity:create_grant(project_id=19b44d37bb6c45f9bf8ff3c6034be9f0, user_id=f0e63a7ea8814fb9ba7bc91187529d75, role_id=153539819e5542df99269d2913bbecfb)` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:52:50.861604 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1ab285-dd1d-4639-92a9-c4aa29b6210c admin admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:52:50.882069 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 819/1632] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Jul 14 10:52:50 2022] PUT /identity/v3/projects/19b44d37bb6c45f9bf8ff3c6034be9f0/users/f0e63a7ea8814fb9ba7bc91187529d75/roles/153539819e5542df99269d2913bbecfb => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:52:50.883819 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1ab285-dd1d-4639-92a9-c4aa29b6210c admin admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:52:50.921227 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f11d6c-378b-4db3-95fe-56b2d0108658 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:52:50.924082 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f11d6c-378b-4db3-95fe-56b2d0108658 service nova] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:52:50.938969 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 814/1633] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jul 14 10:52:50 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:52:50.940985 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8023e13e-1cfa-456f-a8f8-dd8fd5086597 None None] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:52:50.941583 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8023e13e-1cfa-456f-a8f8-dd8fd5086597 None None] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:52:50.941874 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8023e13e-1cfa-456f-a8f8-dd8fd5086597 None None] PATH_INFO: `/` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:52:50.950257 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 815/1634] 10.222.0.16 () {54 vars in 912 bytes} [Thu Jul 14 10:52:50 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:52:50.951910 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8023e13e-1cfa-456f-a8f8-dd8fd5086597 None None] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:52:50.962640 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1ab285-dd1d-4639-92a9-c4aa29b6210c admin admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:52:50.969073 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d26e566-3be9-4860-adca-cb7ca5fac5ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:52:50.970008 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d26e566-3be9-4860-adca-cb7ca5fac5ab admin admin] REQUEST_METHOD: `PUT` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:52:50.970393 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d26e566-3be9-4860-adca-cb7ca5fac5ab admin admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:52:50.970680 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d26e566-3be9-4860-adca-cb7ca5fac5ab admin admin] PATH_INFO: `/v3/projects/e7cc12c08bf64c9eafbb9638668950ad/users/312cfe8eab7f45d7a74ad2d5808ccc48/roles/153539819e5542df99269d2913bbecfb` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:52:50.971069 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8023e13e-1cfa-456f-a8f8-dd8fd5086597 None None] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:52:50.977854 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1458a7f-62f3-49e1-a892-c01a97ccdd83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:52:50.978649 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1458a7f-62f3-49e1-a892-c01a97ccdd83 admin admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:52:50.979700 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1458a7f-62f3-49e1-a892-c01a97ccdd83 admin admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:52:50.979980 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1458a7f-62f3-49e1-a892-c01a97ccdd83 admin admin] PATH_INFO: `/v3/roles` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:52:50.981557 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1458a7f-62f3-49e1-a892-c01a97ccdd83 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:52:50.984476 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1458a7f-62f3-49e1-a892-c01a97ccdd83 admin admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:52:50.990275 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d26e566-3be9-4860-adca-cb7ca5fac5ab admin admin] RBAC: Authorizing `identity:create_grant(project_id=e7cc12c08bf64c9eafbb9638668950ad, user_id=312cfe8eab7f45d7a74ad2d5808ccc48, role_id=153539819e5542df99269d2913bbecfb)` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:52:50.993683 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d26e566-3be9-4860-adca-cb7ca5fac5ab admin admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:52:51.001267 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 816/1635] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jul 14 10:52:50 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:52:51.002743 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1458a7f-62f3-49e1-a892-c01a97ccdd83 admin admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:52:51.019180 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 820/1636] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Jul 14 10:52:50 2022] PUT /identity/v3/projects/e7cc12c08bf64c9eafbb9638668950ad/users/312cfe8eab7f45d7a74ad2d5808ccc48/roles/153539819e5542df99269d2913bbecfb => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:52:51.019180 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d26e566-3be9-4860-adca-cb7ca5fac5ab admin admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:52:51.019493 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1458a7f-62f3-49e1-a892-c01a97ccdd83 admin admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:52:51.102082 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d26e566-3be9-4860-adca-cb7ca5fac5ab admin admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:52:51.104498 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36951e18-adcb-45c9-9481-a477545c0999 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:52:51.105571 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36951e18-adcb-45c9-9481-a477545c0999 admin admin] REQUEST_METHOD: `PUT` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:52:51.105863 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36951e18-adcb-45c9-9481-a477545c0999 admin admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:52:51.106139 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36951e18-adcb-45c9-9481-a477545c0999 admin admin] PATH_INFO: `/v3/projects/6921f74179ea4910b6e7efa7702d1647/users/71c9d27cacc0467181655afc5a157d41/roles/153539819e5542df99269d2913bbecfb` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:52:51.106769 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42eb950f-135c-4227-b52b-3d1de03bf0bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:52:51.107827 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42eb950f-135c-4227-b52b-3d1de03bf0bf admin admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:52:51.108210 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42eb950f-135c-4227-b52b-3d1de03bf0bf admin admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:52:51.108501 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42eb950f-135c-4227-b52b-3d1de03bf0bf admin admin] PATH_INFO: `/v3/roles` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:52:51.109054 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36951e18-adcb-45c9-9481-a477545c0999 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6921f74179ea4910b6e7efa7702d1647, user_id=71c9d27cacc0467181655afc5a157d41, role_id=153539819e5542df99269d2913bbecfb)` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:52:51.109372 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42eb950f-135c-4227-b52b-3d1de03bf0bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:52:51.110967 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42eb950f-135c-4227-b52b-3d1de03bf0bf admin admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:52:51.112119 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36951e18-adcb-45c9-9481-a477545c0999 admin admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:52:51.125087 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 821/1637] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jul 14 10:52:51 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:52:51.126515 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7174e7-01f7-48fd-92cc-a71f1f11a384 None None] REQUEST_METHOD: `POST` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:52:51.126808 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7174e7-01f7-48fd-92cc-a71f1f11a384 None None] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:52:51.127381 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7174e7-01f7-48fd-92cc-a71f1f11a384 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:52:51.131506 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 817/1638] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Jul 14 10:52:51 2022] PUT /identity/v3/projects/6921f74179ea4910b6e7efa7702d1647/users/71c9d27cacc0467181655afc5a157d41/roles/153539819e5542df99269d2913bbecfb => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:52:51.132491 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36951e18-adcb-45c9-9481-a477545c0999 admin admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:52:51.170184 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.auth.core [None req-fa7174e7-01f7-48fd-92cc-a71f1f11a384 None None] MFA Rules not processed for user `26aa294c913c408499a913ec25bb677d`. Rule list: `[]` (Enabled: `True`). {{(pid=86655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:52:51.175366 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-fa7174e7-01f7-48fd-92cc-a71f1f11a384 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:52:51.205566 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:52:51.239794 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:52:51.270117 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36951e18-adcb-45c9-9481-a477545c0999 admin admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:52:51.287739 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1eeb2fb-4e6e-42ce-b4e7-4410232678a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:52:51.288659 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1eeb2fb-4e6e-42ce-b4e7-4410232678a1 admin admin] REQUEST_METHOD: `PUT` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:52:51.288978 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1eeb2fb-4e6e-42ce-b4e7-4410232678a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:52:51.289259 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1eeb2fb-4e6e-42ce-b4e7-4410232678a1 admin admin] PATH_INFO: `/v3/projects/580f8441db3b41ad83682ec4253dfd0e/users/040a3be1ceaf44d08dd2213326815201/roles/153539819e5542df99269d2913bbecfb` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:52:51.291950 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 822/1639] 10.222.0.16 () {58 vars in 1009 bytes} [Thu Jul 14 10:52:51 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:52:51.292864 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7174e7-01f7-48fd-92cc-a71f1f11a384 None None] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:52:51.309263 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7174e7-01f7-48fd-92cc-a71f1f11a384 None None] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:52:51.310008 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1eeb2fb-4e6e-42ce-b4e7-4410232678a1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=580f8441db3b41ad83682ec4253dfd0e, user_id=040a3be1ceaf44d08dd2213326815201, role_id=153539819e5542df99269d2913bbecfb)` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:52:51.313371 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1eeb2fb-4e6e-42ce-b4e7-4410232678a1 admin admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:52:51.315885 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc391da2-8549-48d2-bb14-49aae2eec741 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:52:51.316976 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc391da2-8549-48d2-bb14-49aae2eec741 admin admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:52:51.333854 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc391da2-8549-48d2-bb14-49aae2eec741 admin admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:52:51.337375 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc391da2-8549-48d2-bb14-49aae2eec741 admin admin] PATH_INFO: `/v3/roles` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:52:51.338384 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc391da2-8549-48d2-bb14-49aae2eec741 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:52:51.339336 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 818/1640] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Jul 14 10:52:51 2022] PUT /identity/v3/projects/580f8441db3b41ad83682ec4253dfd0e/users/040a3be1ceaf44d08dd2213326815201/roles/153539819e5542df99269d2913bbecfb => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:52:51.340268 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc391da2-8549-48d2-bb14-49aae2eec741 admin admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:52:51.340401 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1eeb2fb-4e6e-42ce-b4e7-4410232678a1 admin admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:52:51.368832 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 823/1641] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jul 14 10:52:51 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:52:51.379939 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10daf15-a5b1-4c0c-a873-c7e5a0b5b230 None None] REQUEST_METHOD: `POST` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:52:51.380317 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10daf15-a5b1-4c0c-a873-c7e5a0b5b230 None None] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:52:51.380672 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10daf15-a5b1-4c0c-a873-c7e5a0b5b230 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:52:51.456478 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.auth.core [None req-c10daf15-a5b1-4c0c-a873-c7e5a0b5b230 None None] MFA Rules not processed for user `71c9d27cacc0467181655afc5a157d41`. Rule list: `[]` (Enabled: `True`). {{(pid=86655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:52:51.457858 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-c10daf15-a5b1-4c0c-a873-c7e5a0b5b230 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:52:51.526533 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1eeb2fb-4e6e-42ce-b4e7-4410232678a1 admin admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:52:51.543027 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c821c39f-a4e3-4660-b3e2-50494cb2bf31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:52:51.544093 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c821c39f-a4e3-4660-b3e2-50494cb2bf31 admin admin] REQUEST_METHOD: `PUT` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:52:51.544382 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c821c39f-a4e3-4660-b3e2-50494cb2bf31 admin admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:52:51.544691 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c821c39f-a4e3-4660-b3e2-50494cb2bf31 admin admin] PATH_INFO: `/v3/projects/19b44d37bb6c45f9bf8ff3c6034be9f0/users/f0e63a7ea8814fb9ba7bc91187529d75/roles/153539819e5542df99269d2913bbecfb` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:52:51.549978 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c821c39f-a4e3-4660-b3e2-50494cb2bf31 admin admin] RBAC: Authorizing `identity:create_grant(project_id=19b44d37bb6c45f9bf8ff3c6034be9f0, user_id=f0e63a7ea8814fb9ba7bc91187529d75, role_id=153539819e5542df99269d2913bbecfb)` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:52:51.552682 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c821c39f-a4e3-4660-b3e2-50494cb2bf31 admin admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:52:51.587873 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 819/1642] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Jul 14 10:52:51 2022] PUT /identity/v3/projects/19b44d37bb6c45f9bf8ff3c6034be9f0/users/f0e63a7ea8814fb9ba7bc91187529d75/roles/153539819e5542df99269d2913bbecfb => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:52:51.588931 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c821c39f-a4e3-4660-b3e2-50494cb2bf31 admin admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:52:51.640684 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 824/1643] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jul 14 10:52:51 2022] POST /identity/v3/auth/tokens => generated 3291 bytes in 271 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:52:51.644424 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d696b9-0e70-4239-8de9-4f174ce6aa0e None None] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:52:51.646945 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d696b9-0e70-4239-8de9-4f174ce6aa0e None None] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:52:51.647501 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d696b9-0e70-4239-8de9-4f174ce6aa0e None None] PATH_INFO: `/` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:52:51.652701 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 825/1644] 10.222.0.16 () {54 vars in 912 bytes} [Thu Jul 14 10:52:51 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:52:51.654802 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d696b9-0e70-4239-8de9-4f174ce6aa0e None None] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:52:51.715926 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c821c39f-a4e3-4660-b3e2-50494cb2bf31 admin admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:52:51.723923 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f08faf6-810f-472a-911a-fced2a5fdeab service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68382432147a48c3b62271fd2a2eab04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59391272ecbe48b0aa736cb43807be1d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:52:51.724608 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f08faf6-810f-472a-911a-fced2a5fdeab service cinder] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:52:51.724968 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f08faf6-810f-472a-911a-fced2a5fdeab service cinder] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:52:51.725212 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f08faf6-810f-472a-911a-fced2a5fdeab service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:52:51.807585 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d696b9-0e70-4239-8de9-4f174ce6aa0e None None] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:52:51.819719 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b77a53-aa1a-4084-880c-f4105c146036 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:52:51.820409 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b77a53-aa1a-4084-880c-f4105c146036 admin admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:52:51.820697 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b77a53-aa1a-4084-880c-f4105c146036 admin admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:52:51.821004 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b77a53-aa1a-4084-880c-f4105c146036 admin admin] PATH_INFO: `/v3/roles` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:52:51.821751 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b77a53-aa1a-4084-880c-f4105c146036 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:52:51.823363 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b77a53-aa1a-4084-880c-f4105c146036 admin admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:52:51.844543 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 826/1645] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jul 14 10:52:51 2022] GET /identity/v3/roles => generated 1420 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:52:51.845944 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b77a53-aa1a-4084-880c-f4105c146036 admin admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:52:51.865325 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b77a53-aa1a-4084-880c-f4105c146036 admin admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:52:51.880498 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607e288d-c82b-470f-b83d-43b9a7357fbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:52:51.881436 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607e288d-c82b-470f-b83d-43b9a7357fbb admin admin] REQUEST_METHOD: `PUT` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:52:51.881725 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607e288d-c82b-470f-b83d-43b9a7357fbb admin admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:52:51.882007 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607e288d-c82b-470f-b83d-43b9a7357fbb admin admin] PATH_INFO: `/v3/projects/e7cc12c08bf64c9eafbb9638668950ad/users/312cfe8eab7f45d7a74ad2d5808ccc48/roles/153539819e5542df99269d2913bbecfb` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:52:51.884929 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607e288d-c82b-470f-b83d-43b9a7357fbb admin admin] RBAC: Authorizing `identity:create_grant(project_id=e7cc12c08bf64c9eafbb9638668950ad, user_id=312cfe8eab7f45d7a74ad2d5808ccc48, role_id=153539819e5542df99269d2913bbecfb)` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:52:51.887792 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607e288d-c82b-470f-b83d-43b9a7357fbb admin admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:52:51.893841 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f08faf6-810f-472a-911a-fced2a5fdeab service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:52:51.895886 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f08faf6-810f-472a-911a-fced2a5fdeab service cinder] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:52:51.914159 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 827/1646] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Jul 14 10:52:51 2022] PUT /identity/v3/projects/e7cc12c08bf64c9eafbb9638668950ad/users/312cfe8eab7f45d7a74ad2d5808ccc48/roles/153539819e5542df99269d2913bbecfb => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:52:51.917653 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b247f67-4fa8-44b5-8bf7-fc4bdf47b42e None None] REQUEST_METHOD: `POST` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:52:51.917954 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b247f67-4fa8-44b5-8bf7-fc4bdf47b42e None None] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:52:51.918236 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b247f67-4fa8-44b5-8bf7-fc4bdf47b42e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:52:51.933184 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 820/1647] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jul 14 10:52:51 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:52:51.934181 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f08faf6-810f-472a-911a-fced2a5fdeab service cinder] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:52:51.948864 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:52:51.961254 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f08faf6-810f-472a-911a-fced2a5fdeab service cinder] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:52:51.961933 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:52:51.981391 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.auth.core [None req-9b247f67-4fa8-44b5-8bf7-fc4bdf47b42e None None] MFA Rules not processed for user `f0e63a7ea8814fb9ba7bc91187529d75`. Rule list: `[]` (Enabled: `True`). {{(pid=86655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:52:51.982973 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-9b247f67-4fa8-44b5-8bf7-fc4bdf47b42e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:52:52.088873 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a32e24-53f0-4269-9b5f-c9bba99a65c5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68382432147a48c3b62271fd2a2eab04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59391272ecbe48b0aa736cb43807be1d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:52:52.089939 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a32e24-53f0-4269-9b5f-c9bba99a65c5 service cinder] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:52:52.089939 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a32e24-53f0-4269-9b5f-c9bba99a65c5 service cinder] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:52:52.090174 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a32e24-53f0-4269-9b5f-c9bba99a65c5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:52:52.188456 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 828/1648] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jul 14 10:52:51 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:52:52.190036 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e533b81-5c5f-4479-bbc8-0692725814fe None None] REQUEST_METHOD: `POST` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:52:52.190329 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e533b81-5c5f-4479-bbc8-0692725814fe None None] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:52:52.192175 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e533b81-5c5f-4479-bbc8-0692725814fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:52:52.249480 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a32e24-53f0-4269-9b5f-c9bba99a65c5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:52:52.250951 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a32e24-53f0-4269-9b5f-c9bba99a65c5 service cinder] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:52:52.254107 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.auth.core [None req-1e533b81-5c5f-4479-bbc8-0692725814fe None None] MFA Rules not processed for user `26aa294c913c408499a913ec25bb677d`. Rule list: `[]` (Enabled: `True`). {{(pid=86655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:52:52.259460 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-1e533b81-5c5f-4479-bbc8-0692725814fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:52:52.305011 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 821/1649] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jul 14 10:52:51 2022] GET /identity/v3/auth/tokens => generated 3291 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:52:52.312298 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a32e24-53f0-4269-9b5f-c9bba99a65c5 service cinder] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:52:52.422179 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 829/1650] 10.222.0.16 () {58 vars in 1009 bytes} [Thu Jul 14 10:52:52 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:52:52.424232 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2af6e76-fcb2-4877-88cc-c7aacd6f4a9c None None] REQUEST_METHOD: `POST` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:52:52.424509 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2af6e76-fcb2-4877-88cc-c7aacd6f4a9c None None] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:52:52.424920 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2af6e76-fcb2-4877-88cc-c7aacd6f4a9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:52:52.478871 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.auth.core [None req-b2af6e76-fcb2-4877-88cc-c7aacd6f4a9c None None] MFA Rules not processed for user `312cfe8eab7f45d7a74ad2d5808ccc48`. Rule list: `[]` (Enabled: `True`). {{(pid=86655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:52:52.487440 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-b2af6e76-fcb2-4877-88cc-c7aacd6f4a9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:52:52.501500 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a32e24-53f0-4269-9b5f-c9bba99a65c5 service cinder] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:52:52.507525 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb47425-fb6e-4f06-941a-785dd33f743e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:52:52.508326 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb47425-fb6e-4f06-941a-785dd33f743e admin admin] REQUEST_METHOD: `PUT` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:52:52.508611 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb47425-fb6e-4f06-941a-785dd33f743e admin admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:52:52.509060 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb47425-fb6e-4f06-941a-785dd33f743e admin admin] PATH_INFO: `/v3/projects/580f8441db3b41ad83682ec4253dfd0e/users/040a3be1ceaf44d08dd2213326815201/roles/153539819e5542df99269d2913bbecfb` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:52:52.511094 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb47425-fb6e-4f06-941a-785dd33f743e admin admin] RBAC: Authorizing `identity:create_grant(project_id=580f8441db3b41ad83682ec4253dfd0e, user_id=040a3be1ceaf44d08dd2213326815201, role_id=153539819e5542df99269d2913bbecfb)` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:52:52.513800 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb47425-fb6e-4f06-941a-785dd33f743e admin admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:52:52.535666 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 822/1651] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Jul 14 10:52:52 2022] PUT /identity/v3/projects/580f8441db3b41ad83682ec4253dfd0e/users/040a3be1ceaf44d08dd2213326815201/roles/153539819e5542df99269d2913bbecfb => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:52:52.536873 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb47425-fb6e-4f06-941a-785dd33f743e admin admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:52:52.631745 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 830/1652] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jul 14 10:52:52 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:52:52.634302 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86fb056-1fd8-40a1-bcb0-21171ad71441 None None] REQUEST_METHOD: `POST` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:52:52.634546 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86fb056-1fd8-40a1-bcb0-21171ad71441 None None] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:52:52.634832 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86fb056-1fd8-40a1-bcb0-21171ad71441 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:52:52.641701 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:52:52.650915 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb47425-fb6e-4f06-941a-785dd33f743e admin admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:52:52.658111 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=100 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:52:52.664074 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcdda35-4a63-4468-b4df-2b18711d919d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68382432147a48c3b62271fd2a2eab04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59391272ecbe48b0aa736cb43807be1d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:52:52.664762 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcdda35-4a63-4468-b4df-2b18711d919d service cinder] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:52:52.665073 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcdda35-4a63-4468-b4df-2b18711d919d service cinder] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:52:52.665357 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcdda35-4a63-4468-b4df-2b18711d919d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:52:52.670491 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.auth.core [None req-d86fb056-1fd8-40a1-bcb0-21171ad71441 None None] MFA Rules not processed for user `040a3be1ceaf44d08dd2213326815201`. Rule list: `[]` (Enabled: `True`). {{(pid=86655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:52:52.672067 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-d86fb056-1fd8-40a1-bcb0-21171ad71441 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:52:52.766319 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 831/1653] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jul 14 10:52:52 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:52:52.822171 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbcdda35-4a63-4468-b4df-2b18711d919d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:52:52.823657 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbcdda35-4a63-4468-b4df-2b18711d919d service cinder] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:52:52.850566 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 823/1654] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jul 14 10:52:52 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:52:52.915651 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86fb056-1fd8-40a1-bcb0-21171ad71441 None None] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:52:53.092257 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcdda35-4a63-4468-b4df-2b18711d919d service cinder] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:52:53.103383 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcdda35-4a63-4468-b4df-2b18711d919d service cinder] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:52:53.112331 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86fb056-1fd8-40a1-bcb0-21171ad71441 None None] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:52:53.117493 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd83993-393d-40a2-83ea-49f3be1256c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:52:53.118755 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd83993-393d-40a2-83ea-49f3be1256c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:52:53.119212 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd83993-393d-40a2-83ea-49f3be1256c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:52:53.119763 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd83993-393d-40a2-83ea-49f3be1256c1 admin admin] PATH_INFO: `/v3/users/11fba34d28ce4520b8f98de6391ef912` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:52:53.120655 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490eb317-f6dc-423a-bd98-b0a935bdd1c9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68382432147a48c3b62271fd2a2eab04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59391272ecbe48b0aa736cb43807be1d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:52:53.121845 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd83993-393d-40a2-83ea-49f3be1256c1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=11fba34d28ce4520b8f98de6391ef912)` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:52:53.122766 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490eb317-f6dc-423a-bd98-b0a935bdd1c9 service cinder] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:52:53.123061 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490eb317-f6dc-423a-bd98-b0a935bdd1c9 service cinder] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:52:53.123482 dv-cinder-846146-7-smb devstack@keystone.service[86655]: WARNING py.warnings [None req-1fd83993-393d-40a2-83ea-49f3be1256c1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 14 10:52:53.123482 dv-cinder-846146-7-smb devstack@keystone.service[86655]: warnings.warn(msg) Jul 14 10:52:53.123482 dv-cinder-846146-7-smb devstack@keystone.service[86655]: Jul 14 10:52:53.124306 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490eb317-f6dc-423a-bd98-b0a935bdd1c9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:52:53.125602 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd83993-393d-40a2-83ea-49f3be1256c1 admin admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:52:53.265955 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-1fd83993-393d-40a2-83ea-49f3be1256c1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '11fba34d28ce4520b8f98de6391ef912'} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:52:53.292609 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-1fd83993-393d-40a2-83ea-49f3be1256c1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '11fba34d28ce4520b8f98de6391ef912'} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:52:53.293811 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-1fd83993-393d-40a2-83ea-49f3be1256c1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '11fba34d28ce4520b8f98de6391ef912'} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:52:53.320856 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-1fd83993-393d-40a2-83ea-49f3be1256c1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '11fba34d28ce4520b8f98de6391ef912'} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:52:53.323804 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-1fd83993-393d-40a2-83ea-49f3be1256c1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '11fba34d28ce4520b8f98de6391ef912'} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:52:53.380757 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490eb317-f6dc-423a-bd98-b0a935bdd1c9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:52:53.386426 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490eb317-f6dc-423a-bd98-b0a935bdd1c9 service cinder] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:52:53.409929 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 832/1655] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Jul 14 10:52:52 2022] DELETE /identity/v3/users/11fba34d28ce4520b8f98de6391ef912 => generated 0 bytes in 495 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:52:53.415730 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd83993-393d-40a2-83ea-49f3be1256c1 admin admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:52:53.418437 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-1fd83993-393d-40a2-83ea-49f3be1256c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:52:53.429355 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 824/1656] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jul 14 10:52:53 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 10:52:53.434215 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439f93fc-2195-4408-93e0-fa88b5657776 None None] REQUEST_METHOD: `POST` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:52:53.434871 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439f93fc-2195-4408-93e0-fa88b5657776 None None] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:52:53.439482 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439f93fc-2195-4408-93e0-fa88b5657776 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:52:53.464012 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:52:53.483992 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.auth.core [None req-439f93fc-2195-4408-93e0-fa88b5657776 None None] MFA Rules not processed for user `ae4bcdd8106d4bebbdcae96be33505bc`. Rule list: `[]` (Enabled: `True`). {{(pid=86656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:52:53.485475 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-439f93fc-2195-4408-93e0-fa88b5657776 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:52:53.592849 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd83993-393d-40a2-83ea-49f3be1256c1 admin admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:52:53.609547 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6afe4f-327c-456c-bd8b-06f01d03eaa3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68382432147a48c3b62271fd2a2eab04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59391272ecbe48b0aa736cb43807be1d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:52:53.610354 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6afe4f-327c-456c-bd8b-06f01d03eaa3 service cinder] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:52:53.614518 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6afe4f-327c-456c-bd8b-06f01d03eaa3 service cinder] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:52:53.616914 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6afe4f-327c-456c-bd8b-06f01d03eaa3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:52:53.624129 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-ca6afe4f-327c-456c-bd8b-06f01d03eaa3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:52:53.675585 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 825/1657] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jul 14 10:52:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:52:53.709985 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439f93fc-2195-4408-93e0-fa88b5657776 None None] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:52:53.711766 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-439f93fc-2195-4408-93e0-fa88b5657776 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:52:53.781516 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=100 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:52:53.798831 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6afe4f-327c-456c-bd8b-06f01d03eaa3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:52:53.801810 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6afe4f-327c-456c-bd8b-06f01d03eaa3 service cinder] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:52:53.816131 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 833/1658] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jul 14 10:52:53 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:52:53.852435 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439f93fc-2195-4408-93e0-fa88b5657776 None None] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:52:53.864152 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661a0cd3-a254-4272-92ff-4d37aeaa3293 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dddf93691844886982c91fea974385d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59391272ecbe48b0aa736cb43807be1d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:52:53.864900 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661a0cd3-a254-4272-92ff-4d37aeaa3293 service neutron] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:52:53.865253 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661a0cd3-a254-4272-92ff-4d37aeaa3293 service neutron] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:52:53.865440 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661a0cd3-a254-4272-92ff-4d37aeaa3293 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:52:53.883789 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6afe4f-327c-456c-bd8b-06f01d03eaa3 service cinder] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:52:53.898130 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661a0cd3-a254-4272-92ff-4d37aeaa3293 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:52:53.899799 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661a0cd3-a254-4272-92ff-4d37aeaa3293 service neutron] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:52:53.905922 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6afe4f-327c-456c-bd8b-06f01d03eaa3 service cinder] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:52:53.917866 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 826/1659] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jul 14 10:52:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:52:53.923307 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95413a2-1e3e-4a77-b361-e798554ff82e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68382432147a48c3b62271fd2a2eab04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59391272ecbe48b0aa736cb43807be1d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:52:53.924315 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95413a2-1e3e-4a77-b361-e798554ff82e service cinder] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:52:53.924847 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95413a2-1e3e-4a77-b361-e798554ff82e service cinder] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:52:53.926332 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95413a2-1e3e-4a77-b361-e798554ff82e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:52:53.938662 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-e95413a2-1e3e-4a77-b361-e798554ff82e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:52:54.182036 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95413a2-1e3e-4a77-b361-e798554ff82e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:52:54.183518 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95413a2-1e3e-4a77-b361-e798554ff82e service cinder] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:52:54.202508 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 834/1660] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jul 14 10:52:53 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:52:54.337134 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661a0cd3-a254-4272-92ff-4d37aeaa3293 service neutron] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:52:54.354703 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661a0cd3-a254-4272-92ff-4d37aeaa3293 service neutron] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:52:54.374551 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fbfddd-a4a3-4249-81de-f5635ea1edc6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68382432147a48c3b62271fd2a2eab04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59391272ecbe48b0aa736cb43807be1d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:52:54.375219 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fbfddd-a4a3-4249-81de-f5635ea1edc6 service cinder] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:52:54.375535 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fbfddd-a4a3-4249-81de-f5635ea1edc6 service cinder] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:52:54.375868 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fbfddd-a4a3-4249-81de-f5635ea1edc6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:52:54.381387 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-14fbfddd-a4a3-4249-81de-f5635ea1edc6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:52:54.577539 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14fbfddd-a4a3-4249-81de-f5635ea1edc6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:52:54.579890 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14fbfddd-a4a3-4249-81de-f5635ea1edc6 service cinder] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:52:54.607719 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 827/1661] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jul 14 10:52:54 2022] GET /identity/v3/auth/tokens => generated 3224 bytes in 270 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:52:54.912396 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe6934d-d439-4cdd-b587-ff197e4df086 None None] REQUEST_METHOD: `POST` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:52:54.912909 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe6934d-d439-4cdd-b587-ff197e4df086 None None] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:52:54.915705 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe6934d-d439-4cdd-b587-ff197e4df086 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:52:54.930897 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fbfddd-a4a3-4249-81de-f5635ea1edc6 service cinder] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:52:54.946413 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fbfddd-a4a3-4249-81de-f5635ea1edc6 service cinder] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:52:54.956735 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cea53f9-2337-44ca-b4ec-2cf83471764f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68382432147a48c3b62271fd2a2eab04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59391272ecbe48b0aa736cb43807be1d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:52:54.957626 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cea53f9-2337-44ca-b4ec-2cf83471764f service cinder] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:52:54.958246 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cea53f9-2337-44ca-b4ec-2cf83471764f service cinder] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:52:54.958585 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cea53f9-2337-44ca-b4ec-2cf83471764f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:52:54.960663 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-1cea53f9-2337-44ca-b4ec-2cf83471764f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:52:54.985305 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.auth.core [None req-cbe6934d-d439-4cdd-b587-ff197e4df086 None None] MFA Rules not processed for user `fae8e5bd232344cca09294651f4cd93e`. Rule list: `[]` (Enabled: `True`). {{(pid=86655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:52:54.986903 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-cbe6934d-d439-4cdd-b587-ff197e4df086 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:52:55.122723 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cea53f9-2337-44ca-b4ec-2cf83471764f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:52:55.126258 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cea53f9-2337-44ca-b4ec-2cf83471764f service cinder] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:52:55.142527 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=100 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:52:55.156194 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 828/1662] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jul 14 10:52:54 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:52:55.214365 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 835/1663] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jul 14 10:52:54 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 303 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:52:55.225984 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8644a3b2-4047-4b11-b6a6-794f42e9af89 None None] REQUEST_METHOD: `POST` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:52:55.226530 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8644a3b2-4047-4b11-b6a6-794f42e9af89 None None] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:52:55.226951 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8644a3b2-4047-4b11-b6a6-794f42e9af89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:52:55.266760 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.auth.core [None req-8644a3b2-4047-4b11-b6a6-794f42e9af89 None None] MFA Rules not processed for user `fae8e5bd232344cca09294651f4cd93e`. Rule list: `[]` (Enabled: `True`). {{(pid=86656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:52:55.270411 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-8644a3b2-4047-4b11-b6a6-794f42e9af89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:52:55.300100 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 829/1664] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jul 14 10:52:55 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:52:55.314211 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe6934d-d439-4cdd-b587-ff197e4df086 None None] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:52:55.320301 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-cbe6934d-d439-4cdd-b587-ff197e4df086 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:52:55.369222 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8644a3b2-4047-4b11-b6a6-794f42e9af89 None None] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:52:55.370698 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-8644a3b2-4047-4b11-b6a6-794f42e9af89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:52:55.407156 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8644a3b2-4047-4b11-b6a6-794f42e9af89 None None] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:52:55.428565 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05352323-b88e-4818-b2de-6fc5ec9945ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:52:55.429401 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05352323-b88e-4818-b2de-6fc5ec9945ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:52:55.429693 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05352323-b88e-4818-b2de-6fc5ec9945ac admin admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:52:55.429977 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05352323-b88e-4818-b2de-6fc5ec9945ac admin admin] PATH_INFO: `/v3/projects/5f9950e88221478d894497f9da700b04` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:52:55.437809 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05352323-b88e-4818-b2de-6fc5ec9945ac admin admin] RBAC: Authorizing `identity:delete_project(project_id=5f9950e88221478d894497f9da700b04)` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:52:55.440297 dv-cinder-846146-7-smb devstack@keystone.service[86656]: WARNING py.warnings [None req-05352323-b88e-4818-b2de-6fc5ec9945ac admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 14 10:52:55.440297 dv-cinder-846146-7-smb devstack@keystone.service[86656]: warnings.warn(msg) Jul 14 10:52:55.440297 dv-cinder-846146-7-smb devstack@keystone.service[86656]: Jul 14 10:52:55.441571 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05352323-b88e-4818-b2de-6fc5ec9945ac admin admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:52:55.591260 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-05352323-b88e-4818-b2de-6fc5ec9945ac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5f9950e88221478d894497f9da700b04', 'request_id': 'req-05352323-b88e-4818-b2de-6fc5ec9945ac'} {{(pid=86656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:52:55.597287 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:52:55.603083 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-05352323-b88e-4818-b2de-6fc5ec9945ac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5f9950e88221478d894497f9da700b04', 'request_id': 'req-05352323-b88e-4818-b2de-6fc5ec9945ac'} {{(pid=86656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:52:55.637282 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-05352323-b88e-4818-b2de-6fc5ec9945ac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5f9950e88221478d894497f9da700b04', 'request_id': 'req-05352323-b88e-4818-b2de-6fc5ec9945ac'} {{(pid=86656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:52:55.638536 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe6934d-d439-4cdd-b587-ff197e4df086 None None] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:52:55.672130 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-05352323-b88e-4818-b2de-6fc5ec9945ac admin admin] The token cache is being invalidate because project 5f9950e88221478d894497f9da700b04 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86656) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 10:52:55.672796 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-05352323-b88e-4818-b2de-6fc5ec9945ac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:52:55.673829 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-05352323-b88e-4818-b2de-6fc5ec9945ac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:52:55.675950 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 830/1665] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Jul 14 10:52:55 2022] DELETE /identity/v3/projects/5f9950e88221478d894497f9da700b04 => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:52:55.677251 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05352323-b88e-4818-b2de-6fc5ec9945ac admin admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:52:55.687176 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-05352323-b88e-4818-b2de-6fc5ec9945ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:52:55.834153 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05352323-b88e-4818-b2de-6fc5ec9945ac admin admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:52:55.846861 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70502637-29fa-4813-8836-ecf357df622f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:52:55.850611 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70502637-29fa-4813-8836-ecf357df622f admin admin] REQUEST_METHOD: `DELETE` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:52:55.850925 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70502637-29fa-4813-8836-ecf357df622f admin admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:52:55.851212 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70502637-29fa-4813-8836-ecf357df622f admin admin] PATH_INFO: `/v3/users/b3664ed3f27c4cdfba774850be776ad7` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:52:55.856205 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70502637-29fa-4813-8836-ecf357df622f admin admin] RBAC: Authorizing `identity:delete_user(user_id=b3664ed3f27c4cdfba774850be776ad7)` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:52:55.861587 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70502637-29fa-4813-8836-ecf357df622f admin admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:52:55.914282 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fe1612-14ed-4eb8-aac6-d763e696ba1c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26aa294c913c408499a913ec25bb677d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59391272ecbe48b0aa736cb43807be1d', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:52:55.916711 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fe1612-14ed-4eb8-aac6-d763e696ba1c service nova] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:52:55.917345 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fe1612-14ed-4eb8-aac6-d763e696ba1c service nova] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:52:55.918500 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fe1612-14ed-4eb8-aac6-d763e696ba1c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:52:55.923984 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-c5fe1612-14ed-4eb8-aac6-d763e696ba1c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:52:55.978728 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-70502637-29fa-4813-8836-ecf357df622f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b3664ed3f27c4cdfba774850be776ad7'} {{(pid=86656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:52:55.994082 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-70502637-29fa-4813-8836-ecf357df622f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b3664ed3f27c4cdfba774850be776ad7'} {{(pid=86656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:52:55.994760 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-70502637-29fa-4813-8836-ecf357df622f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b3664ed3f27c4cdfba774850be776ad7'} {{(pid=86656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:52:56.006835 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-70502637-29fa-4813-8836-ecf357df622f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b3664ed3f27c4cdfba774850be776ad7'} {{(pid=86656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:52:56.008941 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-70502637-29fa-4813-8836-ecf357df622f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b3664ed3f27c4cdfba774850be776ad7'} {{(pid=86656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:52:56.034342 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 831/1666] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Jul 14 10:52:55 2022] DELETE /identity/v3/users/b3664ed3f27c4cdfba774850be776ad7 => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:52:56.035572 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70502637-29fa-4813-8836-ecf357df622f admin admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:52:56.037125 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-70502637-29fa-4813-8836-ecf357df622f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:52:56.072885 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5fe1612-14ed-4eb8-aac6-d763e696ba1c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:52:56.078033 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5fe1612-14ed-4eb8-aac6-d763e696ba1c service nova] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:52:56.097551 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 836/1667] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jul 14 10:52:55 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 779 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:52:56.097551 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83ea094-815c-49e8-a259-4c4a9ba14edf None None] REQUEST_METHOD: `POST` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:52:56.097551 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83ea094-815c-49e8-a259-4c4a9ba14edf None None] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:52:56.097551 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83ea094-815c-49e8-a259-4c4a9ba14edf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:52:56.134430 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:INSERT=2,keystone:DELETE=13,keystone:SELECT=85 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:52:56.141612 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70502637-29fa-4813-8836-ecf357df622f admin admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:52:56.150840 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f67974e-fe1d-4868-8feb-3cbe8278a873 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:52:56.151754 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f67974e-fe1d-4868-8feb-3cbe8278a873 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:52:56.152038 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f67974e-fe1d-4868-8feb-3cbe8278a873 admin admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:52:56.152818 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f67974e-fe1d-4868-8feb-3cbe8278a873 admin admin] PATH_INFO: `/v3/users/f0e63a7ea8814fb9ba7bc91187529d75` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:52:56.154759 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f67974e-fe1d-4868-8feb-3cbe8278a873 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f0e63a7ea8814fb9ba7bc91187529d75)` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:52:56.157053 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f67974e-fe1d-4868-8feb-3cbe8278a873 admin admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:52:56.161261 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.auth.core [None req-f83ea094-815c-49e8-a259-4c4a9ba14edf None None] MFA Rules not processed for user `ae4bcdd8106d4bebbdcae96be33505bc`. Rule list: `[]` (Enabled: `True`). {{(pid=86655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:52:56.165002 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-f83ea094-815c-49e8-a259-4c4a9ba14edf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:52:56.187483 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 837/1668] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jul 14 10:52:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:52:56.198965 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83ea094-815c-49e8-a259-4c4a9ba14edf None None] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:52:56.204339 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-f83ea094-815c-49e8-a259-4c4a9ba14edf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:52:56.241583 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-2f67974e-fe1d-4868-8feb-3cbe8278a873 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f0e63a7ea8814fb9ba7bc91187529d75'} {{(pid=86656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:52:56.251601 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=100 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:52:56.255639 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-2f67974e-fe1d-4868-8feb-3cbe8278a873 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f0e63a7ea8814fb9ba7bc91187529d75'} {{(pid=86656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:52:56.256351 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-2f67974e-fe1d-4868-8feb-3cbe8278a873 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f0e63a7ea8814fb9ba7bc91187529d75'} {{(pid=86656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:52:56.266639 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-2f67974e-fe1d-4868-8feb-3cbe8278a873 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f0e63a7ea8814fb9ba7bc91187529d75'} {{(pid=86656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:52:56.267002 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-2f67974e-fe1d-4868-8feb-3cbe8278a873 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f0e63a7ea8814fb9ba7bc91187529d75'} {{(pid=86656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:52:56.321412 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 832/1669] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Jul 14 10:52:56 2022] DELETE /identity/v3/users/f0e63a7ea8814fb9ba7bc91187529d75 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:52:56.348851 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83ea094-815c-49e8-a259-4c4a9ba14edf None None] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:52:56.434716 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0711d6-a5aa-472a-83a4-ff5d717f3bc7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dddf93691844886982c91fea974385d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59391272ecbe48b0aa736cb43807be1d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:52:56.438464 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0711d6-a5aa-472a-83a4-ff5d717f3bc7 service neutron] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:52:56.438949 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0711d6-a5aa-472a-83a4-ff5d717f3bc7 service neutron] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:52:56.439437 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0711d6-a5aa-472a-83a4-ff5d717f3bc7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:52:56.444251 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-3a0711d6-a5aa-472a-83a4-ff5d717f3bc7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:52:56.631697 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0711d6-a5aa-472a-83a4-ff5d717f3bc7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:52:56.636880 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0711d6-a5aa-472a-83a4-ff5d717f3bc7 service neutron] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:52:56.668634 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 838/1670] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jul 14 10:52:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 470 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:52:56.843263 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f077942-580b-4656-8c31-ae90523f0478 None None] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:52:56.843562 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f077942-580b-4656-8c31-ae90523f0478 None None] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:52:56.843866 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f077942-580b-4656-8c31-ae90523f0478 None None] PATH_INFO: `/` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:52:56.845827 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 833/1671] 10.222.0.16 () {54 vars in 912 bytes} [Thu Jul 14 10:52:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:52:56.852004 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2318d8-f708-468c-ab2b-6ad36e8be6c5 None None] REQUEST_METHOD: `POST` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:52:56.852371 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2318d8-f708-468c-ab2b-6ad36e8be6c5 None None] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:52:56.852567 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2318d8-f708-468c-ab2b-6ad36e8be6c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:52:56.936658 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.auth.core [None req-ee2318d8-f708-468c-ab2b-6ad36e8be6c5 None None] MFA Rules not processed for user `4dddf93691844886982c91fea974385d`. Rule list: `[]` (Enabled: `True`). {{(pid=86655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:52:56.938305 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-ee2318d8-f708-468c-ab2b-6ad36e8be6c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:52:56.948492 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 839/1672] 10.222.0.16 () {58 vars in 1009 bytes} [Thu Jul 14 10:52:56 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 10:52:57.002904 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f077942-580b-4656-8c31-ae90523f0478 None None] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:52:57.005384 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-0f077942-580b-4656-8c31-ae90523f0478 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:52:57.042139 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f077942-580b-4656-8c31-ae90523f0478 None None] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:52:57.055313 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e233d253-5a43-48ed-b25b-64a969aef557 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dddf93691844886982c91fea974385d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59391272ecbe48b0aa736cb43807be1d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:52:57.056129 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e233d253-5a43-48ed-b25b-64a969aef557 service neutron] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:52:57.056324 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e233d253-5a43-48ed-b25b-64a969aef557 service neutron] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:52:57.056615 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e233d253-5a43-48ed-b25b-64a969aef557 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:52:57.075189 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e233d253-5a43-48ed-b25b-64a969aef557 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:52:57.077254 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e233d253-5a43-48ed-b25b-64a969aef557 service neutron] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:52:57.099536 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 834/1673] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jul 14 10:52:57 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:52:57.119603 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2318d8-f708-468c-ab2b-6ad36e8be6c5 None None] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:52:57.121640 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-ee2318d8-f708-468c-ab2b-6ad36e8be6c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:52:57.155419 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2318d8-f708-468c-ab2b-6ad36e8be6c5 None None] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:52:57.173403 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc0d53b-00a9-47ce-912d-a6161d52756b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:52:57.174744 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc0d53b-00a9-47ce-912d-a6161d52756b admin admin] REQUEST_METHOD: `DELETE` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:52:57.175313 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc0d53b-00a9-47ce-912d-a6161d52756b admin admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:52:57.176118 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc0d53b-00a9-47ce-912d-a6161d52756b admin admin] PATH_INFO: `/v3/projects/19b44d37bb6c45f9bf8ff3c6034be9f0` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:52:57.177971 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc0d53b-00a9-47ce-912d-a6161d52756b admin admin] RBAC: Authorizing `identity:delete_project(project_id=19b44d37bb6c45f9bf8ff3c6034be9f0)` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:52:57.183069 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc0d53b-00a9-47ce-912d-a6161d52756b admin admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:52:57.299049 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e233d253-5a43-48ed-b25b-64a969aef557 service neutron] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:52:57.301931 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-e233d253-5a43-48ed-b25b-64a969aef557 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:52:57.337506 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-0dc0d53b-00a9-47ce-912d-a6161d52756b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '19b44d37bb6c45f9bf8ff3c6034be9f0', 'request_id': 'req-0dc0d53b-00a9-47ce-912d-a6161d52756b'} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:52:57.355868 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-0dc0d53b-00a9-47ce-912d-a6161d52756b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '19b44d37bb6c45f9bf8ff3c6034be9f0', 'request_id': 'req-0dc0d53b-00a9-47ce-912d-a6161d52756b'} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:52:57.357845 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:52:57.359993 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e233d253-5a43-48ed-b25b-64a969aef557 service neutron] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:52:57.372847 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-0dc0d53b-00a9-47ce-912d-a6161d52756b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '19b44d37bb6c45f9bf8ff3c6034be9f0', 'request_id': 'req-0dc0d53b-00a9-47ce-912d-a6161d52756b'} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:52:57.426049 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-0dc0d53b-00a9-47ce-912d-a6161d52756b admin admin] The token cache is being invalidate because project 19b44d37bb6c45f9bf8ff3c6034be9f0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86655) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 10:52:57.426353 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-0dc0d53b-00a9-47ce-912d-a6161d52756b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:52:57.430744 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-0dc0d53b-00a9-47ce-912d-a6161d52756b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:52:57.435133 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 840/1674] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Jul 14 10:52:57 2022] DELETE /identity/v3/projects/19b44d37bb6c45f9bf8ff3c6034be9f0 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:52:57.440983 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55046726-f78f-4c84-bca7-b470ae12bf3f None None] REQUEST_METHOD: `POST` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:52:57.441276 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55046726-f78f-4c84-bca7-b470ae12bf3f None None] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:52:57.441555 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55046726-f78f-4c84-bca7-b470ae12bf3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:52:57.520250 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.auth.core [None req-55046726-f78f-4c84-bca7-b470ae12bf3f None None] MFA Rules not processed for user `ae4bcdd8106d4bebbdcae96be33505bc`. Rule list: `[]` (Enabled: `True`). {{(pid=86655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:52:57.522180 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-55046726-f78f-4c84-bca7-b470ae12bf3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:52:57.536998 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e7644a-a60b-429c-aee5-983f512e29d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:52:57.538064 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e7644a-a60b-429c-aee5-983f512e29d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:52:57.540044 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e7644a-a60b-429c-aee5-983f512e29d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:52:57.540288 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e7644a-a60b-429c-aee5-983f512e29d6 admin admin] PATH_INFO: `/v3/users/2a4149579fc9422595a8085a70a2ee1d` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:52:57.543337 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e7644a-a60b-429c-aee5-983f512e29d6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2a4149579fc9422595a8085a70a2ee1d)` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:52:57.545629 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e7644a-a60b-429c-aee5-983f512e29d6 admin admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:52:57.556214 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 841/1675] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jul 14 10:52:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:52:57.556214 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55046726-f78f-4c84-bca7-b470ae12bf3f None None] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:52:57.558626 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-55046726-f78f-4c84-bca7-b470ae12bf3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:52:57.615546 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55046726-f78f-4c84-bca7-b470ae12bf3f None None] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:52:57.632021 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5954a3-8429-4afa-a63e-a65d835ada27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:52:57.634447 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5954a3-8429-4afa-a63e-a65d835ada27 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:52:57.634769 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5954a3-8429-4afa-a63e-a65d835ada27 admin admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:52:57.635023 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5954a3-8429-4afa-a63e-a65d835ada27 admin admin] PATH_INFO: `/v3/projects/db93acd65a8348249975784e0de4cbd5` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:52:57.640613 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5954a3-8429-4afa-a63e-a65d835ada27 admin admin] RBAC: Authorizing `identity:delete_project(project_id=db93acd65a8348249975784e0de4cbd5)` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:52:57.649219 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5954a3-8429-4afa-a63e-a65d835ada27 admin admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:52:57.680681 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-e5e7644a-a60b-429c-aee5-983f512e29d6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2a4149579fc9422595a8085a70a2ee1d'} {{(pid=86656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:52:57.700671 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-e5e7644a-a60b-429c-aee5-983f512e29d6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2a4149579fc9422595a8085a70a2ee1d'} {{(pid=86656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:52:57.701849 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-e5e7644a-a60b-429c-aee5-983f512e29d6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2a4149579fc9422595a8085a70a2ee1d'} {{(pid=86656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:52:57.714773 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-e5e7644a-a60b-429c-aee5-983f512e29d6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2a4149579fc9422595a8085a70a2ee1d'} {{(pid=86656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:52:57.717486 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-e5e7644a-a60b-429c-aee5-983f512e29d6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2a4149579fc9422595a8085a70a2ee1d'} {{(pid=86656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:52:57.722794 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=80,keystone:DELETE=18,keystone:INSERT=2 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:52:57.783798 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-7f5954a3-8429-4afa-a63e-a65d835ada27 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'db93acd65a8348249975784e0de4cbd5', 'request_id': 'req-7f5954a3-8429-4afa-a63e-a65d835ada27'} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:52:57.789996 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 835/1676] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Jul 14 10:52:57 2022] DELETE /identity/v3/users/2a4149579fc9422595a8085a70a2ee1d => generated 0 bytes in 491 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:52:57.796713 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d372e94-f583-4a9d-8259-564d7e5903ab None None] REQUEST_METHOD: `POST` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:52:57.797280 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d372e94-f583-4a9d-8259-564d7e5903ab None None] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:52:57.797565 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d372e94-f583-4a9d-8259-564d7e5903ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:52:57.809585 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-7f5954a3-8429-4afa-a63e-a65d835ada27 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'db93acd65a8348249975784e0de4cbd5', 'request_id': 'req-7f5954a3-8429-4afa-a63e-a65d835ada27'} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:52:57.829562 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-7f5954a3-8429-4afa-a63e-a65d835ada27 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'db93acd65a8348249975784e0de4cbd5', 'request_id': 'req-7f5954a3-8429-4afa-a63e-a65d835ada27'} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:52:57.851860 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.auth.core [None req-2d372e94-f583-4a9d-8259-564d7e5903ab None None] MFA Rules not processed for user `ae4bcdd8106d4bebbdcae96be33505bc`. Rule list: `[]` (Enabled: `True`). {{(pid=86656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:52:57.854849 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-2d372e94-f583-4a9d-8259-564d7e5903ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:52:57.856509 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-7f5954a3-8429-4afa-a63e-a65d835ada27 admin admin] The token cache is being invalidate because project db93acd65a8348249975784e0de4cbd5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86655) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 10:52:57.856829 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-7f5954a3-8429-4afa-a63e-a65d835ada27 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:52:57.859773 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-7f5954a3-8429-4afa-a63e-a65d835ada27 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:52:57.863781 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 842/1677] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Jul 14 10:52:57 2022] DELETE /identity/v3/projects/db93acd65a8348249975784e0de4cbd5 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:52:57.867521 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4237adf8-544f-45b7-aa12-2c006553bfb9 None None] REQUEST_METHOD: `POST` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:52:57.867659 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4237adf8-544f-45b7-aa12-2c006553bfb9 None None] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:52:57.868104 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4237adf8-544f-45b7-aa12-2c006553bfb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:52:57.946380 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.auth.core [None req-4237adf8-544f-45b7-aa12-2c006553bfb9 None None] MFA Rules not processed for user `ae4bcdd8106d4bebbdcae96be33505bc`. Rule list: `[]` (Enabled: `True`). {{(pid=86655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:52:57.952232 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-4237adf8-544f-45b7-aa12-2c006553bfb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:52:58.089129 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 836/1678] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jul 14 10:52:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 299 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:52:58.092054 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d372e94-f583-4a9d-8259-564d7e5903ab None None] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:52:58.100059 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-2d372e94-f583-4a9d-8259-564d7e5903ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:52:58.143250 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d372e94-f583-4a9d-8259-564d7e5903ab None None] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:52:58.147981 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a285a6-c4bc-4017-9bc9-45741d4294a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:52:58.149211 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a285a6-c4bc-4017-9bc9-45741d4294a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:52:58.149507 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a285a6-c4bc-4017-9bc9-45741d4294a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:52:58.150810 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a285a6-c4bc-4017-9bc9-45741d4294a2 admin admin] PATH_INFO: `/v3/users/040a3be1ceaf44d08dd2213326815201` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:52:58.154377 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a285a6-c4bc-4017-9bc9-45741d4294a2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=040a3be1ceaf44d08dd2213326815201)` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:52:58.161273 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a285a6-c4bc-4017-9bc9-45741d4294a2 admin admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:52:58.179641 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 843/1679] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jul 14 10:52:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 315 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:52:58.180665 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4237adf8-544f-45b7-aa12-2c006553bfb9 None None] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:52:58.204172 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4237adf8-544f-45b7-aa12-2c006553bfb9 None None] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:52:58.225576 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0828b43c-18c8-4a8a-87d5-99276746532d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:52:58.226281 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0828b43c-18c8-4a8a-87d5-99276746532d admin admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:52:58.228875 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0828b43c-18c8-4a8a-87d5-99276746532d admin admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:52:58.229175 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0828b43c-18c8-4a8a-87d5-99276746532d admin admin] PATH_INFO: `/v3/domains` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:52:58.229979 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0828b43c-18c8-4a8a-87d5-99276746532d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:52:58.230291 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0828b43c-18c8-4a8a-87d5-99276746532d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:52:58.233582 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0828b43c-18c8-4a8a-87d5-99276746532d admin admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:52:58.261088 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-22a285a6-c4bc-4017-9bc9-45741d4294a2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '040a3be1ceaf44d08dd2213326815201'} {{(pid=86656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:52:58.268293 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 844/1680] 10.222.0.16 () {58 vars in 1152 bytes} [Thu Jul 14 10:52:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:52:58.270876 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0828b43c-18c8-4a8a-87d5-99276746532d admin admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:52:58.275641 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-0828b43c-18c8-4a8a-87d5-99276746532d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:52:58.281725 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-22a285a6-c4bc-4017-9bc9-45741d4294a2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '040a3be1ceaf44d08dd2213326815201'} {{(pid=86656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:52:58.282572 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-22a285a6-c4bc-4017-9bc9-45741d4294a2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '040a3be1ceaf44d08dd2213326815201'} {{(pid=86656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:52:58.295065 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-22a285a6-c4bc-4017-9bc9-45741d4294a2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '040a3be1ceaf44d08dd2213326815201'} {{(pid=86656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:52:58.297749 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-22a285a6-c4bc-4017-9bc9-45741d4294a2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '040a3be1ceaf44d08dd2213326815201'} {{(pid=86656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:52:58.340821 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 837/1681] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Jul 14 10:52:58 2022] DELETE /identity/v3/users/040a3be1ceaf44d08dd2213326815201 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:52:58.343516 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a285a6-c4bc-4017-9bc9-45741d4294a2 admin admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:52:58.347567 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-22a285a6-c4bc-4017-9bc9-45741d4294a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:52:58.427745 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0828b43c-18c8-4a8a-87d5-99276746532d admin admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:52:58.437195 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:INSERT=2,keystone:DELETE=8,keystone:SELECT=90 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:52:58.537214 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:52:58.559167 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a285a6-c4bc-4017-9bc9-45741d4294a2 admin admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:52:58.584445 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745a11c0-614b-4532-afea-910cdbd8467f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:52:58.587826 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745a11c0-614b-4532-afea-910cdbd8467f admin admin] REQUEST_METHOD: `POST` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:52:58.588120 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745a11c0-614b-4532-afea-910cdbd8467f admin admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:52:58.594334 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745a11c0-614b-4532-afea-910cdbd8467f admin admin] PATH_INFO: `/v3/projects` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:52:58.595253 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745a11c0-614b-4532-afea-910cdbd8467f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:52:58.597289 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745a11c0-614b-4532-afea-910cdbd8467f admin admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:52:58.629155 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d589f4-53f7-4f0b-902f-79798b1b0d58 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dddf93691844886982c91fea974385d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59391272ecbe48b0aa736cb43807be1d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:52:58.630436 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d589f4-53f7-4f0b-902f-79798b1b0d58 service neutron] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:52:58.630919 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d589f4-53f7-4f0b-902f-79798b1b0d58 service neutron] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:52:58.631300 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d589f4-53f7-4f0b-902f-79798b1b0d58 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:52:58.636391 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-22d589f4-53f7-4f0b-902f-79798b1b0d58 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:52:58.694116 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 838/1682] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Jul 14 10:52:58 2022] POST /identity/v3/projects => generated 387 bytes in 353 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:52:58.698076 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d589f4-53f7-4f0b-902f-79798b1b0d58 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:52:58.703423 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d589f4-53f7-4f0b-902f-79798b1b0d58 service neutron] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:52:58.704862 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745a11c0-614b-4532-afea-910cdbd8467f admin admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:52:58.736195 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 845/1683] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jul 14 10:52:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 467 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:52:58.747114 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b743db4-f45b-4016-ab9b-8f522e6da55f None None] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:52:58.747550 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b743db4-f45b-4016-ab9b-8f522e6da55f None None] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:52:58.747936 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b743db4-f45b-4016-ab9b-8f522e6da55f None None] PATH_INFO: `/` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:52:58.754485 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 846/1684] 10.222.0.16 () {54 vars in 960 bytes} [Thu Jul 14 10:52:58 2022] GET /identity => generated 270 bytes in 17 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:52:58.759263 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c695aa5c-2d83-4dc7-8ab7-1d7b5a22b2f1 None None] REQUEST_METHOD: `POST` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:52:58.768551 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c695aa5c-2d83-4dc7-8ab7-1d7b5a22b2f1 None None] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:52:58.769057 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c695aa5c-2d83-4dc7-8ab7-1d7b5a22b2f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:52:58.819478 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.auth.core [None req-c695aa5c-2d83-4dc7-8ab7-1d7b5a22b2f1 None None] MFA Rules not processed for user `16846111ee2a42dd99c3052d40980f72`. Rule list: `[]` (Enabled: `True`). {{(pid=86655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:52:58.822814 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-c695aa5c-2d83-4dc7-8ab7-1d7b5a22b2f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:52:58.904442 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745a11c0-614b-4532-afea-910cdbd8467f admin admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:52:58.930365 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009f2a43-b703-4ed6-b8e2-9d40f09a9cbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:52:58.931281 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009f2a43-b703-4ed6-b8e2-9d40f09a9cbe admin admin] REQUEST_METHOD: `POST` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:52:58.934639 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009f2a43-b703-4ed6-b8e2-9d40f09a9cbe admin admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:52:58.935117 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009f2a43-b703-4ed6-b8e2-9d40f09a9cbe admin admin] PATH_INFO: `/v3/users` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:52:58.936903 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009f2a43-b703-4ed6-b8e2-9d40f09a9cbe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:52:58.950799 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009f2a43-b703-4ed6-b8e2-9d40f09a9cbe admin admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:52:58.995293 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 839/1685] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Jul 14 10:52:58 2022] POST /identity/v3/users => generated 294 bytes in 297 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:52:58.997191 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5634aed1-dea3-4686-8081-e9e97e8ee09e None None] REQUEST_METHOD: `POST` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:52:58.997597 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5634aed1-dea3-4686-8081-e9e97e8ee09e None None] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:52:59.000876 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5634aed1-dea3-4686-8081-e9e97e8ee09e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:52:59.015250 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 847/1686] 10.222.0.16 () {58 vars in 1057 bytes} [Thu Jul 14 10:52:58 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:52:59.016712 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c695aa5c-2d83-4dc7-8ab7-1d7b5a22b2f1 None None] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:52:59.029760 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.auth.core [None req-5634aed1-dea3-4686-8081-e9e97e8ee09e None None] MFA Rules not processed for user `fae8e5bd232344cca09294651f4cd93e`. Rule list: `[]` (Enabled: `True`). {{(pid=86656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:52:59.034806 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-5634aed1-dea3-4686-8081-e9e97e8ee09e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:52:59.041402 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c695aa5c-2d83-4dc7-8ab7-1d7b5a22b2f1 None None] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:52:59.056565 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e940684-de92-444a-974f-5dec5925dca9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:52:59.057570 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e940684-de92-444a-974f-5dec5925dca9 admin admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:52:59.058002 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e940684-de92-444a-974f-5dec5925dca9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:52:59.058422 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e940684-de92-444a-974f-5dec5925dca9 admin admin] PATH_INFO: `/v3/roles` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:52:59.060258 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e940684-de92-444a-974f-5dec5925dca9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:52:59.065933 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e940684-de92-444a-974f-5dec5925dca9 admin admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:52:59.099318 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 848/1687] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jul 14 10:52:59 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:52:59.102609 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e940684-de92-444a-974f-5dec5925dca9 admin admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:52:59.132898 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e940684-de92-444a-974f-5dec5925dca9 admin admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:52:59.142704 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 840/1688] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jul 14 10:52:58 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:52:59.145505 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5634aed1-dea3-4686-8081-e9e97e8ee09e None None] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:52:59.146026 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459aad24-4669-48e9-ab06-ec7a5ac7d3f4 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16846111ee2a42dd99c3052d40980f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59391272ecbe48b0aa736cb43807be1d', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:52:59.146812 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459aad24-4669-48e9-ab06-ec7a5ac7d3f4 service placement] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:52:59.147105 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459aad24-4669-48e9-ab06-ec7a5ac7d3f4 service placement] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:52:59.147389 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459aad24-4669-48e9-ab06-ec7a5ac7d3f4 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:52:59.152682 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-459aad24-4669-48e9-ab06-ec7a5ac7d3f4 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:52:59.182808 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5634aed1-dea3-4686-8081-e9e97e8ee09e None None] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:52:59.188077 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459aad24-4669-48e9-ab06-ec7a5ac7d3f4 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:52:59.189729 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459aad24-4669-48e9-ab06-ec7a5ac7d3f4 service placement] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:52:59.197940 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28c450b-afbc-4801-87dc-eb762e5e8415 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:52:59.198641 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28c450b-afbc-4801-87dc-eb762e5e8415 admin admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:52:59.198931 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28c450b-afbc-4801-87dc-eb762e5e8415 admin admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:52:59.199218 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28c450b-afbc-4801-87dc-eb762e5e8415 admin admin] PATH_INFO: `/v3/roles` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:52:59.200021 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28c450b-afbc-4801-87dc-eb762e5e8415 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:52:59.204413 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28c450b-afbc-4801-87dc-eb762e5e8415 admin admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:52:59.238195 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 841/1689] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jul 14 10:52:59 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:52:59.240274 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28c450b-afbc-4801-87dc-eb762e5e8415 admin admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:52:59.271546 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 849/1690] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jul 14 10:52:59 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:52:59.273766 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28c450b-afbc-4801-87dc-eb762e5e8415 admin admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:52:59.289235 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d865eaa1-0588-46dd-bd63-d449305ba354 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:52:59.290500 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d865eaa1-0588-46dd-bd63-d449305ba354 admin admin] REQUEST_METHOD: `PUT` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:52:59.290792 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d865eaa1-0588-46dd-bd63-d449305ba354 admin admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:52:59.291072 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d865eaa1-0588-46dd-bd63-d449305ba354 admin admin] PATH_INFO: `/v3/projects/2c4afd9a8b1e437f91a5c8db8680034f/users/111fe7332c4944ef966ebe308ea3cd9f/roles/0da46c267d354cce81495dfdd56c1ec2` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:52:59.325950 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d865eaa1-0588-46dd-bd63-d449305ba354 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2c4afd9a8b1e437f91a5c8db8680034f, user_id=111fe7332c4944ef966ebe308ea3cd9f, role_id=0da46c267d354cce81495dfdd56c1ec2)` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:52:59.329738 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d865eaa1-0588-46dd-bd63-d449305ba354 admin admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:52:59.370807 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 842/1691] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Jul 14 10:52:59 2022] PUT /identity/v3/projects/2c4afd9a8b1e437f91a5c8db8680034f/users/111fe7332c4944ef966ebe308ea3cd9f/roles/0da46c267d354cce81495dfdd56c1ec2 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:52:59.383675 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d2c17a-fb9e-44c5-8bc1-bfb8de85f670 None None] REQUEST_METHOD: `POST` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:52:59.384020 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d2c17a-fb9e-44c5-8bc1-bfb8de85f670 None None] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:52:59.384241 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d2c17a-fb9e-44c5-8bc1-bfb8de85f670 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:52:59.546783 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.auth.core [None req-e1d2c17a-fb9e-44c5-8bc1-bfb8de85f670 None None] MFA Rules not processed for user `111fe7332c4944ef966ebe308ea3cd9f`. Rule list: `[]` (Enabled: `True`). {{(pid=86655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:52:59.549761 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-e1d2c17a-fb9e-44c5-8bc1-bfb8de85f670 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:52:59.870042 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 850/1692] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jul 14 10:52:59 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 488 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:52:59.871139 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d865eaa1-0588-46dd-bd63-d449305ba354 admin admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:00.027659 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d2c17a-fb9e-44c5-8bc1-bfb8de85f670 None None] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:00.030136 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-e1d2c17a-fb9e-44c5-8bc1-bfb8de85f670 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:00.061588 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=100 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:53:00.136412 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:53:00.275665 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d865eaa1-0588-46dd-bd63-d449305ba354 admin admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:00.297410 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d4ddc8-8699-49db-b0c4-c27d1d122506 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:00.298108 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d4ddc8-8699-49db-b0c4-c27d1d122506 admin admin] REQUEST_METHOD: `POST` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:00.298397 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d4ddc8-8699-49db-b0c4-c27d1d122506 admin admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:00.298678 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d4ddc8-8699-49db-b0c4-c27d1d122506 admin admin] PATH_INFO: `/v3/projects` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:00.306082 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d4ddc8-8699-49db-b0c4-c27d1d122506 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:00.315588 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d4ddc8-8699-49db-b0c4-c27d1d122506 admin admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:00.329916 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d2c17a-fb9e-44c5-8bc1-bfb8de85f670 None None] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:00.382865 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f1d806-9b8b-4184-ab33-283e44df37d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:00.402729 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f1d806-9b8b-4184-ab33-283e44df37d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:00.404245 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f1d806-9b8b-4184-ab33-283e44df37d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:00.404245 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f1d806-9b8b-4184-ab33-283e44df37d7 admin admin] PATH_INFO: `/v3/projects/580f8441db3b41ad83682ec4253dfd0e` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:00.420592 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f1d806-9b8b-4184-ab33-283e44df37d7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=580f8441db3b41ad83682ec4253dfd0e)` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:00.435315 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f1d806-9b8b-4184-ab33-283e44df37d7 admin admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:00.513194 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 843/1693] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Jul 14 10:52:59 2022] POST /identity/v3/projects => generated 387 bytes in 643 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:53:00.515224 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d4ddc8-8699-49db-b0c4-c27d1d122506 admin admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:00.519744 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-02d4ddc8-8699-49db-b0c4-c27d1d122506 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:00.671500 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-c6f1d806-9b8b-4184-ab33-283e44df37d7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '580f8441db3b41ad83682ec4253dfd0e', 'request_id': 'req-c6f1d806-9b8b-4184-ab33-283e44df37d7'} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:00.688705 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-c6f1d806-9b8b-4184-ab33-283e44df37d7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '580f8441db3b41ad83682ec4253dfd0e', 'request_id': 'req-c6f1d806-9b8b-4184-ab33-283e44df37d7'} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:00.705260 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-c6f1d806-9b8b-4184-ab33-283e44df37d7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '580f8441db3b41ad83682ec4253dfd0e', 'request_id': 'req-c6f1d806-9b8b-4184-ab33-283e44df37d7'} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:00.744280 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-c6f1d806-9b8b-4184-ab33-283e44df37d7 admin admin] The token cache is being invalidate because project 580f8441db3b41ad83682ec4253dfd0e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86655) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 10:53:00.744973 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-c6f1d806-9b8b-4184-ab33-283e44df37d7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:00.749344 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-c6f1d806-9b8b-4184-ab33-283e44df37d7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:00.751867 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 851/1694] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Jul 14 10:53:00 2022] DELETE /identity/v3/projects/580f8441db3b41ad83682ec4253dfd0e => generated 0 bytes in 724 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:53:00.752987 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f1d806-9b8b-4184-ab33-283e44df37d7 admin admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:00.754670 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-c6f1d806-9b8b-4184-ab33-283e44df37d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:00.812521 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d4ddc8-8699-49db-b0c4-c27d1d122506 admin admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:01.034895 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f1d806-9b8b-4184-ab33-283e44df37d7 admin admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:01.072310 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97af2388-e79f-4af6-a119-a8a05ed21f86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:01.073433 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9431952-57d2-4cbd-a1ad-473792a391b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:01.075050 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97af2388-e79f-4af6-a119-a8a05ed21f86 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:01.075610 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97af2388-e79f-4af6-a119-a8a05ed21f86 admin admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:01.075999 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9431952-57d2-4cbd-a1ad-473792a391b0 admin admin] REQUEST_METHOD: `POST` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:01.076584 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97af2388-e79f-4af6-a119-a8a05ed21f86 admin admin] PATH_INFO: `/v3/users/dc87a05afbf245ca9c12b06de07b8840` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:01.077154 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9431952-57d2-4cbd-a1ad-473792a391b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:01.080438 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97af2388-e79f-4af6-a119-a8a05ed21f86 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dc87a05afbf245ca9c12b06de07b8840)` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:01.080889 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9431952-57d2-4cbd-a1ad-473792a391b0 admin admin] PATH_INFO: `/v3/users` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:01.082582 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9431952-57d2-4cbd-a1ad-473792a391b0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:01.083990 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97af2388-e79f-4af6-a119-a8a05ed21f86 admin admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:01.094358 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9431952-57d2-4cbd-a1ad-473792a391b0 admin admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:01.165869 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 852/1695] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Jul 14 10:53:00 2022] POST /identity/v3/users => generated 294 bytes in 413 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:53:01.167595 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e65dad-3f71-4316-989d-f6da7ad628cf None None] REQUEST_METHOD: `POST` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:01.168026 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e65dad-3f71-4316-989d-f6da7ad628cf None None] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:01.168581 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e65dad-3f71-4316-989d-f6da7ad628cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:01.215078 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.auth.core [None req-d4e65dad-3f71-4316-989d-f6da7ad628cf None None] MFA Rules not processed for user `ae4bcdd8106d4bebbdcae96be33505bc`. Rule list: `[]` (Enabled: `True`). {{(pid=86655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:53:01.217575 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-d4e65dad-3f71-4316-989d-f6da7ad628cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:01.225788 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-97af2388-e79f-4af6-a119-a8a05ed21f86 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dc87a05afbf245ca9c12b06de07b8840'} {{(pid=86656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:01.243001 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 853/1696] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jul 14 10:53:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:53:01.244311 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e65dad-3f71-4316-989d-f6da7ad628cf None None] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:01.262521 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-97af2388-e79f-4af6-a119-a8a05ed21f86 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dc87a05afbf245ca9c12b06de07b8840'} {{(pid=86656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:01.267317 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-97af2388-e79f-4af6-a119-a8a05ed21f86 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dc87a05afbf245ca9c12b06de07b8840'} {{(pid=86656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:01.270731 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e65dad-3f71-4316-989d-f6da7ad628cf None None] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:01.278634 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf1752d-1f04-472d-95f4-927b90867aa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:01.280908 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf1752d-1f04-472d-95f4-927b90867aa9 admin admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:01.281848 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf1752d-1f04-472d-95f4-927b90867aa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:01.282413 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf1752d-1f04-472d-95f4-927b90867aa9 admin admin] PATH_INFO: `/v3/roles` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:01.284359 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf1752d-1f04-472d-95f4-927b90867aa9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:01.286803 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf1752d-1f04-472d-95f4-927b90867aa9 admin admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:01.301939 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-97af2388-e79f-4af6-a119-a8a05ed21f86 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dc87a05afbf245ca9c12b06de07b8840'} {{(pid=86656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:01.303664 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-97af2388-e79f-4af6-a119-a8a05ed21f86 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dc87a05afbf245ca9c12b06de07b8840'} {{(pid=86656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:01.307012 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 854/1697] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jul 14 10:53:01 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:53:01.309935 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355af58d-b45c-47d9-a2bf-e5e5e7562e3f None None] REQUEST_METHOD: `POST` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:01.310408 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355af58d-b45c-47d9-a2bf-e5e5e7562e3f None None] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:01.312178 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355af58d-b45c-47d9-a2bf-e5e5e7562e3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:01.332049 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=89,keystone:INSERT=2,keystone:DELETE=9 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:53:01.371077 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.auth.core [None req-355af58d-b45c-47d9-a2bf-e5e5e7562e3f None None] MFA Rules not processed for user `ae4bcdd8106d4bebbdcae96be33505bc`. Rule list: `[]` (Enabled: `True`). {{(pid=86655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:53:01.372947 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 844/1698] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Jul 14 10:53:00 2022] DELETE /identity/v3/users/dc87a05afbf245ca9c12b06de07b8840 => generated 0 bytes in 856 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:53:01.375228 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-355af58d-b45c-47d9-a2bf-e5e5e7562e3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:01.377087 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97af2388-e79f-4af6-a119-a8a05ed21f86 admin admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:01.381352 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-97af2388-e79f-4af6-a119-a8a05ed21f86 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:01.408641 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:53:01.563380 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97af2388-e79f-4af6-a119-a8a05ed21f86 admin admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:01.569446 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 855/1699] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jul 14 10:53:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:53:01.571130 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5281ddb2-e9c8-45ed-8278-efa7c350c810 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:01.572062 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5281ddb2-e9c8-45ed-8278-efa7c350c810 admin admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:01.572454 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5281ddb2-e9c8-45ed-8278-efa7c350c810 admin admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:01.573163 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5281ddb2-e9c8-45ed-8278-efa7c350c810 admin admin] PATH_INFO: `/v3/roles` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:01.574014 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5281ddb2-e9c8-45ed-8278-efa7c350c810 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:01.575392 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420269b8-f2b2-4c41-a5b8-2d93bc54077b None None] REQUEST_METHOD: `POST` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:01.579290 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420269b8-f2b2-4c41-a5b8-2d93bc54077b None None] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:01.579589 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420269b8-f2b2-4c41-a5b8-2d93bc54077b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:01.579775 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5281ddb2-e9c8-45ed-8278-efa7c350c810 admin admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:01.609042 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 845/1700] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jul 14 10:53:01 2022] GET /identity/v3/roles => generated 1420 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:53:01.611254 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5281ddb2-e9c8-45ed-8278-efa7c350c810 admin admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:01.613225 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-5281ddb2-e9c8-45ed-8278-efa7c350c810 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:01.644960 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5281ddb2-e9c8-45ed-8278-efa7c350c810 admin admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:01.644960 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a783d71-14a1-4168-97e4-4a83ef3acdd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:01.644960 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a783d71-14a1-4168-97e4-4a83ef3acdd0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:01.644960 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a783d71-14a1-4168-97e4-4a83ef3acdd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:01.645487 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a783d71-14a1-4168-97e4-4a83ef3acdd0 admin admin] PATH_INFO: `/v3/projects/e26660e07515494b8212d32fc0947fba` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:01.645870 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.auth.core [None req-420269b8-f2b2-4c41-a5b8-2d93bc54077b None None] MFA Rules not processed for user `ae4bcdd8106d4bebbdcae96be33505bc`. Rule list: `[]` (Enabled: `True`). {{(pid=86655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:53:01.648665 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a783d71-14a1-4168-97e4-4a83ef3acdd0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e26660e07515494b8212d32fc0947fba)` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:01.650883 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-420269b8-f2b2-4c41-a5b8-2d93bc54077b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:01.657027 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a783d71-14a1-4168-97e4-4a83ef3acdd0 admin admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:01.673253 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 856/1701] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jul 14 10:53:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:53:01.673253 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204b96f8-cdb1-4915-9a1f-29a85a2e5d37 None None] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:01.673253 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204b96f8-cdb1-4915-9a1f-29a85a2e5d37 None None] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:01.673253 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204b96f8-cdb1-4915-9a1f-29a85a2e5d37 None None] PATH_INFO: `/` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:01.686863 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 857/1702] 10.222.0.16 () {54 vars in 912 bytes} [Thu Jul 14 10:53:01 2022] GET /identity => generated 270 bytes in 16 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:53:01.693358 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204b96f8-cdb1-4915-9a1f-29a85a2e5d37 None None] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:01.722564 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204b96f8-cdb1-4915-9a1f-29a85a2e5d37 None None] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:01.729900 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36142d33-6cc8-4f2f-9c67-dc655471555c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:01.730710 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36142d33-6cc8-4f2f-9c67-dc655471555c admin admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:01.735148 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36142d33-6cc8-4f2f-9c67-dc655471555c admin admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:01.735412 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36142d33-6cc8-4f2f-9c67-dc655471555c admin admin] PATH_INFO: `/v3/domains` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:01.739189 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36142d33-6cc8-4f2f-9c67-dc655471555c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:53:01.739514 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36142d33-6cc8-4f2f-9c67-dc655471555c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:01.743354 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36142d33-6cc8-4f2f-9c67-dc655471555c admin admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:01.771691 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 858/1703] 10.222.0.16 () {58 vars in 1152 bytes} [Thu Jul 14 10:53:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:53:01.771691 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36142d33-6cc8-4f2f-9c67-dc655471555c admin admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:01.795905 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36142d33-6cc8-4f2f-9c67-dc655471555c admin admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:01.803317 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-4a783d71-14a1-4168-97e4-4a83ef3acdd0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e26660e07515494b8212d32fc0947fba', 'request_id': 'req-4a783d71-14a1-4168-97e4-4a83ef3acdd0'} {{(pid=86656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:01.830507 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-4a783d71-14a1-4168-97e4-4a83ef3acdd0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e26660e07515494b8212d32fc0947fba', 'request_id': 'req-4a783d71-14a1-4168-97e4-4a83ef3acdd0'} {{(pid=86656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:01.845381 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-4a783d71-14a1-4168-97e4-4a83ef3acdd0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e26660e07515494b8212d32fc0947fba', 'request_id': 'req-4a783d71-14a1-4168-97e4-4a83ef3acdd0'} {{(pid=86656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:01.876999 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-4a783d71-14a1-4168-97e4-4a83ef3acdd0 admin admin] The token cache is being invalidate because project e26660e07515494b8212d32fc0947fba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86656) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 10:53:01.877314 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-4a783d71-14a1-4168-97e4-4a83ef3acdd0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:01.878664 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-4a783d71-14a1-4168-97e4-4a83ef3acdd0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:01.882378 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 846/1704] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Jul 14 10:53:01 2022] DELETE /identity/v3/projects/e26660e07515494b8212d32fc0947fba => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:53:01.888556 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b6bc29-b0a2-4bbd-b093-f2ab1e2e98f2 None None] REQUEST_METHOD: `POST` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:01.888924 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b6bc29-b0a2-4bbd-b093-f2ab1e2e98f2 None None] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:01.889520 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b6bc29-b0a2-4bbd-b093-f2ab1e2e98f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:01.938476 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.auth.core [None req-f3b6bc29-b0a2-4bbd-b093-f2ab1e2e98f2 None None] MFA Rules not processed for user `e3b4a13350ec406ab5ca248cf2c06ea4`. Rule list: `[]` (Enabled: `True`). {{(pid=86656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:53:01.940619 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-f3b6bc29-b0a2-4bbd-b093-f2ab1e2e98f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:01.943667 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480b4d12-0864-4e9c-965f-503cba46280c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:01.944918 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480b4d12-0864-4e9c-965f-503cba46280c admin admin] REQUEST_METHOD: `PUT` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:01.945186 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480b4d12-0864-4e9c-965f-503cba46280c admin admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:01.945581 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480b4d12-0864-4e9c-965f-503cba46280c admin admin] PATH_INFO: `/v3/projects/4136ff042f9044dc9b8c5e25e4c8eb01/users/6d8e3a5cdc2245df8e1cfca04b6121c0/roles/0da46c267d354cce81495dfdd56c1ec2` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:01.973191 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480b4d12-0864-4e9c-965f-503cba46280c admin admin] RBAC: Authorizing `identity:create_grant(project_id=4136ff042f9044dc9b8c5e25e4c8eb01, user_id=6d8e3a5cdc2245df8e1cfca04b6121c0, role_id=0da46c267d354cce81495dfdd56c1ec2)` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:01.976038 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480b4d12-0864-4e9c-965f-503cba46280c admin admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:02.012931 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 859/1705] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Jul 14 10:53:01 2022] PUT /identity/v3/projects/4136ff042f9044dc9b8c5e25e4c8eb01/users/6d8e3a5cdc2245df8e1cfca04b6121c0/roles/0da46c267d354cce81495dfdd56c1ec2 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:53:02.014768 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480b4d12-0864-4e9c-965f-503cba46280c admin admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:02.016548 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-480b4d12-0864-4e9c-965f-503cba46280c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:02.086256 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:53:02.088618 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 847/1706] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jul 14 10:53:01 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:53:02.092618 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3016d16f-422b-4d0e-804a-d1d8eaac0e6d None None] REQUEST_METHOD: `POST` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:02.093415 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3016d16f-422b-4d0e-804a-d1d8eaac0e6d None None] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:02.094498 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480b4d12-0864-4e9c-965f-503cba46280c admin admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:02.094957 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3016d16f-422b-4d0e-804a-d1d8eaac0e6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:02.102173 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a27c38-9717-4955-8b8f-c80365965793 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dddf93691844886982c91fea974385d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59391272ecbe48b0aa736cb43807be1d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:02.102948 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a27c38-9717-4955-8b8f-c80365965793 service neutron] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:02.103304 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a27c38-9717-4955-8b8f-c80365965793 service neutron] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:02.103751 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a27c38-9717-4955-8b8f-c80365965793 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:02.110801 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-b1a27c38-9717-4955-8b8f-c80365965793 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:02.140054 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.auth.core [None req-3016d16f-422b-4d0e-804a-d1d8eaac0e6d None None] MFA Rules not processed for user `4dddf93691844886982c91fea974385d`. Rule list: `[]` (Enabled: `True`). {{(pid=86656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:53:02.141570 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-3016d16f-422b-4d0e-804a-d1d8eaac0e6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:02.148475 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 848/1707] 10.222.0.16 () {58 vars in 1009 bytes} [Thu Jul 14 10:53:02 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:53:02.149234 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3016d16f-422b-4d0e-804a-d1d8eaac0e6d None None] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:02.152214 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-3016d16f-422b-4d0e-804a-d1d8eaac0e6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:02.183819 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:53:02.237486 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a27c38-9717-4955-8b8f-c80365965793 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:02.240576 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a27c38-9717-4955-8b8f-c80365965793 service neutron] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:02.272199 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 860/1708] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jul 14 10:53:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 257 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:53:02.279340 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61367de3-877e-4d71-86a4-93b89fa310ec None None] REQUEST_METHOD: `POST` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:02.279669 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61367de3-877e-4d71-86a4-93b89fa310ec None None] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:02.279969 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61367de3-877e-4d71-86a4-93b89fa310ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:02.298825 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3016d16f-422b-4d0e-804a-d1d8eaac0e6d None None] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:02.304309 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfe4ff6-aba4-4cc8-abd0-e0540b35d8dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:02.305106 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfe4ff6-aba4-4cc8-abd0-e0540b35d8dd admin admin] REQUEST_METHOD: `POST` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:02.305504 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfe4ff6-aba4-4cc8-abd0-e0540b35d8dd admin admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:02.305882 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfe4ff6-aba4-4cc8-abd0-e0540b35d8dd admin admin] PATH_INFO: `/v3/projects` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:02.306809 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bfe4ff6-aba4-4cc8-abd0-e0540b35d8dd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:02.309000 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bfe4ff6-aba4-4cc8-abd0-e0540b35d8dd admin admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:02.335842 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.auth.core [None req-61367de3-877e-4d71-86a4-93b89fa310ec None None] MFA Rules not processed for user `ae4bcdd8106d4bebbdcae96be33505bc`. Rule list: `[]` (Enabled: `True`). {{(pid=86655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:53:02.339190 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-61367de3-877e-4d71-86a4-93b89fa310ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:02.355665 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 861/1709] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jul 14 10:53:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:53:02.358770 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e2f68a-fc46-47e6-9159-4f3736417624 None None] REQUEST_METHOD: `POST` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:02.359355 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e2f68a-fc46-47e6-9159-4f3736417624 None None] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:02.359916 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e2f68a-fc46-47e6-9159-4f3736417624 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:02.391197 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 849/1710] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Jul 14 10:53:02 2022] POST /identity/v3/projects => generated 375 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:53:02.392638 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b9130d-7b05-436e-a9ac-7810bd0ece9c None None] REQUEST_METHOD: `POST` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:02.392969 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b9130d-7b05-436e-a9ac-7810bd0ece9c None None] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:02.393250 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b9130d-7b05-436e-a9ac-7810bd0ece9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:02.418424 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.auth.core [None req-11e2f68a-fc46-47e6-9159-4f3736417624 None None] MFA Rules not processed for user `6d8e3a5cdc2245df8e1cfca04b6121c0`. Rule list: `[]` (Enabled: `True`). {{(pid=86655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:53:02.419679 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-11e2f68a-fc46-47e6-9159-4f3736417624 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:02.438102 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.auth.core [None req-50b9130d-7b05-436e-a9ac-7810bd0ece9c None None] MFA Rules not processed for user `e3b4a13350ec406ab5ca248cf2c06ea4`. Rule list: `[]` (Enabled: `True`). {{(pid=86656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:53:02.442067 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-50b9130d-7b05-436e-a9ac-7810bd0ece9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:02.540343 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 850/1711] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jul 14 10:53:02 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:53:02.541503 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b9130d-7b05-436e-a9ac-7810bd0ece9c None None] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:02.601622 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 862/1712] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jul 14 10:53:02 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:53:02.607701 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5679f1b-24ef-4007-88ac-eee2d0b1a29b None None] REQUEST_METHOD: `POST` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:02.608122 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5679f1b-24ef-4007-88ac-eee2d0b1a29b None None] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:02.608614 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5679f1b-24ef-4007-88ac-eee2d0b1a29b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:02.633723 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.auth.core [None req-f5679f1b-24ef-4007-88ac-eee2d0b1a29b None None] MFA Rules not processed for user `ae4bcdd8106d4bebbdcae96be33505bc`. Rule list: `[]` (Enabled: `True`). {{(pid=86655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:53:02.635212 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-f5679f1b-24ef-4007-88ac-eee2d0b1a29b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:02.640242 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b9130d-7b05-436e-a9ac-7810bd0ece9c None None] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:02.663740 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c296d8e6-dc98-44aa-bdf8-c1b19b589cc2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dddf93691844886982c91fea974385d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59391272ecbe48b0aa736cb43807be1d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:02.667911 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c296d8e6-dc98-44aa-bdf8-c1b19b589cc2 service neutron] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:02.668241 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c296d8e6-dc98-44aa-bdf8-c1b19b589cc2 service neutron] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:02.668527 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c296d8e6-dc98-44aa-bdf8-c1b19b589cc2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:02.698155 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c296d8e6-dc98-44aa-bdf8-c1b19b589cc2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:02.699622 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c296d8e6-dc98-44aa-bdf8-c1b19b589cc2 service neutron] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:02.721306 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 851/1713] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jul 14 10:53:02 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:53:02.724199 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c296d8e6-dc98-44aa-bdf8-c1b19b589cc2 service neutron] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:02.770694 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 863/1714] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jul 14 10:53:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:53:02.773434 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5679f1b-24ef-4007-88ac-eee2d0b1a29b None None] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:02.776760 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-f5679f1b-24ef-4007-88ac-eee2d0b1a29b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:02.815572 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:53:02.890776 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c296d8e6-dc98-44aa-bdf8-c1b19b589cc2 service neutron] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:02.904728 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86226c11-c25c-4dd6-87c7-90a96163099d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:02.905650 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86226c11-c25c-4dd6-87c7-90a96163099d admin admin] REQUEST_METHOD: `POST` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:02.905995 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=100 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:53:02.906143 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86226c11-c25c-4dd6-87c7-90a96163099d admin admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:02.906538 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86226c11-c25c-4dd6-87c7-90a96163099d admin admin] PATH_INFO: `/v3/users` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:02.907368 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86226c11-c25c-4dd6-87c7-90a96163099d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:02.909496 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86226c11-c25c-4dd6-87c7-90a96163099d admin admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:02.951868 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5679f1b-24ef-4007-88ac-eee2d0b1a29b None None] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:02.959510 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adb01f1-23d8-4f42-8f59-6dd45f908085 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26aa294c913c408499a913ec25bb677d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59391272ecbe48b0aa736cb43807be1d', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:02.960288 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adb01f1-23d8-4f42-8f59-6dd45f908085 service nova] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:02.960621 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adb01f1-23d8-4f42-8f59-6dd45f908085 service nova] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:02.960971 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adb01f1-23d8-4f42-8f59-6dd45f908085 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:02.971004 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4adb01f1-23d8-4f42-8f59-6dd45f908085 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:02.971996 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 852/1715] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Jul 14 10:53:02 2022] POST /identity/v3/users => generated 288 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:53:02.972967 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86226c11-c25c-4dd6-87c7-90a96163099d admin admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:02.978279 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4adb01f1-23d8-4f42-8f59-6dd45f908085 service nova] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:02.979974 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-86226c11-c25c-4dd6-87c7-90a96163099d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:02.991457 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 864/1716] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jul 14 10:53:02 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:53:02.992460 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adb01f1-23d8-4f42-8f59-6dd45f908085 service nova] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:03.006605 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adb01f1-23d8-4f42-8f59-6dd45f908085 service nova] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:03.012412 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6f16d5-9192-4595-82f1-86924bae68e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:03.013169 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6f16d5-9192-4595-82f1-86924bae68e3 admin admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:03.013564 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6f16d5-9192-4595-82f1-86924bae68e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:03.014382 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6f16d5-9192-4595-82f1-86924bae68e3 admin admin] PATH_INFO: `/v3/domains` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:03.015537 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6f16d5-9192-4595-82f1-86924bae68e3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:53:03.015855 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6f16d5-9192-4595-82f1-86924bae68e3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:03.018126 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6f16d5-9192-4595-82f1-86924bae68e3 admin admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:03.026426 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86226c11-c25c-4dd6-87c7-90a96163099d admin admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:03.035458 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 865/1717] 10.222.0.16 () {58 vars in 1152 bytes} [Thu Jul 14 10:53:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:53:03.036478 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6f16d5-9192-4595-82f1-86924bae68e3 admin admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:03.054238 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6f16d5-9192-4595-82f1-86924bae68e3 admin admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:03.061552 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771c4fd7-4546-49a9-827c-76f8d5af2110 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:03.062416 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771c4fd7-4546-49a9-827c-76f8d5af2110 admin admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:03.062728 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771c4fd7-4546-49a9-827c-76f8d5af2110 admin admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:03.063084 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771c4fd7-4546-49a9-827c-76f8d5af2110 admin admin] PATH_INFO: `/v3/roles` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:03.063413 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749b59e3-b5d5-4207-a59e-ebd1858d5417 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:03.063955 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771c4fd7-4546-49a9-827c-76f8d5af2110 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:03.064108 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749b59e3-b5d5-4207-a59e-ebd1858d5417 admin admin] REQUEST_METHOD: `POST` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:03.064400 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749b59e3-b5d5-4207-a59e-ebd1858d5417 admin admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:03.064681 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749b59e3-b5d5-4207-a59e-ebd1858d5417 admin admin] PATH_INFO: `/v3/projects` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:03.065425 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749b59e3-b5d5-4207-a59e-ebd1858d5417 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:03.065984 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771c4fd7-4546-49a9-827c-76f8d5af2110 admin admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:03.067330 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749b59e3-b5d5-4207-a59e-ebd1858d5417 admin admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:03.086326 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 866/1718] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jul 14 10:53:03 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:53:03.086326 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771c4fd7-4546-49a9-827c-76f8d5af2110 admin admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:03.116690 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771c4fd7-4546-49a9-827c-76f8d5af2110 admin admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:03.128845 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8555d3ee-1359-4433-918f-6aea55f99556 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:03.130223 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8555d3ee-1359-4433-918f-6aea55f99556 admin admin] REQUEST_METHOD: `POST` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:03.130752 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8555d3ee-1359-4433-918f-6aea55f99556 admin admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:03.131275 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8555d3ee-1359-4433-918f-6aea55f99556 admin admin] PATH_INFO: `/v3/projects` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:03.132225 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8555d3ee-1359-4433-918f-6aea55f99556 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:03.134828 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8555d3ee-1359-4433-918f-6aea55f99556 admin admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:03.158636 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 853/1719] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Jul 14 10:53:02 2022] POST /identity/v3/projects => generated 387 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:53:03.159697 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749b59e3-b5d5-4207-a59e-ebd1858d5417 admin admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:03.195859 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 867/1720] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Jul 14 10:53:03 2022] POST /identity/v3/projects => generated 373 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:53:03.198879 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8555d3ee-1359-4433-918f-6aea55f99556 admin admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:03.287010 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749b59e3-b5d5-4207-a59e-ebd1858d5417 admin admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:03.340515 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8555d3ee-1359-4433-918f-6aea55f99556 admin admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:03.356349 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9136e45-a4de-4dd1-8bde-597eab792323 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:03.361254 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9136e45-a4de-4dd1-8bde-597eab792323 admin admin] REQUEST_METHOD: `POST` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:03.361448 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9136e45-a4de-4dd1-8bde-597eab792323 admin admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:03.361739 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9136e45-a4de-4dd1-8bde-597eab792323 admin admin] PATH_INFO: `/v3/users` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:03.363123 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9136e45-a4de-4dd1-8bde-597eab792323 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:03.364982 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fdb448-a74f-4e9e-8580-e93ecaa9e764 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:03.365460 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9136e45-a4de-4dd1-8bde-597eab792323 admin admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:03.366377 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fdb448-a74f-4e9e-8580-e93ecaa9e764 admin admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:03.366983 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fdb448-a74f-4e9e-8580-e93ecaa9e764 admin admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:03.367558 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fdb448-a74f-4e9e-8580-e93ecaa9e764 admin admin] PATH_INFO: `/v3/roles` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:03.368721 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41fdb448-a74f-4e9e-8580-e93ecaa9e764 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:03.370671 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41fdb448-a74f-4e9e-8580-e93ecaa9e764 admin admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:03.385281 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 854/1721] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jul 14 10:53:03 2022] GET /identity/v3/roles => generated 1420 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:53:03.386543 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fdb448-a74f-4e9e-8580-e93ecaa9e764 admin admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:03.403440 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fdb448-a74f-4e9e-8580-e93ecaa9e764 admin admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:03.412215 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca673074-973a-42f8-a18e-75fe101ecf10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:03.413251 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca673074-973a-42f8-a18e-75fe101ecf10 admin admin] REQUEST_METHOD: `POST` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:03.413712 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca673074-973a-42f8-a18e-75fe101ecf10 admin admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:03.414550 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca673074-973a-42f8-a18e-75fe101ecf10 admin admin] PATH_INFO: `/v3/users` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:03.415636 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca673074-973a-42f8-a18e-75fe101ecf10 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:03.419183 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca673074-973a-42f8-a18e-75fe101ecf10 admin admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:03.424303 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 868/1722] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Jul 14 10:53:03 2022] POST /identity/v3/users => generated 300 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:53:03.426769 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9136e45-a4de-4dd1-8bde-597eab792323 admin admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:03.430373 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-c9136e45-a4de-4dd1-8bde-597eab792323 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:03.466408 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9136e45-a4de-4dd1-8bde-597eab792323 admin admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:03.473008 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24836f31-34a5-4dca-96e4-2cc8c8b4ad9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:03.475165 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24836f31-34a5-4dca-96e4-2cc8c8b4ad9d admin admin] REQUEST_METHOD: `DELETE` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:03.475669 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24836f31-34a5-4dca-96e4-2cc8c8b4ad9d admin admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:03.476028 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24836f31-34a5-4dca-96e4-2cc8c8b4ad9d admin admin] PATH_INFO: `/v3/projects/a3478f6a9e9249a992564e6034de4459` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:03.478042 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24836f31-34a5-4dca-96e4-2cc8c8b4ad9d admin admin] RBAC: Authorizing `identity:delete_project(project_id=a3478f6a9e9249a992564e6034de4459)` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:03.481600 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24836f31-34a5-4dca-96e4-2cc8c8b4ad9d admin admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:03.485616 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 855/1723] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Jul 14 10:53:03 2022] POST /identity/v3/users => generated 287 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:53:03.503498 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b527ee24-73a7-425f-bb2b-386880341f4a None None] REQUEST_METHOD: `POST` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:03.503498 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b527ee24-73a7-425f-bb2b-386880341f4a None None] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:03.503688 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b527ee24-73a7-425f-bb2b-386880341f4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:03.580274 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-24836f31-34a5-4dca-96e4-2cc8c8b4ad9d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a3478f6a9e9249a992564e6034de4459', 'request_id': 'req-24836f31-34a5-4dca-96e4-2cc8c8b4ad9d'} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:03.594335 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-24836f31-34a5-4dca-96e4-2cc8c8b4ad9d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a3478f6a9e9249a992564e6034de4459', 'request_id': 'req-24836f31-34a5-4dca-96e4-2cc8c8b4ad9d'} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:03.611931 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-24836f31-34a5-4dca-96e4-2cc8c8b4ad9d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a3478f6a9e9249a992564e6034de4459', 'request_id': 'req-24836f31-34a5-4dca-96e4-2cc8c8b4ad9d'} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:03.626681 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:53:03.637243 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-24836f31-34a5-4dca-96e4-2cc8c8b4ad9d admin admin] The token cache is being invalidate because project a3478f6a9e9249a992564e6034de4459 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86655) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 10:53:03.639568 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-24836f31-34a5-4dca-96e4-2cc8c8b4ad9d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:03.657109 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-24836f31-34a5-4dca-96e4-2cc8c8b4ad9d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:03.658956 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 869/1724] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Jul 14 10:53:03 2022] DELETE /identity/v3/projects/a3478f6a9e9249a992564e6034de4459 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:53:03.659586 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24836f31-34a5-4dca-96e4-2cc8c8b4ad9d admin admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:03.661893 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-24836f31-34a5-4dca-96e4-2cc8c8b4ad9d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:03.670827 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:53:03.684968 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.auth.core [None req-b527ee24-73a7-425f-bb2b-386880341f4a None None] MFA Rules not processed for user `0dfc7cd9c05e4f268d2ce316d531c4bd`. Rule list: `[]` (Enabled: `True`). {{(pid=86656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:53:03.686265 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-b527ee24-73a7-425f-bb2b-386880341f4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:03.822170 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24836f31-34a5-4dca-96e4-2cc8c8b4ad9d admin admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:03.831531 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ece5b3-0b2e-46e4-8254-118cfe560f33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:03.832569 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 856/1725] 10.222.0.16 () {58 vars in 1009 bytes} [Thu Jul 14 10:53:03 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 346 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:53:03.833489 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b527ee24-73a7-425f-bb2b-386880341f4a None None] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:03.835135 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ece5b3-0b2e-46e4-8254-118cfe560f33 admin admin] REQUEST_METHOD: `PUT` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:03.835434 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ece5b3-0b2e-46e4-8254-118cfe560f33 admin admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:03.836580 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ece5b3-0b2e-46e4-8254-118cfe560f33 admin admin] PATH_INFO: `/v3/projects/6290ebf76b4e4934a9fd6234b93a4b53/users/ed95849b71054890a7c303145facaf53/roles/0da46c267d354cce81495dfdd56c1ec2` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:03.837852 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-b527ee24-73a7-425f-bb2b-386880341f4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:03.881877 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b527ee24-73a7-425f-bb2b-386880341f4a None None] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:03.884210 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ece5b3-0b2e-46e4-8254-118cfe560f33 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6290ebf76b4e4934a9fd6234b93a4b53, user_id=ed95849b71054890a7c303145facaf53, role_id=0da46c267d354cce81495dfdd56c1ec2)` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:03.887002 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ece5b3-0b2e-46e4-8254-118cfe560f33 admin admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:03.908646 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1f4c8c-d39f-44f3-8d21-cbc7c894fc5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:03.909483 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1f4c8c-d39f-44f3-8d21-cbc7c894fc5a admin admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:03.909752 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1f4c8c-d39f-44f3-8d21-cbc7c894fc5a admin admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:03.910032 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1f4c8c-d39f-44f3-8d21-cbc7c894fc5a admin admin] PATH_INFO: `/v3/roles` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:03.915718 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1f4c8c-d39f-44f3-8d21-cbc7c894fc5a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:03.935085 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1f4c8c-d39f-44f3-8d21-cbc7c894fc5a admin admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:03.957084 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 870/1726] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Jul 14 10:53:03 2022] PUT /identity/v3/projects/6290ebf76b4e4934a9fd6234b93a4b53/users/ed95849b71054890a7c303145facaf53/roles/0da46c267d354cce81495dfdd56c1ec2 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:53:03.964257 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ece5b3-0b2e-46e4-8254-118cfe560f33 admin admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:03.974562 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-03ece5b3-0b2e-46e4-8254-118cfe560f33 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:03.981342 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 857/1727] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jul 14 10:53:03 2022] GET /identity/v3/roles => generated 1420 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:53:03.985642 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46c9ed4-02ef-4443-ac22-4439170b836a None None] REQUEST_METHOD: `POST` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:03.988985 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46c9ed4-02ef-4443-ac22-4439170b836a None None] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:03.989515 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46c9ed4-02ef-4443-ac22-4439170b836a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:04.020156 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.auth.core [None req-c46c9ed4-02ef-4443-ac22-4439170b836a None None] MFA Rules not processed for user `ae4bcdd8106d4bebbdcae96be33505bc`. Rule list: `[]` (Enabled: `True`). {{(pid=86656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:53:04.021696 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-c46c9ed4-02ef-4443-ac22-4439170b836a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:04.185613 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 858/1728] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jul 14 10:53:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:53:04.185613 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64224ac0-b411-49bf-9472-129cd0df9f79 None None] REQUEST_METHOD: `POST` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:04.185613 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64224ac0-b411-49bf-9472-129cd0df9f79 None None] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:04.186488 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ece5b3-0b2e-46e4-8254-118cfe560f33 admin admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:04.187082 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64224ac0-b411-49bf-9472-129cd0df9f79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:04.198751 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e678e06f-fc4c-47c4-8526-b355cae5cc80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:04.199551 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e678e06f-fc4c-47c4-8526-b355cae5cc80 admin admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:04.200309 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e678e06f-fc4c-47c4-8526-b355cae5cc80 admin admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:04.200834 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e678e06f-fc4c-47c4-8526-b355cae5cc80 admin admin] PATH_INFO: `/v3/roles` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:04.201866 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e678e06f-fc4c-47c4-8526-b355cae5cc80 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:04.207905 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e678e06f-fc4c-47c4-8526-b355cae5cc80 admin admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:04.234667 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 871/1729] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jul 14 10:53:03 2022] GET /identity/v3/roles => generated 1420 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:53:04.235946 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e678e06f-fc4c-47c4-8526-b355cae5cc80 admin admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:04.249039 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.auth.core [None req-64224ac0-b411-49bf-9472-129cd0df9f79 None None] MFA Rules not processed for user `ed95849b71054890a7c303145facaf53`. Rule list: `[]` (Enabled: `True`). {{(pid=86656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:53:04.250279 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-64224ac0-b411-49bf-9472-129cd0df9f79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:04.258753 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e678e06f-fc4c-47c4-8526-b355cae5cc80 admin admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:04.270712 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8b7725-5d2d-48e0-a844-13defab1af4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:04.275074 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8b7725-5d2d-48e0-a844-13defab1af4b admin admin] REQUEST_METHOD: `PUT` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:04.275689 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8b7725-5d2d-48e0-a844-13defab1af4b admin admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:04.276083 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8b7725-5d2d-48e0-a844-13defab1af4b admin admin] PATH_INFO: `/v3/projects/d2f835d6065944d19f572f2b0c739bd0/users/efa2cc07d5c44ab697be10e098b4874e/roles/153539819e5542df99269d2913bbecfb` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:04.333459 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8b7725-5d2d-48e0-a844-13defab1af4b admin admin] RBAC: Authorizing `identity:create_grant(project_id=d2f835d6065944d19f572f2b0c739bd0, user_id=efa2cc07d5c44ab697be10e098b4874e, role_id=153539819e5542df99269d2913bbecfb)` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:04.339661 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8b7725-5d2d-48e0-a844-13defab1af4b admin admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:04.372545 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 872/1730] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Jul 14 10:53:04 2022] PUT /identity/v3/projects/d2f835d6065944d19f572f2b0c739bd0/users/efa2cc07d5c44ab697be10e098b4874e/roles/153539819e5542df99269d2913bbecfb => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:53:04.374074 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8b7725-5d2d-48e0-a844-13defab1af4b admin admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:04.380379 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-7c8b7725-5d2d-48e0-a844-13defab1af4b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:04.424362 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 859/1731] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jul 14 10:53:04 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:53:04.427171 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea1c59d-e3ed-4aee-ab4c-f9da0ff6612b None None] REQUEST_METHOD: `POST` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:04.427622 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea1c59d-e3ed-4aee-ab4c-f9da0ff6612b None None] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:04.428232 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea1c59d-e3ed-4aee-ab4c-f9da0ff6612b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:04.454757 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.auth.core [None req-fea1c59d-e3ed-4aee-ab4c-f9da0ff6612b None None] MFA Rules not processed for user `ae4bcdd8106d4bebbdcae96be33505bc`. Rule list: `[]` (Enabled: `True`). {{(pid=86656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:53:04.456258 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-fea1c59d-e3ed-4aee-ab4c-f9da0ff6612b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:04.463300 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=100 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:53:04.511684 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:53:04.608199 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 860/1732] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jul 14 10:53:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:53:04.609585 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea1c59d-e3ed-4aee-ab4c-f9da0ff6612b None None] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:04.614724 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8b7725-5d2d-48e0-a844-13defab1af4b admin admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:04.637503 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d062ea-a562-4786-9d5e-3e5e6decb868 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a23de49b80643eaab7a212f2884d62e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59391272ecbe48b0aa736cb43807be1d', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:04.638197 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d062ea-a562-4786-9d5e-3e5e6decb868 service swift] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:04.638694 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d062ea-a562-4786-9d5e-3e5e6decb868 service swift] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:04.639037 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d062ea-a562-4786-9d5e-3e5e6decb868 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:04.655507 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea1c59d-e3ed-4aee-ab4c-f9da0ff6612b None None] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:04.672205 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2db467-de52-4ce5-9ce3-0ae5fd041784 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:04.673298 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2db467-de52-4ce5-9ce3-0ae5fd041784 admin admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:04.673799 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2db467-de52-4ce5-9ce3-0ae5fd041784 admin admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:04.674444 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2db467-de52-4ce5-9ce3-0ae5fd041784 admin admin] PATH_INFO: `/v3/roles` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:04.675761 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2db467-de52-4ce5-9ce3-0ae5fd041784 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:04.679693 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2db467-de52-4ce5-9ce3-0ae5fd041784 admin admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:04.709857 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 861/1733] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jul 14 10:53:04 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:53:04.720789 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2db467-de52-4ce5-9ce3-0ae5fd041784 admin admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:04.742650 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2db467-de52-4ce5-9ce3-0ae5fd041784 admin admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:04.757534 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d062ea-a562-4786-9d5e-3e5e6decb868 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:04.759391 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78d7cb6-2b2c-40b2-ab68-9b541b6feadb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:04.759537 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d062ea-a562-4786-9d5e-3e5e6decb868 service swift] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:04.761782 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78d7cb6-2b2c-40b2-ab68-9b541b6feadb admin admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:04.762191 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78d7cb6-2b2c-40b2-ab68-9b541b6feadb admin admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:04.763405 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78d7cb6-2b2c-40b2-ab68-9b541b6feadb admin admin] PATH_INFO: `/v3/roles` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:04.765799 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78d7cb6-2b2c-40b2-ab68-9b541b6feadb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:04.770334 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78d7cb6-2b2c-40b2-ab68-9b541b6feadb admin admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:04.775863 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 873/1734] 10.222.0.16 () {60 vars in 1384 bytes} [Thu Jul 14 10:53:04 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 14 10:53:04.789739 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d062ea-a562-4786-9d5e-3e5e6decb868 service swift] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:04.802690 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 862/1735] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jul 14 10:53:04 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:53:04.803790 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78d7cb6-2b2c-40b2-ab68-9b541b6feadb admin admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:04.830468 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78d7cb6-2b2c-40b2-ab68-9b541b6feadb admin admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:04.833591 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d062ea-a562-4786-9d5e-3e5e6decb868 service swift] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:04.847634 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1cc46f-0fda-4225-bb37-862dc4096d63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:04.848517 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1cc46f-0fda-4225-bb37-862dc4096d63 admin admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:04.848644 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc04e9c-f2d9-4592-833f-aec7a7390d92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:04.848994 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1cc46f-0fda-4225-bb37-862dc4096d63 admin admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:04.849243 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc04e9c-f2d9-4592-833f-aec7a7390d92 admin admin] REQUEST_METHOD: `POST` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:04.849484 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1cc46f-0fda-4225-bb37-862dc4096d63 admin admin] PATH_INFO: `/v3/domains` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:04.849588 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc04e9c-f2d9-4592-833f-aec7a7390d92 admin admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:04.849797 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc04e9c-f2d9-4592-833f-aec7a7390d92 admin admin] PATH_INFO: `/v3/projects` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:04.850510 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1cc46f-0fda-4225-bb37-862dc4096d63 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:53:04.850626 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc04e9c-f2d9-4592-833f-aec7a7390d92 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:04.851478 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1cc46f-0fda-4225-bb37-862dc4096d63 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:04.852441 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc04e9c-f2d9-4592-833f-aec7a7390d92 admin admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:04.854212 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1cc46f-0fda-4225-bb37-862dc4096d63 admin admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:04.887439 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 863/1736] 10.222.0.16 () {58 vars in 1152 bytes} [Thu Jul 14 10:53:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:53:04.889312 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1cc46f-0fda-4225-bb37-862dc4096d63 admin admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:04.912344 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1cc46f-0fda-4225-bb37-862dc4096d63 admin admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:04.917422 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 874/1737] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Jul 14 10:53:04 2022] POST /identity/v3/projects => generated 377 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:53:04.918360 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc04e9c-f2d9-4592-833f-aec7a7390d92 admin admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:05.050940 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da5c1fc-ad21-4da3-b7b5-642c4fd99313 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:05.052368 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da5c1fc-ad21-4da3-b7b5-642c4fd99313 admin admin] REQUEST_METHOD: `PUT` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:05.057569 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da5c1fc-ad21-4da3-b7b5-642c4fd99313 admin admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:05.058093 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da5c1fc-ad21-4da3-b7b5-642c4fd99313 admin admin] PATH_INFO: `/v3/projects/4af7b268f6de4726ad8d78ced603bbfe/users/f095bf9ce8af4762a2bceaff7c83f045/roles/0da46c267d354cce81495dfdd56c1ec2` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:05.099402 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da5c1fc-ad21-4da3-b7b5-642c4fd99313 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4af7b268f6de4726ad8d78ced603bbfe, user_id=f095bf9ce8af4762a2bceaff7c83f045, role_id=0da46c267d354cce81495dfdd56c1ec2)` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:05.104915 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da5c1fc-ad21-4da3-b7b5-642c4fd99313 admin admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:05.132464 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 864/1738] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Jul 14 10:53:04 2022] PUT /identity/v3/projects/4af7b268f6de4726ad8d78ced603bbfe/users/f095bf9ce8af4762a2bceaff7c83f045/roles/0da46c267d354cce81495dfdd56c1ec2 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:53:05.133507 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da5c1fc-ad21-4da3-b7b5-642c4fd99313 admin admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:05.173307 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc04e9c-f2d9-4592-833f-aec7a7390d92 admin admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:05.325055 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da5c1fc-ad21-4da3-b7b5-642c4fd99313 admin admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:05.340558 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76281641-8c1e-4a1c-b6e5-440c0378551c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:05.341840 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76281641-8c1e-4a1c-b6e5-440c0378551c admin admin] REQUEST_METHOD: `POST` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:05.342696 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76281641-8c1e-4a1c-b6e5-440c0378551c admin admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:05.343388 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76281641-8c1e-4a1c-b6e5-440c0378551c admin admin] PATH_INFO: `/v3/projects` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:05.351221 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76281641-8c1e-4a1c-b6e5-440c0378551c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:05.353489 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76281641-8c1e-4a1c-b6e5-440c0378551c admin admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:05.363547 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:53:05.402026 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14016fb8-c1ba-4d6c-8341-dba9d903d8ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:05.403473 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14016fb8-c1ba-4d6c-8341-dba9d903d8ed admin admin] REQUEST_METHOD: `PUT` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:05.403773 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14016fb8-c1ba-4d6c-8341-dba9d903d8ed admin admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:05.404044 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14016fb8-c1ba-4d6c-8341-dba9d903d8ed admin admin] PATH_INFO: `/v3/projects/d2f835d6065944d19f572f2b0c739bd0/users/efa2cc07d5c44ab697be10e098b4874e/roles/153539819e5542df99269d2913bbecfb` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:05.409827 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14016fb8-c1ba-4d6c-8341-dba9d903d8ed admin admin] RBAC: Authorizing `identity:create_grant(project_id=d2f835d6065944d19f572f2b0c739bd0, user_id=efa2cc07d5c44ab697be10e098b4874e, role_id=153539819e5542df99269d2913bbecfb)` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:05.412659 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14016fb8-c1ba-4d6c-8341-dba9d903d8ed admin admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:05.420534 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 865/1739] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Jul 14 10:53:05 2022] POST /identity/v3/projects => generated 367 bytes in 287 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:53:05.421376 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76281641-8c1e-4a1c-b6e5-440c0378551c admin admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:05.449510 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:53:05.469753 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 875/1740] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Jul 14 10:53:04 2022] PUT /identity/v3/projects/d2f835d6065944d19f572f2b0c739bd0/users/efa2cc07d5c44ab697be10e098b4874e/roles/153539819e5542df99269d2913bbecfb => generated 0 bytes in 552 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:53:05.473816 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cc5af5-4165-4304-ac80-134534396839 None None] REQUEST_METHOD: `POST` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:05.474111 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cc5af5-4165-4304-ac80-134534396839 None None] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:05.482710 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cc5af5-4165-4304-ac80-134534396839 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:05.603674 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.auth.core [None req-48cc5af5-4165-4304-ac80-134534396839 None None] MFA Rules not processed for user `f095bf9ce8af4762a2bceaff7c83f045`. Rule list: `[]` (Enabled: `True`). {{(pid=86655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:53:05.605571 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-48cc5af5-4165-4304-ac80-134534396839 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:05.741666 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76281641-8c1e-4a1c-b6e5-440c0378551c admin admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:05.887510 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 876/1741] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jul 14 10:53:05 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 417 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:53:05.901100 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48cc5af5-4165-4304-ac80-134534396839 None None] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:06.009585 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7660b9dc-9806-4b78-8ad0-1a94b0cceb4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:06.010295 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7660b9dc-9806-4b78-8ad0-1a94b0cceb4d admin admin] REQUEST_METHOD: `POST` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:06.010584 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7660b9dc-9806-4b78-8ad0-1a94b0cceb4d admin admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:06.010862 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7660b9dc-9806-4b78-8ad0-1a94b0cceb4d admin admin] PATH_INFO: `/v3/users` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:06.011580 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7660b9dc-9806-4b78-8ad0-1a94b0cceb4d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:06.013591 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7660b9dc-9806-4b78-8ad0-1a94b0cceb4d admin admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:06.088221 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48cc5af5-4165-4304-ac80-134534396839 None None] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:06.099642 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d3ba98-b87c-4110-8593-c92d090123ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:06.100407 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d3ba98-b87c-4110-8593-c92d090123ca admin admin] REQUEST_METHOD: `POST` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:06.100700 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d3ba98-b87c-4110-8593-c92d090123ca admin admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:06.101025 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d3ba98-b87c-4110-8593-c92d090123ca admin admin] PATH_INFO: `/v3/users` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:06.101740 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d3ba98-b87c-4110-8593-c92d090123ca admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:06.109647 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 866/1742] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Jul 14 10:53:05 2022] POST /identity/v3/users => generated 295 bytes in 688 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:53:06.111314 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ab338d-2c55-45dd-958a-790f9ae9cc34 None None] REQUEST_METHOD: `POST` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:06.111619 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ab338d-2c55-45dd-958a-790f9ae9cc34 None None] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:06.111904 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ab338d-2c55-45dd-958a-790f9ae9cc34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:06.133565 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d3ba98-b87c-4110-8593-c92d090123ca admin admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:06.246029 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 877/1743] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Jul 14 10:53:05 2022] POST /identity/v3/users => generated 284 bytes in 358 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:53:06.266946 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e93a12f-f247-4a21-bbbb-0306a33aa136 None None] REQUEST_METHOD: `POST` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:06.267231 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e93a12f-f247-4a21-bbbb-0306a33aa136 None None] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:06.267505 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e93a12f-f247-4a21-bbbb-0306a33aa136 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:06.308723 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.auth.core [None req-97ab338d-2c55-45dd-958a-790f9ae9cc34 None None] MFA Rules not processed for user `efa2cc07d5c44ab697be10e098b4874e`. Rule list: `[]` (Enabled: `True`). {{(pid=86656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:53:06.320720 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-97ab338d-2c55-45dd-958a-790f9ae9cc34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:06.350435 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.auth.core [None req-9e93a12f-f247-4a21-bbbb-0306a33aa136 None None] MFA Rules not processed for user `4dddf93691844886982c91fea974385d`. Rule list: `[]` (Enabled: `True`). {{(pid=86655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:53:06.358650 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-9e93a12f-f247-4a21-bbbb-0306a33aa136 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:06.508487 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 867/1744] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jul 14 10:53:06 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 398 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:53:06.513607 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ab338d-2c55-45dd-958a-790f9ae9cc34 None None] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:06.529446 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ab338d-2c55-45dd-958a-790f9ae9cc34 None None] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:06.535150 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed6d575-9619-4bd5-bc51-48afa7ed12d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:06.535897 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed6d575-9619-4bd5-bc51-48afa7ed12d3 admin admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:06.536188 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed6d575-9619-4bd5-bc51-48afa7ed12d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:06.536514 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed6d575-9619-4bd5-bc51-48afa7ed12d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:06.537588 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed6d575-9619-4bd5-bc51-48afa7ed12d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:06.540290 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed6d575-9619-4bd5-bc51-48afa7ed12d3 admin admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:06.542641 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:53:06.566363 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 868/1745] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jul 14 10:53:06 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:53:06.567511 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed6d575-9619-4bd5-bc51-48afa7ed12d3 admin admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:06.580867 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 878/1746] 10.222.0.73 () {58 vars in 1015 bytes} [Thu Jul 14 10:53:06 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 320 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:53:06.582816 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e93a12f-f247-4a21-bbbb-0306a33aa136 None None] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:06.584568 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-6ed6d575-9619-4bd5-bc51-48afa7ed12d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:06.642428 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e93a12f-f247-4a21-bbbb-0306a33aa136 None None] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:06.676703 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76095289-4c19-474c-aaf5-39af87086d2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:06.677750 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76095289-4c19-474c-aaf5-39af87086d2c admin admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:06.678218 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76095289-4c19-474c-aaf5-39af87086d2c admin admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:06.679789 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76095289-4c19-474c-aaf5-39af87086d2c admin admin] PATH_INFO: `/v3/roles` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:06.681351 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76095289-4c19-474c-aaf5-39af87086d2c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:06.688672 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76095289-4c19-474c-aaf5-39af87086d2c admin admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:06.757523 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 879/1747] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jul 14 10:53:06 2022] GET /identity/v3/roles => generated 1420 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:53:06.758864 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76095289-4c19-474c-aaf5-39af87086d2c admin admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:06.763266 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-76095289-4c19-474c-aaf5-39af87086d2c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:06.816567 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:53:06.914398 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed6d575-9619-4bd5-bc51-48afa7ed12d3 admin admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:06.922801 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152a7b12-4a49-4dfc-9544-103142663a52 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26aa294c913c408499a913ec25bb677d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59391272ecbe48b0aa736cb43807be1d', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:06.924231 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152a7b12-4a49-4dfc-9544-103142663a52 service nova] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:06.926522 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152a7b12-4a49-4dfc-9544-103142663a52 service nova] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:06.927310 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152a7b12-4a49-4dfc-9544-103142663a52 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:06.940218 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152a7b12-4a49-4dfc-9544-103142663a52 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:06.942218 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152a7b12-4a49-4dfc-9544-103142663a52 service nova] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:06.955876 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 869/1748] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jul 14 10:53:06 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:53:06.957092 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152a7b12-4a49-4dfc-9544-103142663a52 service nova] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:06.964104 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76095289-4c19-474c-aaf5-39af87086d2c admin admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:06.977415 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152a7b12-4a49-4dfc-9544-103142663a52 service nova] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:06.980954 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b1ceab-ab73-44bf-b5ca-53bce4175f43 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68382432147a48c3b62271fd2a2eab04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59391272ecbe48b0aa736cb43807be1d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:06.981666 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b1ceab-ab73-44bf-b5ca-53bce4175f43 service cinder] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:06.981929 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b1ceab-ab73-44bf-b5ca-53bce4175f43 service cinder] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:06.982290 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b1ceab-ab73-44bf-b5ca-53bce4175f43 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:06.984318 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e90714d-9d0f-4b87-ad12-200c80e75c09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:06.990359 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e90714d-9d0f-4b87-ad12-200c80e75c09 admin admin] REQUEST_METHOD: `PUT` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:06.990359 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e90714d-9d0f-4b87-ad12-200c80e75c09 admin admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:06.990359 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e90714d-9d0f-4b87-ad12-200c80e75c09 admin admin] PATH_INFO: `/v3/projects/ac1d0d3dc7de4566b7064c81668c8853/users/4bc70bc60d7c40ea9e786eac195fc300/roles/153539819e5542df99269d2913bbecfb` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:07.032752 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b1ceab-ab73-44bf-b5ca-53bce4175f43 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:07.035134 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b1ceab-ab73-44bf-b5ca-53bce4175f43 service cinder] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:07.038564 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e90714d-9d0f-4b87-ad12-200c80e75c09 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ac1d0d3dc7de4566b7064c81668c8853, user_id=4bc70bc60d7c40ea9e786eac195fc300, role_id=153539819e5542df99269d2913bbecfb)` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:07.066337 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e90714d-9d0f-4b87-ad12-200c80e75c09 admin admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:07.066863 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 880/1749] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jul 14 10:53:06 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:53:07.067919 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b1ceab-ab73-44bf-b5ca-53bce4175f43 service cinder] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:07.071505 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-80b1ceab-ab73-44bf-b5ca-53bce4175f43 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:07.101238 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 870/1750] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Jul 14 10:53:06 2022] PUT /identity/v3/projects/ac1d0d3dc7de4566b7064c81668c8853/users/4bc70bc60d7c40ea9e786eac195fc300/roles/153539819e5542df99269d2913bbecfb => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:53:07.104391 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e90714d-9d0f-4b87-ad12-200c80e75c09 admin admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:07.121895 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b1ceab-ab73-44bf-b5ca-53bce4175f43 service cinder] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:07.243474 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e90714d-9d0f-4b87-ad12-200c80e75c09 admin admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:07.271324 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe34cce-3558-471b-a5ba-f6f550854c98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:07.272106 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe34cce-3558-471b-a5ba-f6f550854c98 admin admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:07.272510 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe34cce-3558-471b-a5ba-f6f550854c98 admin admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:07.272828 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe34cce-3558-471b-a5ba-f6f550854c98 admin admin] PATH_INFO: `/v3/roles` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:07.273594 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe34cce-3558-471b-a5ba-f6f550854c98 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:07.278851 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe34cce-3558-471b-a5ba-f6f550854c98 admin admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:07.342149 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 871/1751] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jul 14 10:53:07 2022] GET /identity/v3/roles => generated 1420 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:53:07.345384 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe34cce-3558-471b-a5ba-f6f550854c98 admin admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:07.351465 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14da7fe2-0ecb-4094-acab-03c9444577ea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dddf93691844886982c91fea974385d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59391272ecbe48b0aa736cb43807be1d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:07.353472 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14da7fe2-0ecb-4094-acab-03c9444577ea service neutron] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:07.354389 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14da7fe2-0ecb-4094-acab-03c9444577ea service neutron] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:07.355358 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14da7fe2-0ecb-4094-acab-03c9444577ea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:07.411740 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14da7fe2-0ecb-4094-acab-03c9444577ea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:07.412965 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe34cce-3558-471b-a5ba-f6f550854c98 admin admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:07.414609 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14da7fe2-0ecb-4094-acab-03c9444577ea service neutron] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:07.437509 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599504fe-88d3-418b-84a7-3deb3f6cd767 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:07.439100 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599504fe-88d3-418b-84a7-3deb3f6cd767 admin admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:07.440060 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599504fe-88d3-418b-84a7-3deb3f6cd767 admin admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:07.440356 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599504fe-88d3-418b-84a7-3deb3f6cd767 admin admin] PATH_INFO: `/v3/roles` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:07.442574 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599504fe-88d3-418b-84a7-3deb3f6cd767 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:07.443755 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 881/1752] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jul 14 10:53:07 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:53:07.444765 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14da7fe2-0ecb-4094-acab-03c9444577ea service neutron] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:07.460424 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599504fe-88d3-418b-84a7-3deb3f6cd767 admin admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:07.490864 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14da7fe2-0ecb-4094-acab-03c9444577ea service neutron] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:07.516352 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 872/1753] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jul 14 10:53:07 2022] GET /identity/v3/roles => generated 1420 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:53:07.517643 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d158ca8a-a0a6-46a0-9862-7adfa4cb488c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:07.518558 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d158ca8a-a0a6-46a0-9862-7adfa4cb488c admin admin] REQUEST_METHOD: `PUT` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:07.518846 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d158ca8a-a0a6-46a0-9862-7adfa4cb488c admin admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:07.519224 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d158ca8a-a0a6-46a0-9862-7adfa4cb488c admin admin] PATH_INFO: `/v3/projects/c7dba31575ec4e0dbd90067d4ff53c7f/users/dac36048e10f46598a93fe8a4225fe7c/roles/0da46c267d354cce81495dfdd56c1ec2` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:07.521277 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599504fe-88d3-418b-84a7-3deb3f6cd767 admin admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:07.559411 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599504fe-88d3-418b-84a7-3deb3f6cd767 admin admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:07.583620 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5427ac8-56ee-43a9-8526-97a56354ab14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:07.586466 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5427ac8-56ee-43a9-8526-97a56354ab14 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:07.587645 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5427ac8-56ee-43a9-8526-97a56354ab14 admin admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:07.588711 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5427ac8-56ee-43a9-8526-97a56354ab14 admin admin] PATH_INFO: `/v3/users/f095bf9ce8af4762a2bceaff7c83f045` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:07.594108 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5427ac8-56ee-43a9-8526-97a56354ab14 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f095bf9ce8af4762a2bceaff7c83f045)` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:07.601711 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5427ac8-56ee-43a9-8526-97a56354ab14 admin admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:07.611474 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d158ca8a-a0a6-46a0-9862-7adfa4cb488c admin admin] RBAC: Authorizing `identity:create_grant(project_id=c7dba31575ec4e0dbd90067d4ff53c7f, user_id=dac36048e10f46598a93fe8a4225fe7c, role_id=0da46c267d354cce81495dfdd56c1ec2)` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:07.617195 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d158ca8a-a0a6-46a0-9862-7adfa4cb488c admin admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:07.656406 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 882/1754] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Jul 14 10:53:07 2022] PUT /identity/v3/projects/c7dba31575ec4e0dbd90067d4ff53c7f/users/dac36048e10f46598a93fe8a4225fe7c/roles/0da46c267d354cce81495dfdd56c1ec2 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:53:07.671892 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d158ca8a-a0a6-46a0-9862-7adfa4cb488c admin admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:07.800232 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=94,keystone:INSERT=1,keystone:DELETE=5 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:53:07.851909 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-e5427ac8-56ee-43a9-8526-97a56354ab14 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f095bf9ce8af4762a2bceaff7c83f045'} {{(pid=86656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:07.884053 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-e5427ac8-56ee-43a9-8526-97a56354ab14 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f095bf9ce8af4762a2bceaff7c83f045'} {{(pid=86656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:07.886403 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-e5427ac8-56ee-43a9-8526-97a56354ab14 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f095bf9ce8af4762a2bceaff7c83f045'} {{(pid=86656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:07.935350 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-e5427ac8-56ee-43a9-8526-97a56354ab14 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f095bf9ce8af4762a2bceaff7c83f045'} {{(pid=86656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:07.938434 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-e5427ac8-56ee-43a9-8526-97a56354ab14 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f095bf9ce8af4762a2bceaff7c83f045'} {{(pid=86656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:08.019819 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d158ca8a-a0a6-46a0-9862-7adfa4cb488c admin admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:08.052786 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7740c3-9bef-4f73-900b-affd4748ca35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:08.052786 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7740c3-9bef-4f73-900b-affd4748ca35 admin admin] REQUEST_METHOD: `PUT` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:08.052786 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7740c3-9bef-4f73-900b-affd4748ca35 admin admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:08.052786 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7740c3-9bef-4f73-900b-affd4748ca35 admin admin] PATH_INFO: `/v3/projects/ac1d0d3dc7de4566b7064c81668c8853/users/4bc70bc60d7c40ea9e786eac195fc300/roles/153539819e5542df99269d2913bbecfb` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:08.060750 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 873/1755] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Jul 14 10:53:07 2022] DELETE /identity/v3/users/f095bf9ce8af4762a2bceaff7c83f045 => generated 0 bytes in 543 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:53:08.064315 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba396730-de80-4594-90df-eb73fa504fd9 None None] REQUEST_METHOD: `POST` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:08.065593 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba396730-de80-4594-90df-eb73fa504fd9 None None] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:08.065593 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba396730-de80-4594-90df-eb73fa504fd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:08.067321 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7740c3-9bef-4f73-900b-affd4748ca35 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ac1d0d3dc7de4566b7064c81668c8853, user_id=4bc70bc60d7c40ea9e786eac195fc300, role_id=153539819e5542df99269d2913bbecfb)` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:08.070050 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7740c3-9bef-4f73-900b-affd4748ca35 admin admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:08.128122 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 883/1756] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Jul 14 10:53:07 2022] PUT /identity/v3/projects/ac1d0d3dc7de4566b7064c81668c8853/users/4bc70bc60d7c40ea9e786eac195fc300/roles/153539819e5542df99269d2913bbecfb => generated 0 bytes in 471 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:53:08.129523 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a7363e-5262-433b-af2b-5bf71ac31f4c None None] REQUEST_METHOD: `POST` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:08.130431 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a7363e-5262-433b-af2b-5bf71ac31f4c None None] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:08.130431 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a7363e-5262-433b-af2b-5bf71ac31f4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:08.170688 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.auth.core [None req-ba396730-de80-4594-90df-eb73fa504fd9 None None] MFA Rules not processed for user `dac36048e10f46598a93fe8a4225fe7c`. Rule list: `[]` (Enabled: `True`). {{(pid=86656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:53:08.172120 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-ba396730-de80-4594-90df-eb73fa504fd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:08.193997 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.auth.core [None req-e3a7363e-5262-433b-af2b-5bf71ac31f4c None None] MFA Rules not processed for user `ae4bcdd8106d4bebbdcae96be33505bc`. Rule list: `[]` (Enabled: `True`). {{(pid=86655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:53:08.196439 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-e3a7363e-5262-433b-af2b-5bf71ac31f4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:08.303449 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:53:08.417083 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 874/1757] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jul 14 10:53:08 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 356 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:53:08.429137 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3712e328-c298-4f4b-afed-571d8f9aba85 None None] REQUEST_METHOD: `POST` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:08.429472 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3712e328-c298-4f4b-afed-571d8f9aba85 None None] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:08.429691 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3712e328-c298-4f4b-afed-571d8f9aba85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:08.449507 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 884/1758] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jul 14 10:53:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 321 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:53:08.533782 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.auth.core [None req-3712e328-c298-4f4b-afed-571d8f9aba85 None None] MFA Rules not processed for user `4bc70bc60d7c40ea9e786eac195fc300`. Rule list: `[]` (Enabled: `True`). {{(pid=86656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:53:08.533782 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-3712e328-c298-4f4b-afed-571d8f9aba85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:08.634451 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a7363e-5262-433b-af2b-5bf71ac31f4c None None] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:08.635926 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-e3a7363e-5262-433b-af2b-5bf71ac31f4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:08.788666 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 875/1759] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jul 14 10:53:08 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 371 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:53:08.791197 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3712e328-c298-4f4b-afed-571d8f9aba85 None None] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:08.805667 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-3712e328-c298-4f4b-afed-571d8f9aba85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:08.845349 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a7363e-5262-433b-af2b-5bf71ac31f4c None None] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:08.862227 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1048c825-0ed5-4d76-ae99-8350938b7119 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68382432147a48c3b62271fd2a2eab04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59391272ecbe48b0aa736cb43807be1d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:08.863176 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1048c825-0ed5-4d76-ae99-8350938b7119 service cinder] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:08.863745 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1048c825-0ed5-4d76-ae99-8350938b7119 service cinder] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:08.864175 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1048c825-0ed5-4d76-ae99-8350938b7119 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:08.897146 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1048c825-0ed5-4d76-ae99-8350938b7119 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:08.898641 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1048c825-0ed5-4d76-ae99-8350938b7119 service cinder] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:08.916215 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:53:08.926912 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 885/1760] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jul 14 10:53:08 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 10:53:08.994155 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3712e328-c298-4f4b-afed-571d8f9aba85 None None] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:09.002778 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be7885f-ec85-4ab3-b953-42c990500fb5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dddf93691844886982c91fea974385d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59391272ecbe48b0aa736cb43807be1d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:09.004953 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be7885f-ec85-4ab3-b953-42c990500fb5 service neutron] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:09.006512 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be7885f-ec85-4ab3-b953-42c990500fb5 service neutron] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:09.006948 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be7885f-ec85-4ab3-b953-42c990500fb5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:09.030867 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be7885f-ec85-4ab3-b953-42c990500fb5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:09.033962 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be7885f-ec85-4ab3-b953-42c990500fb5 service neutron] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:09.048534 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 876/1761] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jul 14 10:53:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 258 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:53:09.433139 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1048c825-0ed5-4d76-ae99-8350938b7119 service cinder] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:09.434896 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-1048c825-0ed5-4d76-ae99-8350938b7119 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:09.464233 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1048c825-0ed5-4d76-ae99-8350938b7119 service cinder] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:09.477701 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2f9b3e-954d-4e9f-ae9b-82c86a2c5496 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68382432147a48c3b62271fd2a2eab04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59391272ecbe48b0aa736cb43807be1d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:09.478578 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2f9b3e-954d-4e9f-ae9b-82c86a2c5496 service cinder] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:09.479019 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2f9b3e-954d-4e9f-ae9b-82c86a2c5496 service cinder] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:09.479454 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2f9b3e-954d-4e9f-ae9b-82c86a2c5496 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:09.482653 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-4c2f9b3e-954d-4e9f-ae9b-82c86a2c5496 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:09.673039 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2f9b3e-954d-4e9f-ae9b-82c86a2c5496 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:09.674569 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2f9b3e-954d-4e9f-ae9b-82c86a2c5496 service cinder] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:09.708886 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 886/1762] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jul 14 10:53:09 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 276 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:53:10.989983 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be7885f-ec85-4ab3-b953-42c990500fb5 service neutron] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:11.016930 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be7885f-ec85-4ab3-b953-42c990500fb5 service neutron] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:11.039783 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf37d855-12f5-4a98-b1df-06c29f1d47f7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68382432147a48c3b62271fd2a2eab04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59391272ecbe48b0aa736cb43807be1d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:11.040534 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf37d855-12f5-4a98-b1df-06c29f1d47f7 service cinder] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:11.041115 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf37d855-12f5-4a98-b1df-06c29f1d47f7 service cinder] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:11.042951 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf37d855-12f5-4a98-b1df-06c29f1d47f7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:11.051239 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-cf37d855-12f5-4a98-b1df-06c29f1d47f7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:11.213254 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf37d855-12f5-4a98-b1df-06c29f1d47f7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:11.216444 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf37d855-12f5-4a98-b1df-06c29f1d47f7 service cinder] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:11.236165 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2f9b3e-954d-4e9f-ae9b-82c86a2c5496 service cinder] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:11.240651 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-4c2f9b3e-954d-4e9f-ae9b-82c86a2c5496 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:11.244802 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 877/1763] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jul 14 10:53:10 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 255 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:53:11.276524 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2f9b3e-954d-4e9f-ae9b-82c86a2c5496 service cinder] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:11.287014 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b3aa59-a880-4a08-865f-9a5026b78c2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:11.287986 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b3aa59-a880-4a08-865f-9a5026b78c2e admin admin] REQUEST_METHOD: `DELETE` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:11.288258 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b3aa59-a880-4a08-865f-9a5026b78c2e admin admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:11.288540 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b3aa59-a880-4a08-865f-9a5026b78c2e admin admin] PATH_INFO: `/v3/projects/4af7b268f6de4726ad8d78ced603bbfe` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:11.289925 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b3aa59-a880-4a08-865f-9a5026b78c2e admin admin] RBAC: Authorizing `identity:delete_project(project_id=4af7b268f6de4726ad8d78ced603bbfe)` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:11.292013 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b3aa59-a880-4a08-865f-9a5026b78c2e admin admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:11.406306 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-85b3aa59-a880-4a08-865f-9a5026b78c2e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4af7b268f6de4726ad8d78ced603bbfe', 'request_id': 'req-85b3aa59-a880-4a08-865f-9a5026b78c2e'} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:11.425766 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-85b3aa59-a880-4a08-865f-9a5026b78c2e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4af7b268f6de4726ad8d78ced603bbfe', 'request_id': 'req-85b3aa59-a880-4a08-865f-9a5026b78c2e'} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:11.447715 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-85b3aa59-a880-4a08-865f-9a5026b78c2e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4af7b268f6de4726ad8d78ced603bbfe', 'request_id': 'req-85b3aa59-a880-4a08-865f-9a5026b78c2e'} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:11.452378 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:53:11.472202 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-85b3aa59-a880-4a08-865f-9a5026b78c2e admin admin] The token cache is being invalidate because project 4af7b268f6de4726ad8d78ced603bbfe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86655) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 10:53:11.472495 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-85b3aa59-a880-4a08-865f-9a5026b78c2e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:11.477248 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-85b3aa59-a880-4a08-865f-9a5026b78c2e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:11.481037 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 887/1764] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Jul 14 10:53:11 2022] DELETE /identity/v3/projects/4af7b268f6de4726ad8d78ced603bbfe => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:53:11.492447 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f12191a-f951-485d-b8ae-74f6204f76df None None] REQUEST_METHOD: `POST` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:11.492922 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f12191a-f951-485d-b8ae-74f6204f76df None None] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:11.493306 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f12191a-f951-485d-b8ae-74f6204f76df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:11.639351 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.auth.core [None req-2f12191a-f951-485d-b8ae-74f6204f76df None None] MFA Rules not processed for user `ae4bcdd8106d4bebbdcae96be33505bc`. Rule list: `[]` (Enabled: `True`). {{(pid=86656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:53:11.645629 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-2f12191a-f951-485d-b8ae-74f6204f76df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:12.047870 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 878/1765] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jul 14 10:53:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 563 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:53:12.056409 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02051621-6633-45b1-b359-d943fd318d3d None None] REQUEST_METHOD: `POST` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:12.057130 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02051621-6633-45b1-b359-d943fd318d3d None None] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:12.057629 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02051621-6633-45b1-b359-d943fd318d3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:12.135149 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.auth.core [None req-02051621-6633-45b1-b359-d943fd318d3d None None] MFA Rules not processed for user `ae4bcdd8106d4bebbdcae96be33505bc`. Rule list: `[]` (Enabled: `True`). {{(pid=86655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:53:12.142134 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-02051621-6633-45b1-b359-d943fd318d3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:12.174523 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 888/1766] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jul 14 10:53:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:53:12.178865 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f12191a-f951-485d-b8ae-74f6204f76df None None] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:12.199603 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b121c0c-7515-4995-bc04-2987149bf551 None None] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:12.201369 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b121c0c-7515-4995-bc04-2987149bf551 None None] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:12.202179 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b121c0c-7515-4995-bc04-2987149bf551 None None] PATH_INFO: `/` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:12.204660 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f12191a-f951-485d-b8ae-74f6204f76df None None] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:12.208456 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 889/1767] 10.222.0.16 () {54 vars in 921 bytes} [Thu Jul 14 10:53:12 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:53:12.241965 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ee2023-edee-47c6-9f41-5eef94f4231e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:12.242937 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ee2023-edee-47c6-9f41-5eef94f4231e admin admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:12.243456 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ee2023-edee-47c6-9f41-5eef94f4231e admin admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:12.244558 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ee2023-edee-47c6-9f41-5eef94f4231e admin admin] PATH_INFO: `/v3/domains` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:12.245576 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ee2023-edee-47c6-9f41-5eef94f4231e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:53:12.246103 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ee2023-edee-47c6-9f41-5eef94f4231e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:12.249879 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ee2023-edee-47c6-9f41-5eef94f4231e admin admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:12.254208 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6174e433-ccb7-42a5-90a8-4a5d92aa79eb None None] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:12.255125 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6174e433-ccb7-42a5-90a8-4a5d92aa79eb None None] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:12.255627 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6174e433-ccb7-42a5-90a8-4a5d92aa79eb None None] PATH_INFO: `/` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:12.257489 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 890/1768] 10.222.0.16 () {54 vars in 921 bytes} [Thu Jul 14 10:53:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 14 10:53:12.267060 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc249cbe-1f3c-493f-a31f-a3e1d74f1c6d None None] REQUEST_METHOD: `POST` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:12.267654 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc249cbe-1f3c-493f-a31f-a3e1d74f1c6d None None] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:12.268141 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc249cbe-1f3c-493f-a31f-a3e1d74f1c6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:12.307560 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 879/1769] 10.222.0.16 () {58 vars in 1152 bytes} [Thu Jul 14 10:53:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:53:12.312185 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ee2023-edee-47c6-9f41-5eef94f4231e admin admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:12.312348 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.auth.core [None req-cc249cbe-1f3c-493f-a31f-a3e1d74f1c6d None None] MFA Rules not processed for user `26aa294c913c408499a913ec25bb677d`. Rule list: `[]` (Enabled: `True`). {{(pid=86655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:53:12.313810 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-cc249cbe-1f3c-493f-a31f-a3e1d74f1c6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:12.333826 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ee2023-edee-47c6-9f41-5eef94f4231e admin admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:12.339954 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae6b4eb-f6ea-46e5-9f9a-b5ff2bdfb90e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:12.340920 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae6b4eb-f6ea-46e5-9f9a-b5ff2bdfb90e admin admin] REQUEST_METHOD: `POST` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:12.341422 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae6b4eb-f6ea-46e5-9f9a-b5ff2bdfb90e admin admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:12.341981 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae6b4eb-f6ea-46e5-9f9a-b5ff2bdfb90e admin admin] PATH_INFO: `/v3/projects` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:12.342910 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae6b4eb-f6ea-46e5-9f9a-b5ff2bdfb90e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:12.345180 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae6b4eb-f6ea-46e5-9f9a-b5ff2bdfb90e admin admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:12.430963 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 880/1770] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Jul 14 10:53:12 2022] POST /identity/v3/projects => generated 371 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:53:12.434587 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae6b4eb-f6ea-46e5-9f9a-b5ff2bdfb90e admin admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:12.594176 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:53:12.611565 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 891/1771] 10.222.0.16 () {58 vars in 1018 bytes} [Thu Jul 14 10:53:12 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 345 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:53:12.614499 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5109426a-6733-4abb-8f37-b2b587cb42b4 None None] REQUEST_METHOD: `POST` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:12.614812 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5109426a-6733-4abb-8f37-b2b587cb42b4 None None] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:12.615097 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5109426a-6733-4abb-8f37-b2b587cb42b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:12.662118 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.auth.core [None req-5109426a-6733-4abb-8f37-b2b587cb42b4 None None] MFA Rules not processed for user `26aa294c913c408499a913ec25bb677d`. Rule list: `[]` (Enabled: `True`). {{(pid=86655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:53:12.671542 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-5109426a-6733-4abb-8f37-b2b587cb42b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:12.698664 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae6b4eb-f6ea-46e5-9f9a-b5ff2bdfb90e admin admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:12.716033 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483d1353-b90b-499c-9f34-65355312b097 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:12.717849 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483d1353-b90b-499c-9f34-65355312b097 admin admin] REQUEST_METHOD: `POST` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:12.718259 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483d1353-b90b-499c-9f34-65355312b097 admin admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:12.718646 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483d1353-b90b-499c-9f34-65355312b097 admin admin] PATH_INFO: `/v3/users` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:12.719480 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483d1353-b90b-499c-9f34-65355312b097 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:12.728994 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483d1353-b90b-499c-9f34-65355312b097 admin admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:12.816738 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 881/1772] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Jul 14 10:53:12 2022] POST /identity/v3/users => generated 286 bytes in 383 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 10:53:12.824269 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483d1353-b90b-499c-9f34-65355312b097 admin admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:12.833987 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-483d1353-b90b-499c-9f34-65355312b097 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:13.014489 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483d1353-b90b-499c-9f34-65355312b097 admin admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:13.028402 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782971b7-08da-4a32-a76a-bcd902d4bd46 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26aa294c913c408499a913ec25bb677d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59391272ecbe48b0aa736cb43807be1d', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:13.028981 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 892/1773] 10.222.0.16 () {58 vars in 1018 bytes} [Thu Jul 14 10:53:12 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 417 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:53:13.030447 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782971b7-08da-4a32-a76a-bcd902d4bd46 service nova] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:13.031207 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782971b7-08da-4a32-a76a-bcd902d4bd46 service nova] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:13.031748 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782971b7-08da-4a32-a76a-bcd902d4bd46 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:13.036628 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5109426a-6733-4abb-8f37-b2b587cb42b4 None None] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:13.056093 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782971b7-08da-4a32-a76a-bcd902d4bd46 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:13.062699 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782971b7-08da-4a32-a76a-bcd902d4bd46 service nova] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:13.067960 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5109426a-6733-4abb-8f37-b2b587cb42b4 None None] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:13.094653 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42ee8e6-cfcc-4ba9-9af7-e133b011bf34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:13.097099 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42ee8e6-cfcc-4ba9-9af7-e133b011bf34 admin admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:13.097410 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42ee8e6-cfcc-4ba9-9af7-e133b011bf34 admin admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:13.098420 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42ee8e6-cfcc-4ba9-9af7-e133b011bf34 admin admin] PATH_INFO: `/v3/roles` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:13.099204 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42ee8e6-cfcc-4ba9-9af7-e133b011bf34 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:13.100867 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42ee8e6-cfcc-4ba9-9af7-e133b011bf34 admin admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:13.112649 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 882/1774] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jul 14 10:53:12 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:53:13.113987 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782971b7-08da-4a32-a76a-bcd902d4bd46 service nova] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:13.115846 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-782971b7-08da-4a32-a76a-bcd902d4bd46 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:13.132102 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 893/1775] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jul 14 10:53:13 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:53:13.136363 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42ee8e6-cfcc-4ba9-9af7-e133b011bf34 admin admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:13.141506 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782971b7-08da-4a32-a76a-bcd902d4bd46 service nova] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:13.151807 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a0a398-e50a-4341-9f5d-877c83512282 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26aa294c913c408499a913ec25bb677d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59391272ecbe48b0aa736cb43807be1d', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:13.152627 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a0a398-e50a-4341-9f5d-877c83512282 service nova] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:13.153924 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a0a398-e50a-4341-9f5d-877c83512282 service nova] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:13.154996 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a0a398-e50a-4341-9f5d-877c83512282 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:13.162930 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42ee8e6-cfcc-4ba9-9af7-e133b011bf34 admin admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:13.169344 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a0a398-e50a-4341-9f5d-877c83512282 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:13.172385 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a0a398-e50a-4341-9f5d-877c83512282 service nova] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:13.182860 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff7d9e7-7907-463f-925c-d01a66e382f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:13.183576 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff7d9e7-7907-463f-925c-d01a66e382f1 admin admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:13.183865 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff7d9e7-7907-463f-925c-d01a66e382f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:13.184151 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff7d9e7-7907-463f-925c-d01a66e382f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:13.185229 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff7d9e7-7907-463f-925c-d01a66e382f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:13.188847 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff7d9e7-7907-463f-925c-d01a66e382f1 admin admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:13.192510 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 883/1776] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jul 14 10:53:13 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:53:13.240735 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 894/1777] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jul 14 10:53:13 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:53:13.245030 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a0a398-e50a-4341-9f5d-877c83512282 service nova] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:13.264987 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a0a398-e50a-4341-9f5d-877c83512282 service nova] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:13.286620 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9342feb3-b475-4c37-ae8a-51401e415c26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:13.287435 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9342feb3-b475-4c37-ae8a-51401e415c26 admin admin] REQUEST_METHOD: `PUT` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:13.288160 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9342feb3-b475-4c37-ae8a-51401e415c26 admin admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:13.289456 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9342feb3-b475-4c37-ae8a-51401e415c26 admin admin] PATH_INFO: `/v3/projects/28888e282a7d4665b9969bee391e010a/users/5424070783544cc29b4f89ca4e3e3017/roles/0da46c267d354cce81495dfdd56c1ec2` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:13.347318 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9342feb3-b475-4c37-ae8a-51401e415c26 admin admin] RBAC: Authorizing `identity:create_grant(project_id=28888e282a7d4665b9969bee391e010a, user_id=5424070783544cc29b4f89ca4e3e3017, role_id=0da46c267d354cce81495dfdd56c1ec2)` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:13.358151 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9342feb3-b475-4c37-ae8a-51401e415c26 admin admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:13.401074 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 884/1778] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Jul 14 10:53:13 2022] PUT /identity/v3/projects/28888e282a7d4665b9969bee391e010a/users/5424070783544cc29b4f89ca4e3e3017/roles/0da46c267d354cce81495dfdd56c1ec2 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 10:53:13.411455 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35449120-46dd-4421-a2a2-c26c263613d4 None None] REQUEST_METHOD: `POST` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:13.413396 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35449120-46dd-4421-a2a2-c26c263613d4 None None] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:13.413912 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35449120-46dd-4421-a2a2-c26c263613d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:13.516962 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.auth.core [None req-35449120-46dd-4421-a2a2-c26c263613d4 None None] MFA Rules not processed for user `5424070783544cc29b4f89ca4e3e3017`. Rule list: `[]` (Enabled: `True`). {{(pid=86655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:53:13.518841 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-35449120-46dd-4421-a2a2-c26c263613d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:13.656066 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=100 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:53:13.730206 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 895/1779] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jul 14 10:53:13 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 320 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:53:13.734780 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9342feb3-b475-4c37-ae8a-51401e415c26 admin admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:13.934325 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9342feb3-b475-4c37-ae8a-51401e415c26 admin admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:13.954697 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f837ae22-ecd7-44f3-9474-0a0520d8eed0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:13.955323 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f837ae22-ecd7-44f3-9474-0a0520d8eed0 admin admin] REQUEST_METHOD: `POST` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:13.955613 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f837ae22-ecd7-44f3-9474-0a0520d8eed0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:13.958297 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f837ae22-ecd7-44f3-9474-0a0520d8eed0 admin admin] PATH_INFO: `/v3/projects` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:13.959061 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f837ae22-ecd7-44f3-9474-0a0520d8eed0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:13.968150 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f837ae22-ecd7-44f3-9474-0a0520d8eed0 admin admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:14.001155 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:53:14.016281 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 885/1780] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Jul 14 10:53:13 2022] POST /identity/v3/projects => generated 373 bytes in 280 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:53:14.016671 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35449120-46dd-4421-a2a2-c26c263613d4 None None] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:14.034765 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35449120-46dd-4421-a2a2-c26c263613d4 None None] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:14.211835 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43b9edf-be9c-4144-ab10-bd861a56be99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:14.213415 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43b9edf-be9c-4144-ab10-bd861a56be99 admin admin] REQUEST_METHOD: `POST` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:14.214078 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43b9edf-be9c-4144-ab10-bd861a56be99 admin admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:14.214819 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43b9edf-be9c-4144-ab10-bd861a56be99 admin admin] PATH_INFO: `/v3/users` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:14.215765 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43b9edf-be9c-4144-ab10-bd861a56be99 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:14.218429 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43b9edf-be9c-4144-ab10-bd861a56be99 admin admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:14.258877 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f837ae22-ecd7-44f3-9474-0a0520d8eed0 admin admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:14.260101 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 896/1781] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Jul 14 10:53:14 2022] POST /identity/v3/users => generated 293 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:53:14.278264 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f837ae22-ecd7-44f3-9474-0a0520d8eed0 admin admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:14.284184 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e0586c-94fc-462a-98e1-f653a52526ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:14.284956 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e0586c-94fc-462a-98e1-f653a52526ec admin admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:14.285421 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e0586c-94fc-462a-98e1-f653a52526ec admin admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:14.285846 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e0586c-94fc-462a-98e1-f653a52526ec admin admin] PATH_INFO: `/v3/roles` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:14.286829 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e0586c-94fc-462a-98e1-f653a52526ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:14.289257 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e0586c-94fc-462a-98e1-f653a52526ec admin admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:14.307288 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43b9edf-be9c-4144-ab10-bd861a56be99 admin admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:14.320570 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 886/1782] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jul 14 10:53:14 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:53:14.323679 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43b9edf-be9c-4144-ab10-bd861a56be99 admin admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:14.335696 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2f6fa3-84e2-4088-9a40-d674818f4b35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:14.336984 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2f6fa3-84e2-4088-9a40-d674818f4b35 admin admin] REQUEST_METHOD: `PUT` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:14.337545 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2f6fa3-84e2-4088-9a40-d674818f4b35 admin admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:14.338330 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2f6fa3-84e2-4088-9a40-d674818f4b35 admin admin] PATH_INFO: `/v3/projects/70f61952c0a0494baafa76e55ef495f6/users/aaafe8640b394ccda35ca9c07e9e7f74/roles/153539819e5542df99269d2913bbecfb` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:14.349311 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e0586c-94fc-462a-98e1-f653a52526ec admin admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:14.352241 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-81e0586c-94fc-462a-98e1-f653a52526ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:14.374901 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2f6fa3-84e2-4088-9a40-d674818f4b35 admin admin] RBAC: Authorizing `identity:create_grant(project_id=70f61952c0a0494baafa76e55ef495f6, user_id=aaafe8640b394ccda35ca9c07e9e7f74, role_id=153539819e5542df99269d2913bbecfb)` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:14.383175 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2f6fa3-84e2-4088-9a40-d674818f4b35 admin admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:14.457918 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 897/1783] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Jul 14 10:53:14 2022] PUT /identity/v3/projects/70f61952c0a0494baafa76e55ef495f6/users/aaafe8640b394ccda35ca9c07e9e7f74/roles/153539819e5542df99269d2913bbecfb => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 10:53:14.460650 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2f6fa3-84e2-4088-9a40-d674818f4b35 admin admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:14.559191 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e0586c-94fc-462a-98e1-f653a52526ec admin admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:14.658801 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2f6fa3-84e2-4088-9a40-d674818f4b35 admin admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:14.666477 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c464aa4-8bdd-449c-abdb-d166c30c1177 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:14.667880 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c464aa4-8bdd-449c-abdb-d166c30c1177 admin admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:14.668166 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c464aa4-8bdd-449c-abdb-d166c30c1177 admin admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:14.668441 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c464aa4-8bdd-449c-abdb-d166c30c1177 admin admin] PATH_INFO: `/v3/roles` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:14.669617 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c464aa4-8bdd-449c-abdb-d166c30c1177 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:14.671782 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81145731-b795-46a2-80cd-7224fa39d04a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68382432147a48c3b62271fd2a2eab04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59391272ecbe48b0aa736cb43807be1d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:14.672456 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81145731-b795-46a2-80cd-7224fa39d04a service cinder] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:14.672741 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81145731-b795-46a2-80cd-7224fa39d04a service cinder] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:14.673060 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81145731-b795-46a2-80cd-7224fa39d04a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:14.674786 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c464aa4-8bdd-449c-abdb-d166c30c1177 admin admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:14.678061 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-81145731-b795-46a2-80cd-7224fa39d04a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:14.695844 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 898/1784] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jul 14 10:53:14 2022] GET /identity/v3/roles => generated 1420 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:53:14.699502 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c464aa4-8bdd-449c-abdb-d166c30c1177 admin admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:14.766586 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c464aa4-8bdd-449c-abdb-d166c30c1177 admin admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:14.787202 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea886d4-8230-4985-8131-79b51c042a69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:14.788664 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea886d4-8230-4985-8131-79b51c042a69 admin admin] REQUEST_METHOD: `PUT` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:14.789266 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea886d4-8230-4985-8131-79b51c042a69 admin admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:14.797144 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea886d4-8230-4985-8131-79b51c042a69 admin admin] PATH_INFO: `/v3/projects/70f61952c0a0494baafa76e55ef495f6/users/aaafe8640b394ccda35ca9c07e9e7f74/roles/153539819e5542df99269d2913bbecfb` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:14.803024 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea886d4-8230-4985-8131-79b51c042a69 admin admin] RBAC: Authorizing `identity:create_grant(project_id=70f61952c0a0494baafa76e55ef495f6, user_id=aaafe8640b394ccda35ca9c07e9e7f74, role_id=153539819e5542df99269d2913bbecfb)` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:14.810991 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea886d4-8230-4985-8131-79b51c042a69 admin admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:14.858815 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81145731-b795-46a2-80cd-7224fa39d04a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:14.860578 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81145731-b795-46a2-80cd-7224fa39d04a service cinder] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:14.863521 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 899/1785] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Jul 14 10:53:14 2022] PUT /identity/v3/projects/70f61952c0a0494baafa76e55ef495f6/users/aaafe8640b394ccda35ca9c07e9e7f74/roles/153539819e5542df99269d2913bbecfb => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:53:14.877829 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d098226f-7443-4816-9a40-57b07c9aa30b None None] REQUEST_METHOD: `POST` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:14.878474 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d098226f-7443-4816-9a40-57b07c9aa30b None None] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:14.878966 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d098226f-7443-4816-9a40-57b07c9aa30b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:14.905923 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 887/1786] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jul 14 10:53:14 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 556 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 10:53:14.964158 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.auth.core [None req-d098226f-7443-4816-9a40-57b07c9aa30b None None] MFA Rules not processed for user `aaafe8640b394ccda35ca9c07e9e7f74`. Rule list: `[]` (Enabled: `True`). {{(pid=86655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:53:14.965511 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-d098226f-7443-4816-9a40-57b07c9aa30b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:15.004615 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:53:15.128840 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 900/1787] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jul 14 10:53:14 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 10:53:15.249790 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81145731-b795-46a2-80cd-7224fa39d04a service cinder] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:15.261207 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81145731-b795-46a2-80cd-7224fa39d04a service cinder] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:15.339346 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a177a61-332e-4e69-9994-3b3fe5ab2625 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68382432147a48c3b62271fd2a2eab04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59391272ecbe48b0aa736cb43807be1d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:15.340291 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a177a61-332e-4e69-9994-3b3fe5ab2625 service cinder] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:15.340946 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a177a61-332e-4e69-9994-3b3fe5ab2625 service cinder] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:15.342284 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a177a61-332e-4e69-9994-3b3fe5ab2625 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:15.351476 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=100 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:53:15.354875 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a177a61-332e-4e69-9994-3b3fe5ab2625 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:15.357145 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a177a61-332e-4e69-9994-3b3fe5ab2625 service cinder] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:15.381436 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 888/1788] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jul 14 10:53:15 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:53:17.908583 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d098226f-7443-4816-9a40-57b07c9aa30b None None] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:18.035301 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d098226f-7443-4816-9a40-57b07c9aa30b None None] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:18.051657 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e8a4d7-d3e5-44cb-bf5d-615d23e4482f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:18.053277 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e8a4d7-d3e5-44cb-bf5d-615d23e4482f admin admin] REQUEST_METHOD: `DELETE` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:18.053707 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e8a4d7-d3e5-44cb-bf5d-615d23e4482f admin admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:18.053994 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e8a4d7-d3e5-44cb-bf5d-615d23e4482f admin admin] PATH_INFO: `/v3/users/5424070783544cc29b4f89ca4e3e3017` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:18.059462 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e8a4d7-d3e5-44cb-bf5d-615d23e4482f admin admin] RBAC: Authorizing `identity:delete_user(user_id=5424070783544cc29b4f89ca4e3e3017)` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:18.062088 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e8a4d7-d3e5-44cb-bf5d-615d23e4482f admin admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:18.178543 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-76e8a4d7-d3e5-44cb-bf5d-615d23e4482f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5424070783544cc29b4f89ca4e3e3017'} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:18.192963 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-76e8a4d7-d3e5-44cb-bf5d-615d23e4482f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5424070783544cc29b4f89ca4e3e3017'} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:18.194557 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-76e8a4d7-d3e5-44cb-bf5d-615d23e4482f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5424070783544cc29b4f89ca4e3e3017'} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:18.220142 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-76e8a4d7-d3e5-44cb-bf5d-615d23e4482f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5424070783544cc29b4f89ca4e3e3017'} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:18.221970 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-76e8a4d7-d3e5-44cb-bf5d-615d23e4482f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5424070783544cc29b4f89ca4e3e3017'} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:18.278769 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 901/1789] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Jul 14 10:53:17 2022] DELETE /identity/v3/users/5424070783544cc29b4f89ca4e3e3017 => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:53:18.286097 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1055cb5d-6bcd-4ad6-b203-4eec8aa38d92 None None] REQUEST_METHOD: `POST` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:18.286517 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1055cb5d-6bcd-4ad6-b203-4eec8aa38d92 None None] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:18.286938 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1055cb5d-6bcd-4ad6-b203-4eec8aa38d92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:18.317594 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.auth.core [None req-1055cb5d-6bcd-4ad6-b203-4eec8aa38d92 None None] MFA Rules not processed for user `ae4bcdd8106d4bebbdcae96be33505bc`. Rule list: `[]` (Enabled: `True`). {{(pid=86656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:53:18.319455 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-1055cb5d-6bcd-4ad6-b203-4eec8aa38d92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:18.382239 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e8a4d7-d3e5-44cb-bf5d-615d23e4482f admin admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:18.383652 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-76e8a4d7-d3e5-44cb-bf5d-615d23e4482f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:18.410450 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 889/1790] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jul 14 10:53:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:53:18.424505 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1055cb5d-6bcd-4ad6-b203-4eec8aa38d92 None None] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:18.426492 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-1055cb5d-6bcd-4ad6-b203-4eec8aa38d92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:18.429807 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:53:18.456266 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e8a4d7-d3e5-44cb-bf5d-615d23e4482f admin admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:18.462091 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e5cd19-a5a6-45af-866e-c03ff60e0686 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68382432147a48c3b62271fd2a2eab04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59391272ecbe48b0aa736cb43807be1d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:18.462758 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e5cd19-a5a6-45af-866e-c03ff60e0686 service cinder] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:18.463043 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e5cd19-a5a6-45af-866e-c03ff60e0686 service cinder] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:18.463324 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e5cd19-a5a6-45af-866e-c03ff60e0686 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:18.465144 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-68e5cd19-a5a6-45af-866e-c03ff60e0686 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:18.523154 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1055cb5d-6bcd-4ad6-b203-4eec8aa38d92 None None] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:18.528982 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56a70a9-a08d-41a8-8519-b06fdf430aec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dddf93691844886982c91fea974385d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59391272ecbe48b0aa736cb43807be1d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:18.529707 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56a70a9-a08d-41a8-8519-b06fdf430aec service neutron] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:18.529997 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56a70a9-a08d-41a8-8519-b06fdf430aec service neutron] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:18.530281 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56a70a9-a08d-41a8-8519-b06fdf430aec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:18.540669 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56a70a9-a08d-41a8-8519-b06fdf430aec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:18.542164 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56a70a9-a08d-41a8-8519-b06fdf430aec service neutron] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:18.547222 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e5cd19-a5a6-45af-866e-c03ff60e0686 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:18.549499 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e5cd19-a5a6-45af-866e-c03ff60e0686 service cinder] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:18.554545 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 890/1791] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jul 14 10:53:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:53:18.565004 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 902/1792] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jul 14 10:53:18 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 10:53:18.980331 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56a70a9-a08d-41a8-8519-b06fdf430aec service neutron] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:18.982882 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-b56a70a9-a08d-41a8-8519-b06fdf430aec service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:19.009157 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56a70a9-a08d-41a8-8519-b06fdf430aec service neutron] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:19.015937 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfcd9855-798f-42e1-ac31-bef0eafcde68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:19.019861 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcd9855-798f-42e1-ac31-bef0eafcde68 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:19.020415 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcd9855-798f-42e1-ac31-bef0eafcde68 admin admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:19.020791 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcd9855-798f-42e1-ac31-bef0eafcde68 admin admin] PATH_INFO: `/v3/projects/28888e282a7d4665b9969bee391e010a` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:19.022443 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfcd9855-798f-42e1-ac31-bef0eafcde68 admin admin] RBAC: Authorizing `identity:delete_project(project_id=28888e282a7d4665b9969bee391e010a)` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:19.024502 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfcd9855-798f-42e1-ac31-bef0eafcde68 admin admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:19.097375 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-cfcd9855-798f-42e1-ac31-bef0eafcde68 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '28888e282a7d4665b9969bee391e010a', 'request_id': 'req-cfcd9855-798f-42e1-ac31-bef0eafcde68'} {{(pid=86656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:19.106129 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-cfcd9855-798f-42e1-ac31-bef0eafcde68 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '28888e282a7d4665b9969bee391e010a', 'request_id': 'req-cfcd9855-798f-42e1-ac31-bef0eafcde68'} {{(pid=86656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:19.114379 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-cfcd9855-798f-42e1-ac31-bef0eafcde68 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '28888e282a7d4665b9969bee391e010a', 'request_id': 'req-cfcd9855-798f-42e1-ac31-bef0eafcde68'} {{(pid=86656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:19.129692 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-cfcd9855-798f-42e1-ac31-bef0eafcde68 admin admin] The token cache is being invalidate because project 28888e282a7d4665b9969bee391e010a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86656) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 10:53:19.130019 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-cfcd9855-798f-42e1-ac31-bef0eafcde68 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:19.130846 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-cfcd9855-798f-42e1-ac31-bef0eafcde68 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:19.132892 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 891/1793] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Jul 14 10:53:18 2022] DELETE /identity/v3/projects/28888e282a7d4665b9969bee391e010a => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:53:19.137138 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e5cd19-a5a6-45af-866e-c03ff60e0686 service cinder] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:19.149130 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e5cd19-a5a6-45af-866e-c03ff60e0686 service cinder] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:19.226412 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7dc77e5-27e1-49c6-8b4b-362562773135 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:19.227375 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7dc77e5-27e1-49c6-8b4b-362562773135 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:19.227666 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7dc77e5-27e1-49c6-8b4b-362562773135 admin admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:19.227967 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7dc77e5-27e1-49c6-8b4b-362562773135 admin admin] PATH_INFO: `/v3/users/aaafe8640b394ccda35ca9c07e9e7f74` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:19.229329 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7dc77e5-27e1-49c6-8b4b-362562773135 admin admin] RBAC: Authorizing `identity:delete_user(user_id=aaafe8640b394ccda35ca9c07e9e7f74)` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:19.231431 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7dc77e5-27e1-49c6-8b4b-362562773135 admin admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:19.295711 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-f7dc77e5-27e1-49c6-8b4b-362562773135 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aaafe8640b394ccda35ca9c07e9e7f74'} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:19.314373 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-f7dc77e5-27e1-49c6-8b4b-362562773135 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aaafe8640b394ccda35ca9c07e9e7f74'} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:19.315103 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-f7dc77e5-27e1-49c6-8b4b-362562773135 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aaafe8640b394ccda35ca9c07e9e7f74'} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:19.323880 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-f7dc77e5-27e1-49c6-8b4b-362562773135 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aaafe8640b394ccda35ca9c07e9e7f74'} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:19.325125 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-f7dc77e5-27e1-49c6-8b4b-362562773135 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aaafe8640b394ccda35ca9c07e9e7f74'} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:19.350823 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 903/1794] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Jul 14 10:53:19 2022] DELETE /identity/v3/users/aaafe8640b394ccda35ca9c07e9e7f74 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:53:19.449950 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfcd9855-798f-42e1-ac31-bef0eafcde68 admin admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:19.453124 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-cfcd9855-798f-42e1-ac31-bef0eafcde68 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:19.467588 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfcd9855-798f-42e1-ac31-bef0eafcde68 admin admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:19.488212 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:53:19.548710 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ad58b6-7512-4068-a6da-8cd251526fae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:19.553525 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ad58b6-7512-4068-a6da-8cd251526fae admin admin] REQUEST_METHOD: `DELETE` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:19.553916 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ad58b6-7512-4068-a6da-8cd251526fae admin admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:19.554214 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ad58b6-7512-4068-a6da-8cd251526fae admin admin] PATH_INFO: `/v3/users/54f1bcb7cfb7435b88bfc8eeb5141f64` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:19.556206 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ad58b6-7512-4068-a6da-8cd251526fae admin admin] RBAC: Authorizing `identity:delete_user(user_id=54f1bcb7cfb7435b88bfc8eeb5141f64)` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:19.559525 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ad58b6-7512-4068-a6da-8cd251526fae admin admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:19.633948 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-07ad58b6-7512-4068-a6da-8cd251526fae admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '54f1bcb7cfb7435b88bfc8eeb5141f64'} {{(pid=86656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:19.661344 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-07ad58b6-7512-4068-a6da-8cd251526fae admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '54f1bcb7cfb7435b88bfc8eeb5141f64'} {{(pid=86656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:19.665069 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-07ad58b6-7512-4068-a6da-8cd251526fae admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '54f1bcb7cfb7435b88bfc8eeb5141f64'} {{(pid=86656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:19.677891 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-07ad58b6-7512-4068-a6da-8cd251526fae admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '54f1bcb7cfb7435b88bfc8eeb5141f64'} {{(pid=86656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:19.678666 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-07ad58b6-7512-4068-a6da-8cd251526fae admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '54f1bcb7cfb7435b88bfc8eeb5141f64'} {{(pid=86656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:19.682605 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7dc77e5-27e1-49c6-8b4b-362562773135 admin admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:19.684206 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-f7dc77e5-27e1-49c6-8b4b-362562773135 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:19.703921 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7dc77e5-27e1-49c6-8b4b-362562773135 admin admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:19.717808 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd1d590-11c1-48c9-a33f-850fe3f9a639 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:19.718707 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd1d590-11c1-48c9-a33f-850fe3f9a639 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:19.719023 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd1d590-11c1-48c9-a33f-850fe3f9a639 admin admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:19.719354 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd1d590-11c1-48c9-a33f-850fe3f9a639 admin admin] PATH_INFO: `/v3/projects/70f61952c0a0494baafa76e55ef495f6` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:19.721366 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd1d590-11c1-48c9-a33f-850fe3f9a639 admin admin] RBAC: Authorizing `identity:delete_project(project_id=70f61952c0a0494baafa76e55ef495f6)` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:19.721519 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 892/1795] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Jul 14 10:53:19 2022] DELETE /identity/v3/users/54f1bcb7cfb7435b88bfc8eeb5141f64 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:53:19.724637 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd1d590-11c1-48c9-a33f-850fe3f9a639 admin admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:19.726489 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac394543-0091-4db9-a7b0-b6d9db5de689 None None] REQUEST_METHOD: `POST` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:19.726674 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:53:19.726790 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac394543-0091-4db9-a7b0-b6d9db5de689 None None] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:19.727124 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac394543-0091-4db9-a7b0-b6d9db5de689 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:19.750136 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.auth.core [None req-ac394543-0091-4db9-a7b0-b6d9db5de689 None None] MFA Rules not processed for user `ae4bcdd8106d4bebbdcae96be33505bc`. Rule list: `[]` (Enabled: `True`). {{(pid=86656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:53:19.751608 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-ac394543-0091-4db9-a7b0-b6d9db5de689 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:19.789246 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-7fd1d590-11c1-48c9-a33f-850fe3f9a639 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '70f61952c0a0494baafa76e55ef495f6', 'request_id': 'req-7fd1d590-11c1-48c9-a33f-850fe3f9a639'} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:19.802528 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-7fd1d590-11c1-48c9-a33f-850fe3f9a639 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '70f61952c0a0494baafa76e55ef495f6', 'request_id': 'req-7fd1d590-11c1-48c9-a33f-850fe3f9a639'} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:19.811515 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-7fd1d590-11c1-48c9-a33f-850fe3f9a639 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '70f61952c0a0494baafa76e55ef495f6', 'request_id': 'req-7fd1d590-11c1-48c9-a33f-850fe3f9a639'} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:19.824811 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-7fd1d590-11c1-48c9-a33f-850fe3f9a639 admin admin] The token cache is being invalidate because project 70f61952c0a0494baafa76e55ef495f6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86655) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 10:53:19.825751 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-7fd1d590-11c1-48c9-a33f-850fe3f9a639 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:19.826530 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-7fd1d590-11c1-48c9-a33f-850fe3f9a639 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:19.828319 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 893/1796] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jul 14 10:53:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:53:19.829168 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 904/1797] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Jul 14 10:53:19 2022] DELETE /identity/v3/projects/70f61952c0a0494baafa76e55ef495f6 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 10:53:19.837424 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6f2f2f-f932-4055-a809-e6ca7a812068 None None] REQUEST_METHOD: `POST` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:19.837733 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6f2f2f-f932-4055-a809-e6ca7a812068 None None] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:19.838025 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6f2f2f-f932-4055-a809-e6ca7a812068 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:19.841109 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd1d590-11c1-48c9-a33f-850fe3f9a639 admin admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:19.843520 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-7fd1d590-11c1-48c9-a33f-850fe3f9a639 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:19.862313 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.auth.core [None req-1c6f2f2f-f932-4055-a809-e6ca7a812068 None None] MFA Rules not processed for user `ae4bcdd8106d4bebbdcae96be33505bc`. Rule list: `[]` (Enabled: `True`). {{(pid=86656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:53:19.863074 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-1c6f2f2f-f932-4055-a809-e6ca7a812068 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:19.916387 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:53:19.935670 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd1d590-11c1-48c9-a33f-850fe3f9a639 admin admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:19.940058 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fde53c-c365-4b0a-b132-67390b981898 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dddf93691844886982c91fea974385d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59391272ecbe48b0aa736cb43807be1d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:19.940940 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fde53c-c365-4b0a-b132-67390b981898 service neutron] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:19.941484 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fde53c-c365-4b0a-b132-67390b981898 service neutron] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:19.941915 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fde53c-c365-4b0a-b132-67390b981898 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:19.942831 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 894/1798] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jul 14 10:53:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:53:19.951652 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0038038-4e2b-4f85-a9db-4b7c38f16723 None None] REQUEST_METHOD: `POST` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:19.951972 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0038038-4e2b-4f85-a9db-4b7c38f16723 None None] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:19.952261 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0038038-4e2b-4f85-a9db-4b7c38f16723 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:19.953425 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-a6fde53c-c365-4b0a-b132-67390b981898 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:19.966529 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6fde53c-c365-4b0a-b132-67390b981898 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:19.968928 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6fde53c-c365-4b0a-b132-67390b981898 service neutron] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:19.972226 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.auth.core [None req-d0038038-4e2b-4f85-a9db-4b7c38f16723 None None] MFA Rules not processed for user `ae4bcdd8106d4bebbdcae96be33505bc`. Rule list: `[]` (Enabled: `True`). {{(pid=86656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:53:19.973488 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-d0038038-4e2b-4f85-a9db-4b7c38f16723 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:19.979237 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 905/1799] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jul 14 10:53:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 10:53:19.981832 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 895/1800] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jul 14 10:53:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 10:53:19.986230 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fde53c-c365-4b0a-b132-67390b981898 service neutron] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:19.995808 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fde53c-c365-4b0a-b132-67390b981898 service neutron] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:20.001129 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63264131-561f-477d-83a4-831c6d67d281 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:20.001440 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63264131-561f-477d-83a4-831c6d67d281 admin admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:20.002076 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63264131-561f-477d-83a4-831c6d67d281 admin admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:20.002076 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63264131-561f-477d-83a4-831c6d67d281 admin admin] PATH_INFO: `/v3/domains` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:20.002708 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63264131-561f-477d-83a4-831c6d67d281 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:53:20.005113 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63264131-561f-477d-83a4-831c6d67d281 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:20.006759 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63264131-561f-477d-83a4-831c6d67d281 admin admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:20.020060 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 906/1801] 10.222.0.16 () {58 vars in 1152 bytes} [Thu Jul 14 10:53:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:53:20.024232 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0038038-4e2b-4f85-a9db-4b7c38f16723 None None] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:20.038441 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0038038-4e2b-4f85-a9db-4b7c38f16723 None None] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:20.048856 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776b82b1-a591-49cb-91c5-bf02659066b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:20.049562 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776b82b1-a591-49cb-91c5-bf02659066b2 admin admin] REQUEST_METHOD: `POST` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:20.049865 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776b82b1-a591-49cb-91c5-bf02659066b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:20.050135 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776b82b1-a591-49cb-91c5-bf02659066b2 admin admin] PATH_INFO: `/v3/projects` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:20.050860 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776b82b1-a591-49cb-91c5-bf02659066b2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:20.052823 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776b82b1-a591-49cb-91c5-bf02659066b2 admin admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:20.093765 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 896/1802] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Jul 14 10:53:20 2022] POST /identity/v3/projects => generated 391 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 10:53:20.098287 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63264131-561f-477d-83a4-831c6d67d281 admin admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:20.111961 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63264131-561f-477d-83a4-831c6d67d281 admin admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:20.206958 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6de884-490f-4cc9-90a7-37c3eeb23740 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:20.208570 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6de884-490f-4cc9-90a7-37c3eeb23740 admin admin] REQUEST_METHOD: `POST` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:20.209216 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6de884-490f-4cc9-90a7-37c3eeb23740 admin admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:20.209798 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6de884-490f-4cc9-90a7-37c3eeb23740 admin admin] PATH_INFO: `/v3/users` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:20.210864 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6de884-490f-4cc9-90a7-37c3eeb23740 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:20.214389 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6de884-490f-4cc9-90a7-37c3eeb23740 admin admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:20.249295 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 907/1803] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Jul 14 10:53:20 2022] POST /identity/v3/users => generated 296 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 10:53:20.251080 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776b82b1-a591-49cb-91c5-bf02659066b2 admin admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:20.262273 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776b82b1-a591-49cb-91c5-bf02659066b2 admin admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:20.267803 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81a74d3-567e-499d-adc2-3df2e9a0771b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:20.268456 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81a74d3-567e-499d-adc2-3df2e9a0771b admin admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:20.268740 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81a74d3-567e-499d-adc2-3df2e9a0771b admin admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:20.269087 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81a74d3-567e-499d-adc2-3df2e9a0771b admin admin] PATH_INFO: `/v3/roles` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:20.269862 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81a74d3-567e-499d-adc2-3df2e9a0771b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:20.271456 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81a74d3-567e-499d-adc2-3df2e9a0771b admin admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:20.284126 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 897/1804] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jul 14 10:53:20 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:53:20.288538 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6de884-490f-4cc9-90a7-37c3eeb23740 admin admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:20.318848 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6de884-490f-4cc9-90a7-37c3eeb23740 admin admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:20.324678 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d30079-d2a4-4b1b-9713-a331fdb1eacd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:20.325434 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d30079-d2a4-4b1b-9713-a331fdb1eacd admin admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:20.325910 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d30079-d2a4-4b1b-9713-a331fdb1eacd admin admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:20.326154 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d30079-d2a4-4b1b-9713-a331fdb1eacd admin admin] PATH_INFO: `/v3/roles` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:20.326901 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d30079-d2a4-4b1b-9713-a331fdb1eacd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:20.328512 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d30079-d2a4-4b1b-9713-a331fdb1eacd admin admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:20.334968 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81a74d3-567e-499d-adc2-3df2e9a0771b admin admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:20.335492 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:53:20.337352 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-c81a74d3-567e-499d-adc2-3df2e9a0771b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:20.361646 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 908/1805] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jul 14 10:53:20 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 10:53:20.361910 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d30079-d2a4-4b1b-9713-a331fdb1eacd admin admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:20.373957 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81a74d3-567e-499d-adc2-3df2e9a0771b admin admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:20.376033 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d30079-d2a4-4b1b-9713-a331fdb1eacd admin admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:20.382374 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20cf4c5-4813-4bee-bfc2-c1f10a753827 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:20.383170 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1189c2-3d2c-4318-a733-6e5561a9eb1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:20.383292 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20cf4c5-4813-4bee-bfc2-c1f10a753827 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:20.383584 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20cf4c5-4813-4bee-bfc2-c1f10a753827 admin admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:20.383869 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20cf4c5-4813-4bee-bfc2-c1f10a753827 admin admin] PATH_INFO: `/v3/projects/9c661b9c2c5d4349866ed82cefa1e717` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:20.384542 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1189c2-3d2c-4318-a733-6e5561a9eb1e admin admin] REQUEST_METHOD: `PUT` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:20.385127 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20cf4c5-4813-4bee-bfc2-c1f10a753827 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9c661b9c2c5d4349866ed82cefa1e717)` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:20.385343 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1189c2-3d2c-4318-a733-6e5561a9eb1e admin admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:20.385799 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1189c2-3d2c-4318-a733-6e5561a9eb1e admin admin] PATH_INFO: `/v3/projects/5a26d19ad5324a3e80a0da6bf54c361f/users/4f89ddcda7304b38ae33c6e5abb450be/roles/0da46c267d354cce81495dfdd56c1ec2` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:20.387556 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20cf4c5-4813-4bee-bfc2-c1f10a753827 admin admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:20.405723 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1189c2-3d2c-4318-a733-6e5561a9eb1e admin admin] RBAC: Authorizing `identity:create_grant(project_id=5a26d19ad5324a3e80a0da6bf54c361f, user_id=4f89ddcda7304b38ae33c6e5abb450be, role_id=0da46c267d354cce81495dfdd56c1ec2)` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:20.408458 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1189c2-3d2c-4318-a733-6e5561a9eb1e admin admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:20.426944 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 909/1806] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Jul 14 10:53:20 2022] PUT /identity/v3/projects/5a26d19ad5324a3e80a0da6bf54c361f/users/4f89ddcda7304b38ae33c6e5abb450be/roles/0da46c267d354cce81495dfdd56c1ec2 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:53:20.437879 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19cfb27-b84a-474c-a94a-b33af8eac3f8 None None] REQUEST_METHOD: `POST` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:20.437879 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19cfb27-b84a-474c-a94a-b33af8eac3f8 None None] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:20.438300 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19cfb27-b84a-474c-a94a-b33af8eac3f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:20.453575 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-b20cf4c5-4813-4bee-bfc2-c1f10a753827 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9c661b9c2c5d4349866ed82cefa1e717', 'request_id': 'req-b20cf4c5-4813-4bee-bfc2-c1f10a753827'} {{(pid=86656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:20.470210 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.auth.core [None req-f19cfb27-b84a-474c-a94a-b33af8eac3f8 None None] MFA Rules not processed for user `4f89ddcda7304b38ae33c6e5abb450be`. Rule list: `[]` (Enabled: `True`). {{(pid=86655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:53:20.470410 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-b20cf4c5-4813-4bee-bfc2-c1f10a753827 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9c661b9c2c5d4349866ed82cefa1e717', 'request_id': 'req-b20cf4c5-4813-4bee-bfc2-c1f10a753827'} {{(pid=86656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:20.471461 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-f19cfb27-b84a-474c-a94a-b33af8eac3f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:20.477692 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-b20cf4c5-4813-4bee-bfc2-c1f10a753827 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9c661b9c2c5d4349866ed82cefa1e717', 'request_id': 'req-b20cf4c5-4813-4bee-bfc2-c1f10a753827'} {{(pid=86656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:20.488534 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-b20cf4c5-4813-4bee-bfc2-c1f10a753827 admin admin] The token cache is being invalidate because project 9c661b9c2c5d4349866ed82cefa1e717 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86656) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 10:53:20.488876 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-b20cf4c5-4813-4bee-bfc2-c1f10a753827 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:20.489607 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-b20cf4c5-4813-4bee-bfc2-c1f10a753827 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:20.491456 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 898/1807] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Jul 14 10:53:20 2022] DELETE /identity/v3/projects/9c661b9c2c5d4349866ed82cefa1e717 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:53:20.495011 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20cf4c5-4813-4bee-bfc2-c1f10a753827 admin admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:20.496517 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-b20cf4c5-4813-4bee-bfc2-c1f10a753827 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:20.558146 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 910/1808] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jul 14 10:53:20 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:53:20.559935 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19cfb27-b84a-474c-a94a-b33af8eac3f8 None None] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:20.562724 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-f19cfb27-b84a-474c-a94a-b33af8eac3f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:20.587914 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20cf4c5-4813-4bee-bfc2-c1f10a753827 admin admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:20.593955 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e8e587-3763-4d76-80c6-4675f0b52049 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:20.594858 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e8e587-3763-4d76-80c6-4675f0b52049 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:20.595154 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e8e587-3763-4d76-80c6-4675f0b52049 admin admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:20.595426 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e8e587-3763-4d76-80c6-4675f0b52049 admin admin] PATH_INFO: `/v3/users/71c9d27cacc0467181655afc5a157d41` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:20.596673 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e8e587-3763-4d76-80c6-4675f0b52049 admin admin] RBAC: Authorizing `identity:delete_user(user_id=71c9d27cacc0467181655afc5a157d41)` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:20.598672 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e8e587-3763-4d76-80c6-4675f0b52049 admin admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:20.632873 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=86,keystone:INSERT=2,keystone:DELETE=12 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:53:20.641050 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19cfb27-b84a-474c-a94a-b33af8eac3f8 None None] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:20.649629 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574e871d-4cc4-4eae-8ac0-6a332a994254 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:20.650712 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574e871d-4cc4-4eae-8ac0-6a332a994254 admin admin] REQUEST_METHOD: `POST` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:20.651432 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574e871d-4cc4-4eae-8ac0-6a332a994254 admin admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:20.652177 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574e871d-4cc4-4eae-8ac0-6a332a994254 admin admin] PATH_INFO: `/v3/projects` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:20.653101 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574e871d-4cc4-4eae-8ac0-6a332a994254 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:20.656024 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574e871d-4cc4-4eae-8ac0-6a332a994254 admin admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:20.656429 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-76e8e587-3763-4d76-80c6-4675f0b52049 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '71c9d27cacc0467181655afc5a157d41'} {{(pid=86656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:20.677347 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-76e8e587-3763-4d76-80c6-4675f0b52049 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '71c9d27cacc0467181655afc5a157d41'} {{(pid=86656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:20.679589 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-76e8e587-3763-4d76-80c6-4675f0b52049 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '71c9d27cacc0467181655afc5a157d41'} {{(pid=86656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:20.697694 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 911/1809] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Jul 14 10:53:20 2022] POST /identity/v3/projects => generated 393 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:53:20.699276 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-76e8e587-3763-4d76-80c6-4675f0b52049 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '71c9d27cacc0467181655afc5a157d41'} {{(pid=86656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:20.699990 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-76e8e587-3763-4d76-80c6-4675f0b52049 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '71c9d27cacc0467181655afc5a157d41'} {{(pid=86656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:20.701578 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574e871d-4cc4-4eae-8ac0-6a332a994254 admin admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:20.704149 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-574e871d-4cc4-4eae-8ac0-6a332a994254 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:20.719244 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 899/1810] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Jul 14 10:53:20 2022] DELETE /identity/v3/users/71c9d27cacc0467181655afc5a157d41 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 10:53:20.780723 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:53:20.815819 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574e871d-4cc4-4eae-8ac0-6a332a994254 admin admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:20.900529 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5c72bd-1450-424d-9361-c27c47a2b365 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:20.901256 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5c72bd-1450-424d-9361-c27c47a2b365 admin admin] REQUEST_METHOD: `POST` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:20.901732 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5c72bd-1450-424d-9361-c27c47a2b365 admin admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:20.902055 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5c72bd-1450-424d-9361-c27c47a2b365 admin admin] PATH_INFO: `/v3/users` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:20.903087 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5c72bd-1450-424d-9361-c27c47a2b365 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:20.905570 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5c72bd-1450-424d-9361-c27c47a2b365 admin admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:20.946242 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 912/1811] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Jul 14 10:53:20 2022] POST /identity/v3/users => generated 303 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:53:20.953158 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e8e587-3763-4d76-80c6-4675f0b52049 admin admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:20.970113 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e8e587-3763-4d76-80c6-4675f0b52049 admin admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:20.978446 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3a59b5-8ac0-4242-8b19-175f693c603e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:20.979780 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3a59b5-8ac0-4242-8b19-175f693c603e admin admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:20.980225 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3a59b5-8ac0-4242-8b19-175f693c603e admin admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:20.980722 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3a59b5-8ac0-4242-8b19-175f693c603e admin admin] PATH_INFO: `/v3/roles` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:20.981656 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3a59b5-8ac0-4242-8b19-175f693c603e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:20.983387 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3a59b5-8ac0-4242-8b19-175f693c603e admin admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:20.995891 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 900/1812] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jul 14 10:53:20 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:53:20.999785 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5c72bd-1450-424d-9361-c27c47a2b365 admin admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:21.010633 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5c72bd-1450-424d-9361-c27c47a2b365 admin admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:21.016696 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0580ade-dc4d-4532-99b1-4e46fe231aa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:21.017744 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0580ade-dc4d-4532-99b1-4e46fe231aa6 admin admin] REQUEST_METHOD: `PUT` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:21.018167 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0580ade-dc4d-4532-99b1-4e46fe231aa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:21.018582 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0580ade-dc4d-4532-99b1-4e46fe231aa6 admin admin] PATH_INFO: `/v3/projects/0b97288b035f4eeea866a9e78509274d/users/fccc6d65fc1b414db5ece99218736c1a/roles/153539819e5542df99269d2913bbecfb` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:21.036338 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0580ade-dc4d-4532-99b1-4e46fe231aa6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0b97288b035f4eeea866a9e78509274d, user_id=fccc6d65fc1b414db5ece99218736c1a, role_id=153539819e5542df99269d2913bbecfb)` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:21.041967 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0580ade-dc4d-4532-99b1-4e46fe231aa6 admin admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:21.058653 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 913/1813] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Jul 14 10:53:20 2022] PUT /identity/v3/projects/0b97288b035f4eeea866a9e78509274d/users/fccc6d65fc1b414db5ece99218736c1a/roles/153539819e5542df99269d2913bbecfb => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:53:21.063224 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3a59b5-8ac0-4242-8b19-175f693c603e admin admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:21.076450 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3a59b5-8ac0-4242-8b19-175f693c603e admin admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:21.129411 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0580ade-dc4d-4532-99b1-4e46fe231aa6 admin admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:21.131852 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-b0580ade-dc4d-4532-99b1-4e46fe231aa6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:21.211685 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d047e6-2a24-47c6-b537-10ae55674541 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:21.213485 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d047e6-2a24-47c6-b537-10ae55674541 admin admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:21.216588 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d047e6-2a24-47c6-b537-10ae55674541 admin admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:21.217293 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d047e6-2a24-47c6-b537-10ae55674541 admin admin] PATH_INFO: `/v3/roles` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:21.219196 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d047e6-2a24-47c6-b537-10ae55674541 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:21.222875 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d047e6-2a24-47c6-b537-10ae55674541 admin admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:21.246514 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 901/1814] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jul 14 10:53:21 2022] GET /identity/v3/roles => generated 1420 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:53:21.252254 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d047e6-2a24-47c6-b537-10ae55674541 admin admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:21.266904 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d047e6-2a24-47c6-b537-10ae55674541 admin admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:21.273653 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b566412-4edf-44b9-a451-439b7f580803 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:21.274840 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b566412-4edf-44b9-a451-439b7f580803 admin admin] REQUEST_METHOD: `PUT` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:21.274993 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b566412-4edf-44b9-a451-439b7f580803 admin admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:21.275412 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b566412-4edf-44b9-a451-439b7f580803 admin admin] PATH_INFO: `/v3/projects/0b97288b035f4eeea866a9e78509274d/users/fccc6d65fc1b414db5ece99218736c1a/roles/153539819e5542df99269d2913bbecfb` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:21.277737 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b566412-4edf-44b9-a451-439b7f580803 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0b97288b035f4eeea866a9e78509274d, user_id=fccc6d65fc1b414db5ece99218736c1a, role_id=153539819e5542df99269d2913bbecfb)` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:21.278993 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0580ade-dc4d-4532-99b1-4e46fe231aa6 admin admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:21.281839 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b566412-4edf-44b9-a451-439b7f580803 admin admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:21.286279 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38932d72-d0d0-4442-8ff6-89d156ebcc42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:21.287463 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38932d72-d0d0-4442-8ff6-89d156ebcc42 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:21.287828 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38932d72-d0d0-4442-8ff6-89d156ebcc42 admin admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:21.288181 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38932d72-d0d0-4442-8ff6-89d156ebcc42 admin admin] PATH_INFO: `/v3/projects/6921f74179ea4910b6e7efa7702d1647` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:21.289676 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38932d72-d0d0-4442-8ff6-89d156ebcc42 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6921f74179ea4910b6e7efa7702d1647)` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:21.292015 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38932d72-d0d0-4442-8ff6-89d156ebcc42 admin admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:21.306408 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 902/1815] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Jul 14 10:53:21 2022] PUT /identity/v3/projects/0b97288b035f4eeea866a9e78509274d/users/fccc6d65fc1b414db5ece99218736c1a/roles/153539819e5542df99269d2913bbecfb => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:53:21.307299 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b566412-4edf-44b9-a451-439b7f580803 admin admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:21.309225 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-2b566412-4edf-44b9-a451-439b7f580803 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:21.366471 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-38932d72-d0d0-4442-8ff6-89d156ebcc42 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6921f74179ea4910b6e7efa7702d1647', 'request_id': 'req-38932d72-d0d0-4442-8ff6-89d156ebcc42'} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:21.373971 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-38932d72-d0d0-4442-8ff6-89d156ebcc42 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6921f74179ea4910b6e7efa7702d1647', 'request_id': 'req-38932d72-d0d0-4442-8ff6-89d156ebcc42'} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:21.378377 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:53:21.383700 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-38932d72-d0d0-4442-8ff6-89d156ebcc42 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6921f74179ea4910b6e7efa7702d1647', 'request_id': 'req-38932d72-d0d0-4442-8ff6-89d156ebcc42'} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:21.401324 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-38932d72-d0d0-4442-8ff6-89d156ebcc42 admin admin] The token cache is being invalidate because project 6921f74179ea4910b6e7efa7702d1647 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86655) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 10:53:21.401622 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-38932d72-d0d0-4442-8ff6-89d156ebcc42 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:21.405253 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-38932d72-d0d0-4442-8ff6-89d156ebcc42 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:21.407676 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 914/1816] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Jul 14 10:53:21 2022] DELETE /identity/v3/projects/6921f74179ea4910b6e7efa7702d1647 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 10:53:21.410280 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74a8b98-0ee1-4f1a-9817-1c4392193dbc None None] REQUEST_METHOD: `POST` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:21.410723 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74a8b98-0ee1-4f1a-9817-1c4392193dbc None None] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:21.412842 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74a8b98-0ee1-4f1a-9817-1c4392193dbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:21.415355 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b566412-4edf-44b9-a451-439b7f580803 admin admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:21.442154 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.auth.core [None req-d74a8b98-0ee1-4f1a-9817-1c4392193dbc None None] MFA Rules not processed for user `fccc6d65fc1b414db5ece99218736c1a`. Rule list: `[]` (Enabled: `True`). {{(pid=86655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:53:21.443683 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-d74a8b98-0ee1-4f1a-9817-1c4392193dbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:21.448430 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:53:21.495749 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19c0ffc-36a5-49d6-889d-6f1199b714d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:21.496679 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19c0ffc-36a5-49d6-889d-6f1199b714d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:21.496993 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19c0ffc-36a5-49d6-889d-6f1199b714d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:21.497285 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19c0ffc-36a5-49d6-889d-6f1199b714d8 admin admin] PATH_INFO: `/v3/users/111fe7332c4944ef966ebe308ea3cd9f` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:21.498623 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19c0ffc-36a5-49d6-889d-6f1199b714d8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=111fe7332c4944ef966ebe308ea3cd9f)` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:21.501385 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19c0ffc-36a5-49d6-889d-6f1199b714d8 admin admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:21.566447 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-b19c0ffc-36a5-49d6-889d-6f1199b714d8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '111fe7332c4944ef966ebe308ea3cd9f'} {{(pid=86656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:21.571656 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 915/1817] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jul 14 10:53:21 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:53:21.573613 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebb7d18-8756-4b93-9aa2-7ef9d913987e None None] REQUEST_METHOD: `POST` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:21.573981 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebb7d18-8756-4b93-9aa2-7ef9d913987e None None] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:21.574297 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebb7d18-8756-4b93-9aa2-7ef9d913987e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:21.582553 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-b19c0ffc-36a5-49d6-889d-6f1199b714d8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '111fe7332c4944ef966ebe308ea3cd9f'} {{(pid=86656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:21.583414 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-b19c0ffc-36a5-49d6-889d-6f1199b714d8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '111fe7332c4944ef966ebe308ea3cd9f'} {{(pid=86656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:21.598154 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.auth.core [None req-eebb7d18-8756-4b93-9aa2-7ef9d913987e None None] MFA Rules not processed for user `ae4bcdd8106d4bebbdcae96be33505bc`. Rule list: `[]` (Enabled: `True`). {{(pid=86655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:53:21.598347 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-b19c0ffc-36a5-49d6-889d-6f1199b714d8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '111fe7332c4944ef966ebe308ea3cd9f'} {{(pid=86656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:21.599497 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-b19c0ffc-36a5-49d6-889d-6f1199b714d8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '111fe7332c4944ef966ebe308ea3cd9f'} {{(pid=86656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:21.599602 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-eebb7d18-8756-4b93-9aa2-7ef9d913987e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:21.608882 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 916/1818] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jul 14 10:53:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:53:21.609701 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebb7d18-8756-4b93-9aa2-7ef9d913987e None None] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:21.611795 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-eebb7d18-8756-4b93-9aa2-7ef9d913987e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:21.627866 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 903/1819] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Jul 14 10:53:21 2022] DELETE /identity/v3/users/111fe7332c4944ef966ebe308ea3cd9f => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:53:21.632248 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35fb1aa-945b-466a-a615-6ff0d133abea None None] REQUEST_METHOD: `POST` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:21.632678 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35fb1aa-945b-466a-a615-6ff0d133abea None None] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:21.633103 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35fb1aa-945b-466a-a615-6ff0d133abea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:21.654980 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.auth.core [None req-a35fb1aa-945b-466a-a615-6ff0d133abea None None] MFA Rules not processed for user `ae4bcdd8106d4bebbdcae96be33505bc`. Rule list: `[]` (Enabled: `True`). {{(pid=86656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:53:21.656737 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-a35fb1aa-945b-466a-a615-6ff0d133abea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:21.689766 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebb7d18-8756-4b93-9aa2-7ef9d913987e None None] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:21.743808 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 904/1820] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jul 14 10:53:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:53:21.745648 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9660e84-dc74-4c86-b02e-c858c07a7d23 None None] REQUEST_METHOD: `POST` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:21.745942 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9660e84-dc74-4c86-b02e-c858c07a7d23 None None] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:21.746222 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9660e84-dc74-4c86-b02e-c858c07a7d23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:21.755746 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6777c0b1-d7d8-4b63-85fb-deaecafcd173 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68382432147a48c3b62271fd2a2eab04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59391272ecbe48b0aa736cb43807be1d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:21.756445 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6777c0b1-d7d8-4b63-85fb-deaecafcd173 service cinder] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:21.756731 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6777c0b1-d7d8-4b63-85fb-deaecafcd173 service cinder] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:21.757044 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6777c0b1-d7d8-4b63-85fb-deaecafcd173 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:21.758975 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-6777c0b1-d7d8-4b63-85fb-deaecafcd173 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:21.764667 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.auth.core [None req-f9660e84-dc74-4c86-b02e-c858c07a7d23 None None] MFA Rules not processed for user `ae4bcdd8106d4bebbdcae96be33505bc`. Rule list: `[]` (Enabled: `True`). {{(pid=86656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:53:21.765883 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-f9660e84-dc74-4c86-b02e-c858c07a7d23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:21.773489 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 905/1821] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jul 14 10:53:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:53:21.774258 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9660e84-dc74-4c86-b02e-c858c07a7d23 None None] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:21.789277 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9660e84-dc74-4c86-b02e-c858c07a7d23 None None] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:21.794825 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7f47b2-7f30-491f-8b53-cea460f8fec5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:21.795714 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7f47b2-7f30-491f-8b53-cea460f8fec5 admin admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:21.795916 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7f47b2-7f30-491f-8b53-cea460f8fec5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:21.796200 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7f47b2-7f30-491f-8b53-cea460f8fec5 admin admin] PATH_INFO: `/v3/domains` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:21.796968 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7f47b2-7f30-491f-8b53-cea460f8fec5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:53:21.797285 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7f47b2-7f30-491f-8b53-cea460f8fec5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:21.799110 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7f47b2-7f30-491f-8b53-cea460f8fec5 admin admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:21.808618 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=100 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:53:21.812807 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 906/1822] 10.222.0.16 () {58 vars in 1152 bytes} [Thu Jul 14 10:53:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:53:21.813647 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7f47b2-7f30-491f-8b53-cea460f8fec5 admin admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:21.815325 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-df7f47b2-7f30-491f-8b53-cea460f8fec5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:21.838438 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6777c0b1-d7d8-4b63-85fb-deaecafcd173 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:21.839932 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6777c0b1-d7d8-4b63-85fb-deaecafcd173 service cinder] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:21.846045 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:53:21.852873 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 917/1823] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jul 14 10:53:21 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 243 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:53:21.853560 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6777c0b1-d7d8-4b63-85fb-deaecafcd173 service cinder] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:21.865822 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6777c0b1-d7d8-4b63-85fb-deaecafcd173 service cinder] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:21.871882 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983fd63d-ecb6-4563-af5d-3c251badde2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:21.873286 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983fd63d-ecb6-4563-af5d-3c251badde2c admin admin] REQUEST_METHOD: `POST` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:21.873465 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983fd63d-ecb6-4563-af5d-3c251badde2c admin admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:21.873766 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983fd63d-ecb6-4563-af5d-3c251badde2c admin admin] PATH_INFO: `/v3/projects` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:21.874527 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983fd63d-ecb6-4563-af5d-3c251badde2c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:21.876474 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983fd63d-ecb6-4563-af5d-3c251badde2c admin admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:21.890739 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7f47b2-7f30-491f-8b53-cea460f8fec5 admin admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:21.895595 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82de50a1-4d4f-4de8-a0a0-1ae01c82ac24 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dddf93691844886982c91fea974385d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59391272ecbe48b0aa736cb43807be1d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:21.896354 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82de50a1-4d4f-4de8-a0a0-1ae01c82ac24 service neutron] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:21.896677 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82de50a1-4d4f-4de8-a0a0-1ae01c82ac24 service neutron] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:21.897055 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82de50a1-4d4f-4de8-a0a0-1ae01c82ac24 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:21.908972 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82de50a1-4d4f-4de8-a0a0-1ae01c82ac24 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:21.910679 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82de50a1-4d4f-4de8-a0a0-1ae01c82ac24 service neutron] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:21.915362 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 918/1824] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Jul 14 10:53:21 2022] POST /identity/v3/projects => generated 365 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:53:21.917252 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983fd63d-ecb6-4563-af5d-3c251badde2c admin admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:21.919910 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-983fd63d-ecb6-4563-af5d-3c251badde2c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:21.925565 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 907/1825] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jul 14 10:53:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:53:21.926371 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82de50a1-4d4f-4de8-a0a0-1ae01c82ac24 service neutron] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:21.937608 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82de50a1-4d4f-4de8-a0a0-1ae01c82ac24 service neutron] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:22.008388 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983fd63d-ecb6-4563-af5d-3c251badde2c admin admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:22.012595 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0859708-58bc-4f71-b955-aeab5f4cc009 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68382432147a48c3b62271fd2a2eab04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59391272ecbe48b0aa736cb43807be1d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:22.013275 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0859708-58bc-4f71-b955-aeab5f4cc009 service cinder] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:22.013626 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0859708-58bc-4f71-b955-aeab5f4cc009 service cinder] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:22.014117 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0859708-58bc-4f71-b955-aeab5f4cc009 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:22.016020 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-a0859708-58bc-4f71-b955-aeab5f4cc009 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:22.018813 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cd86f9-5072-4888-ba3b-57b7f22dc08a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:22.019615 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cd86f9-5072-4888-ba3b-57b7f22dc08a admin admin] REQUEST_METHOD: `POST` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:22.019991 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cd86f9-5072-4888-ba3b-57b7f22dc08a admin admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:22.020314 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cd86f9-5072-4888-ba3b-57b7f22dc08a admin admin] PATH_INFO: `/v3/users` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:22.021087 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09cd86f9-5072-4888-ba3b-57b7f22dc08a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:22.023061 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09cd86f9-5072-4888-ba3b-57b7f22dc08a admin admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:22.052904 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 908/1826] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Jul 14 10:53:21 2022] POST /identity/v3/users => generated 283 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:53:22.054854 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cd86f9-5072-4888-ba3b-57b7f22dc08a admin admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:22.074536 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cd86f9-5072-4888-ba3b-57b7f22dc08a admin admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:22.084303 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18f0787-dd6b-4cfe-b687-98ae0c34b1aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:22.085048 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18f0787-dd6b-4cfe-b687-98ae0c34b1aa admin admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:22.085509 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18f0787-dd6b-4cfe-b687-98ae0c34b1aa admin admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:22.085936 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18f0787-dd6b-4cfe-b687-98ae0c34b1aa admin admin] PATH_INFO: `/v3/roles` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:22.088116 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18f0787-dd6b-4cfe-b687-98ae0c34b1aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:22.089814 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18f0787-dd6b-4cfe-b687-98ae0c34b1aa admin admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:22.106766 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 909/1827] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jul 14 10:53:22 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:53:22.109111 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18f0787-dd6b-4cfe-b687-98ae0c34b1aa admin admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:22.110544 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0859708-58bc-4f71-b955-aeab5f4cc009 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:22.112313 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0859708-58bc-4f71-b955-aeab5f4cc009 service cinder] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:22.123790 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18f0787-dd6b-4cfe-b687-98ae0c34b1aa admin admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:22.125190 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 919/1828] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jul 14 10:53:21 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:53:22.130918 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03619a6d-9d2d-4c7d-9c53-699591508212 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:22.132240 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03619a6d-9d2d-4c7d-9c53-699591508212 admin admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:22.132240 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03619a6d-9d2d-4c7d-9c53-699591508212 admin admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:22.132428 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03619a6d-9d2d-4c7d-9c53-699591508212 admin admin] PATH_INFO: `/v3/roles` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:22.133040 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03619a6d-9d2d-4c7d-9c53-699591508212 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:22.135054 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03619a6d-9d2d-4c7d-9c53-699591508212 admin admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:22.149227 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 910/1829] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jul 14 10:53:22 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 10:53:22.155383 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0859708-58bc-4f71-b955-aeab5f4cc009 service cinder] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:22.168241 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0859708-58bc-4f71-b955-aeab5f4cc009 service cinder] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:22.175219 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4532f8a-533d-4a47-b4df-bd8009fa99ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:22.176288 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4532f8a-533d-4a47-b4df-bd8009fa99ef admin admin] REQUEST_METHOD: `PUT` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:22.176579 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4532f8a-533d-4a47-b4df-bd8009fa99ef admin admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:22.177217 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4532f8a-533d-4a47-b4df-bd8009fa99ef admin admin] PATH_INFO: `/v3/projects/7f97f27e4863462cba1ca1792e865315/users/7a9a3eed9c2e4e03b955758a5a7b4ecb/roles/0da46c267d354cce81495dfdd56c1ec2` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:22.194779 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4532f8a-533d-4a47-b4df-bd8009fa99ef admin admin] RBAC: Authorizing `identity:create_grant(project_id=7f97f27e4863462cba1ca1792e865315, user_id=7a9a3eed9c2e4e03b955758a5a7b4ecb, role_id=0da46c267d354cce81495dfdd56c1ec2)` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:22.197505 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4532f8a-533d-4a47-b4df-bd8009fa99ef admin admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:22.214446 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 920/1830] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Jul 14 10:53:22 2022] PUT /identity/v3/projects/7f97f27e4863462cba1ca1792e865315/users/7a9a3eed9c2e4e03b955758a5a7b4ecb/roles/0da46c267d354cce81495dfdd56c1ec2 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:53:22.225209 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2b0f9a-3443-4bc1-84b9-2cacade380b9 None None] REQUEST_METHOD: `POST` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:22.225209 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2b0f9a-3443-4bc1-84b9-2cacade380b9 None None] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:22.225209 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2b0f9a-3443-4bc1-84b9-2cacade380b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:22.257455 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4532f8a-533d-4a47-b4df-bd8009fa99ef admin admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:22.258936 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.auth.core [None req-ca2b0f9a-3443-4bc1-84b9-2cacade380b9 None None] MFA Rules not processed for user `7a9a3eed9c2e4e03b955758a5a7b4ecb`. Rule list: `[]` (Enabled: `True`). {{(pid=86656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:53:22.260528 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-ca2b0f9a-3443-4bc1-84b9-2cacade380b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:22.261191 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-b4532f8a-533d-4a47-b4df-bd8009fa99ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:22.348624 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:53:22.364604 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 911/1831] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jul 14 10:53:22 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:53:22.369195 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2b0f9a-3443-4bc1-84b9-2cacade380b9 None None] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:22.383664 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2b0f9a-3443-4bc1-84b9-2cacade380b9 None None] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:22.388910 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61b7066-960e-4e12-a3f8-abb9319cfe75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:22.389527 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61b7066-960e-4e12-a3f8-abb9319cfe75 admin admin] REQUEST_METHOD: `POST` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:22.389787 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61b7066-960e-4e12-a3f8-abb9319cfe75 admin admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:22.390068 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61b7066-960e-4e12-a3f8-abb9319cfe75 admin admin] PATH_INFO: `/v3/projects` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:22.390775 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61b7066-960e-4e12-a3f8-abb9319cfe75 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:22.392739 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61b7066-960e-4e12-a3f8-abb9319cfe75 admin admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:22.401258 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4532f8a-533d-4a47-b4df-bd8009fa99ef admin admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:22.411846 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e5278d-bf43-4e6a-b164-e2743973637a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:22.413383 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e5278d-bf43-4e6a-b164-e2743973637a admin admin] REQUEST_METHOD: `DELETE` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:22.413677 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e5278d-bf43-4e6a-b164-e2743973637a admin admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:22.413962 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e5278d-bf43-4e6a-b164-e2743973637a admin admin] PATH_INFO: `/v3/projects/2c4afd9a8b1e437f91a5c8db8680034f` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:22.415892 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e5278d-bf43-4e6a-b164-e2743973637a admin admin] RBAC: Authorizing `identity:delete_project(project_id=2c4afd9a8b1e437f91a5c8db8680034f)` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:22.417944 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e5278d-bf43-4e6a-b164-e2743973637a admin admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:22.437505 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 912/1832] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Jul 14 10:53:22 2022] POST /identity/v3/projects => generated 363 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 10:53:22.441579 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61b7066-960e-4e12-a3f8-abb9319cfe75 admin admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:22.450188 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:53:22.507479 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-72e5278d-bf43-4e6a-b164-e2743973637a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2c4afd9a8b1e437f91a5c8db8680034f', 'request_id': 'req-72e5278d-bf43-4e6a-b164-e2743973637a'} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:22.527807 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-72e5278d-bf43-4e6a-b164-e2743973637a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2c4afd9a8b1e437f91a5c8db8680034f', 'request_id': 'req-72e5278d-bf43-4e6a-b164-e2743973637a'} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:22.542162 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-72e5278d-bf43-4e6a-b164-e2743973637a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2c4afd9a8b1e437f91a5c8db8680034f', 'request_id': 'req-72e5278d-bf43-4e6a-b164-e2743973637a'} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:22.569414 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-72e5278d-bf43-4e6a-b164-e2743973637a admin admin] The token cache is being invalidate because project 2c4afd9a8b1e437f91a5c8db8680034f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86655) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 10:53:22.570252 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-72e5278d-bf43-4e6a-b164-e2743973637a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:22.574417 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-72e5278d-bf43-4e6a-b164-e2743973637a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:22.576497 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 921/1833] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Jul 14 10:53:22 2022] DELETE /identity/v3/projects/2c4afd9a8b1e437f91a5c8db8680034f => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 10:53:22.583238 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e5278d-bf43-4e6a-b164-e2743973637a admin admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:22.585431 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-72e5278d-bf43-4e6a-b164-e2743973637a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:22.597610 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61b7066-960e-4e12-a3f8-abb9319cfe75 admin admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:22.682501 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e5278d-bf43-4e6a-b164-e2743973637a admin admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:22.695358 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5280f41b-0310-4328-9bcb-4132c02b6606 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:22.699402 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5280f41b-0310-4328-9bcb-4132c02b6606 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:22.700437 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5280f41b-0310-4328-9bcb-4132c02b6606 admin admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:22.702380 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5280f41b-0310-4328-9bcb-4132c02b6606 admin admin] PATH_INFO: `/v3/users/6d8e3a5cdc2245df8e1cfca04b6121c0` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:22.704988 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5280f41b-0310-4328-9bcb-4132c02b6606 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6d8e3a5cdc2245df8e1cfca04b6121c0)` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:22.712124 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5280f41b-0310-4328-9bcb-4132c02b6606 admin admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:22.714278 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59001a67-453b-40f8-a66b-eff84a972ac9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:22.715129 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59001a67-453b-40f8-a66b-eff84a972ac9 admin admin] REQUEST_METHOD: `POST` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:22.715685 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59001a67-453b-40f8-a66b-eff84a972ac9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:22.716149 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59001a67-453b-40f8-a66b-eff84a972ac9 admin admin] PATH_INFO: `/v3/users` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:22.721373 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59001a67-453b-40f8-a66b-eff84a972ac9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:22.724381 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59001a67-453b-40f8-a66b-eff84a972ac9 admin admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:22.759561 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 913/1834] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Jul 14 10:53:22 2022] POST /identity/v3/users => generated 288 bytes in 316 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 10:53:22.760992 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59001a67-453b-40f8-a66b-eff84a972ac9 admin admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:22.763273 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-59001a67-453b-40f8-a66b-eff84a972ac9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:22.778180 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59001a67-453b-40f8-a66b-eff84a972ac9 admin admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:22.792029 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd25ad26-98c4-4280-8c21-2f0b281cda7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:22.793054 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd25ad26-98c4-4280-8c21-2f0b281cda7c admin admin] REQUEST_METHOD: `DELETE` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:22.793438 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd25ad26-98c4-4280-8c21-2f0b281cda7c admin admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:22.797227 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd25ad26-98c4-4280-8c21-2f0b281cda7c admin admin] PATH_INFO: `/v3/users/dac36048e10f46598a93fe8a4225fe7c` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:22.799324 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd25ad26-98c4-4280-8c21-2f0b281cda7c admin admin] RBAC: Authorizing `identity:delete_user(user_id=dac36048e10f46598a93fe8a4225fe7c)` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:22.802088 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-5280f41b-0310-4328-9bcb-4132c02b6606 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6d8e3a5cdc2245df8e1cfca04b6121c0'} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:22.802439 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd25ad26-98c4-4280-8c21-2f0b281cda7c admin admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:22.814758 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-5280f41b-0310-4328-9bcb-4132c02b6606 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6d8e3a5cdc2245df8e1cfca04b6121c0'} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:22.815545 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-5280f41b-0310-4328-9bcb-4132c02b6606 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6d8e3a5cdc2245df8e1cfca04b6121c0'} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:22.840309 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-5280f41b-0310-4328-9bcb-4132c02b6606 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6d8e3a5cdc2245df8e1cfca04b6121c0'} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:22.841217 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-5280f41b-0310-4328-9bcb-4132c02b6606 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6d8e3a5cdc2245df8e1cfca04b6121c0'} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:22.854186 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:53:22.865101 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 922/1835] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Jul 14 10:53:22 2022] DELETE /identity/v3/users/6d8e3a5cdc2245df8e1cfca04b6121c0 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 10:53:22.870502 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5280f41b-0310-4328-9bcb-4132c02b6606 admin admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:22.872321 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-5280f41b-0310-4328-9bcb-4132c02b6606 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:22.876994 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-fd25ad26-98c4-4280-8c21-2f0b281cda7c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dac36048e10f46598a93fe8a4225fe7c'} {{(pid=86656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:22.889421 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-fd25ad26-98c4-4280-8c21-2f0b281cda7c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dac36048e10f46598a93fe8a4225fe7c'} {{(pid=86656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:22.890280 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-fd25ad26-98c4-4280-8c21-2f0b281cda7c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dac36048e10f46598a93fe8a4225fe7c'} {{(pid=86656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:22.901896 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-fd25ad26-98c4-4280-8c21-2f0b281cda7c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dac36048e10f46598a93fe8a4225fe7c'} {{(pid=86656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:22.903040 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-fd25ad26-98c4-4280-8c21-2f0b281cda7c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dac36048e10f46598a93fe8a4225fe7c'} {{(pid=86656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:22.941516 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 914/1836] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Jul 14 10:53:22 2022] DELETE /identity/v3/users/dac36048e10f46598a93fe8a4225fe7c => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:53:22.947149 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3259ba-e8d0-4d72-956f-8abb55a93dd7 None None] REQUEST_METHOD: `POST` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:22.948148 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3259ba-e8d0-4d72-956f-8abb55a93dd7 None None] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:22.949138 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3259ba-e8d0-4d72-956f-8abb55a93dd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:22.974895 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.auth.core [None req-ba3259ba-e8d0-4d72-956f-8abb55a93dd7 None None] MFA Rules not processed for user `ae4bcdd8106d4bebbdcae96be33505bc`. Rule list: `[]` (Enabled: `True`). {{(pid=86656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:53:22.976343 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-ba3259ba-e8d0-4d72-956f-8abb55a93dd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:22.979213 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5280f41b-0310-4328-9bcb-4132c02b6606 admin admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:22.984649 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:53:23.073145 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 915/1837] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jul 14 10:53:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:53:23.080964 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3259ba-e8d0-4d72-956f-8abb55a93dd7 None None] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:23.082150 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2484cc9f-a600-4c5b-83a8-5375cca2375d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:23.082712 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-ba3259ba-e8d0-4d72-956f-8abb55a93dd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:23.083084 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2484cc9f-a600-4c5b-83a8-5375cca2375d admin admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:23.083440 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2484cc9f-a600-4c5b-83a8-5375cca2375d admin admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:23.083824 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2484cc9f-a600-4c5b-83a8-5375cca2375d admin admin] PATH_INFO: `/v3/roles` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:23.084681 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2484cc9f-a600-4c5b-83a8-5375cca2375d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:23.086472 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2484cc9f-a600-4c5b-83a8-5375cca2375d admin admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:23.100878 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 923/1838] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jul 14 10:53:22 2022] GET /identity/v3/roles => generated 1420 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:53:23.104915 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2484cc9f-a600-4c5b-83a8-5375cca2375d admin admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:23.108602 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-2484cc9f-a600-4c5b-83a8-5375cca2375d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:23.125397 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2484cc9f-a600-4c5b-83a8-5375cca2375d admin admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:23.132003 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f1667f-7f6d-45d0-a449-40352dc0643d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:23.133984 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f1667f-7f6d-45d0-a449-40352dc0643d admin admin] REQUEST_METHOD: `PUT` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:23.134277 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f1667f-7f6d-45d0-a449-40352dc0643d admin admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:23.134562 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f1667f-7f6d-45d0-a449-40352dc0643d admin admin] PATH_INFO: `/v3/projects/a5807ba4901249a9baf9a4ffba173244/users/c127470dd85545eeb9f9dbb4afd4ce3c/roles/153539819e5542df99269d2913bbecfb` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:23.157091 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f1667f-7f6d-45d0-a449-40352dc0643d admin admin] RBAC: Authorizing `identity:create_grant(project_id=a5807ba4901249a9baf9a4ffba173244, user_id=c127470dd85545eeb9f9dbb4afd4ce3c, role_id=153539819e5542df99269d2913bbecfb)` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:23.159773 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f1667f-7f6d-45d0-a449-40352dc0643d admin admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:23.165010 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3259ba-e8d0-4d72-956f-8abb55a93dd7 None None] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:23.170964 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8349fe74-ea93-4f46-b81e-b263a1220116 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dddf93691844886982c91fea974385d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59391272ecbe48b0aa736cb43807be1d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:23.171848 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8349fe74-ea93-4f46-b81e-b263a1220116 service neutron] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:23.172426 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8349fe74-ea93-4f46-b81e-b263a1220116 service neutron] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:23.172584 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8349fe74-ea93-4f46-b81e-b263a1220116 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:23.180257 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 924/1839] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Jul 14 10:53:23 2022] PUT /identity/v3/projects/a5807ba4901249a9baf9a4ffba173244/users/c127470dd85545eeb9f9dbb4afd4ce3c/roles/153539819e5542df99269d2913bbecfb => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:53:23.186024 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f1667f-7f6d-45d0-a449-40352dc0643d admin admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:23.194609 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8349fe74-ea93-4f46-b81e-b263a1220116 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:23.196405 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8349fe74-ea93-4f46-b81e-b263a1220116 service neutron] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:23.213859 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 916/1840] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jul 14 10:53:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 10:53:23.215628 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8349fe74-ea93-4f46-b81e-b263a1220116 service neutron] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:23.217340 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-8349fe74-ea93-4f46-b81e-b263a1220116 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:23.234012 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8349fe74-ea93-4f46-b81e-b263a1220116 service neutron] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:23.280691 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f1667f-7f6d-45d0-a449-40352dc0643d admin admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:23.287355 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f243649-95f5-48d9-8b3b-724848ff8a8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:23.288085 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f243649-95f5-48d9-8b3b-724848ff8a8a admin admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:23.288395 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f243649-95f5-48d9-8b3b-724848ff8a8a admin admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:23.288809 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f243649-95f5-48d9-8b3b-724848ff8a8a admin admin] PATH_INFO: `/v3/roles` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:23.289521 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f243649-95f5-48d9-8b3b-724848ff8a8a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:23.291298 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f243649-95f5-48d9-8b3b-724848ff8a8a admin admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:23.303420 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 925/1841] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jul 14 10:53:23 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:53:23.307276 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f243649-95f5-48d9-8b3b-724848ff8a8a admin admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:23.317748 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f243649-95f5-48d9-8b3b-724848ff8a8a admin admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:23.319527 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c861672c-8169-4baa-962c-c1494755b293 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:23.320487 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c861672c-8169-4baa-962c-c1494755b293 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:23.320810 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c861672c-8169-4baa-962c-c1494755b293 admin admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:23.321083 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c861672c-8169-4baa-962c-c1494755b293 admin admin] PATH_INFO: `/v3/projects/4136ff042f9044dc9b8c5e25e4c8eb01` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:23.322478 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c861672c-8169-4baa-962c-c1494755b293 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4136ff042f9044dc9b8c5e25e4c8eb01)` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:23.323318 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08add893-4758-46e1-858c-a6507610a566 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:23.324599 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08add893-4758-46e1-858c-a6507610a566 admin admin] REQUEST_METHOD: `PUT` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:23.324722 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c861672c-8169-4baa-962c-c1494755b293 admin admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:23.324820 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08add893-4758-46e1-858c-a6507610a566 admin admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:23.324913 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08add893-4758-46e1-858c-a6507610a566 admin admin] PATH_INFO: `/v3/projects/a5807ba4901249a9baf9a4ffba173244/users/c127470dd85545eeb9f9dbb4afd4ce3c/roles/153539819e5542df99269d2913bbecfb` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:23.328307 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08add893-4758-46e1-858c-a6507610a566 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a5807ba4901249a9baf9a4ffba173244, user_id=c127470dd85545eeb9f9dbb4afd4ce3c, role_id=153539819e5542df99269d2913bbecfb)` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:23.331128 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08add893-4758-46e1-858c-a6507610a566 admin admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:23.334704 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:DELETE=1,keystone:SELECT=97,keystone:INSERT=2 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:53:23.353013 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 926/1842] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Jul 14 10:53:23 2022] PUT /identity/v3/projects/a5807ba4901249a9baf9a4ffba173244/users/c127470dd85545eeb9f9dbb4afd4ce3c/roles/153539819e5542df99269d2913bbecfb => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 10:53:23.354513 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4ee85a-de13-4b6c-8b6e-db4295af7d08 None None] REQUEST_METHOD: `POST` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:23.354886 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4ee85a-de13-4b6c-8b6e-db4295af7d08 None None] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:23.355238 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4ee85a-de13-4b6c-8b6e-db4295af7d08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:23.386889 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.auth.core [None req-bd4ee85a-de13-4b6c-8b6e-db4295af7d08 None None] MFA Rules not processed for user `c127470dd85545eeb9f9dbb4afd4ce3c`. Rule list: `[]` (Enabled: `True`). {{(pid=86655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:53:23.388080 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-bd4ee85a-de13-4b6c-8b6e-db4295af7d08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:23.391358 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-c861672c-8169-4baa-962c-c1494755b293 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4136ff042f9044dc9b8c5e25e4c8eb01', 'request_id': 'req-c861672c-8169-4baa-962c-c1494755b293'} {{(pid=86656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:23.402033 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-c861672c-8169-4baa-962c-c1494755b293 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4136ff042f9044dc9b8c5e25e4c8eb01', 'request_id': 'req-c861672c-8169-4baa-962c-c1494755b293'} {{(pid=86656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:23.404306 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:53:23.414803 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-c861672c-8169-4baa-962c-c1494755b293 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4136ff042f9044dc9b8c5e25e4c8eb01', 'request_id': 'req-c861672c-8169-4baa-962c-c1494755b293'} {{(pid=86656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:23.428515 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-c861672c-8169-4baa-962c-c1494755b293 admin admin] The token cache is being invalidate because project 4136ff042f9044dc9b8c5e25e4c8eb01 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86656) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 10:53:23.428933 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-c861672c-8169-4baa-962c-c1494755b293 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:23.429710 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-c861672c-8169-4baa-962c-c1494755b293 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:23.431686 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 917/1843] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Jul 14 10:53:23 2022] DELETE /identity/v3/projects/4136ff042f9044dc9b8c5e25e4c8eb01 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:53:23.437192 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c861672c-8169-4baa-962c-c1494755b293 admin admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:23.438590 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-c861672c-8169-4baa-962c-c1494755b293 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:23.474436 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 927/1844] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jul 14 10:53:23 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:53:23.485758 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4ee85a-de13-4b6c-8b6e-db4295af7d08 None None] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:23.487318 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-bd4ee85a-de13-4b6c-8b6e-db4295af7d08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:23.515041 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c861672c-8169-4baa-962c-c1494755b293 admin admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:23.520748 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3894ec7a-8b73-4c16-93ab-3d73df384c1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:23.521752 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3894ec7a-8b73-4c16-93ab-3d73df384c1f admin admin] REQUEST_METHOD: `DELETE` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:23.522046 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3894ec7a-8b73-4c16-93ab-3d73df384c1f admin admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:23.522427 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3894ec7a-8b73-4c16-93ab-3d73df384c1f admin admin] PATH_INFO: `/v3/users/efa2cc07d5c44ab697be10e098b4874e` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:23.523882 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3894ec7a-8b73-4c16-93ab-3d73df384c1f admin admin] RBAC: Authorizing `identity:delete_user(user_id=efa2cc07d5c44ab697be10e098b4874e)` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:23.526988 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3894ec7a-8b73-4c16-93ab-3d73df384c1f admin admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:23.551714 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4ee85a-de13-4b6c-8b6e-db4295af7d08 None None] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:23.556525 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9211037-fe71-4ce5-8d60-afff351847b9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68382432147a48c3b62271fd2a2eab04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59391272ecbe48b0aa736cb43807be1d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:23.557477 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9211037-fe71-4ce5-8d60-afff351847b9 service cinder] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:23.557781 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9211037-fe71-4ce5-8d60-afff351847b9 service cinder] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:23.558073 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9211037-fe71-4ce5-8d60-afff351847b9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:23.569410 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9211037-fe71-4ce5-8d60-afff351847b9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:23.570883 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9211037-fe71-4ce5-8d60-afff351847b9 service cinder] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:23.581505 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 928/1845] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jul 14 10:53:23 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 10:53:23.582468 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9211037-fe71-4ce5-8d60-afff351847b9 service cinder] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:23.583989 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-d9211037-fe71-4ce5-8d60-afff351847b9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:23.590380 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-3894ec7a-8b73-4c16-93ab-3d73df384c1f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'efa2cc07d5c44ab697be10e098b4874e'} {{(pid=86656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:23.602317 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-3894ec7a-8b73-4c16-93ab-3d73df384c1f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'efa2cc07d5c44ab697be10e098b4874e'} {{(pid=86656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:23.603304 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-3894ec7a-8b73-4c16-93ab-3d73df384c1f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'efa2cc07d5c44ab697be10e098b4874e'} {{(pid=86656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:23.604532 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9211037-fe71-4ce5-8d60-afff351847b9 service cinder] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:23.614106 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07649f55-65ba-41cb-90a0-621ae76d980b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:23.615730 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07649f55-65ba-41cb-90a0-621ae76d980b admin admin] REQUEST_METHOD: `DELETE` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:23.616328 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07649f55-65ba-41cb-90a0-621ae76d980b admin admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:23.616863 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07649f55-65ba-41cb-90a0-621ae76d980b admin admin] PATH_INFO: `/v3/projects/c7dba31575ec4e0dbd90067d4ff53c7f` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:23.617334 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-3894ec7a-8b73-4c16-93ab-3d73df384c1f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'efa2cc07d5c44ab697be10e098b4874e'} {{(pid=86656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:23.618337 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-3894ec7a-8b73-4c16-93ab-3d73df384c1f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'efa2cc07d5c44ab697be10e098b4874e'} {{(pid=86656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:23.619083 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07649f55-65ba-41cb-90a0-621ae76d980b admin admin] RBAC: Authorizing `identity:delete_project(project_id=c7dba31575ec4e0dbd90067d4ff53c7f)` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:23.625031 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07649f55-65ba-41cb-90a0-621ae76d980b admin admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:23.640925 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 918/1846] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Jul 14 10:53:23 2022] DELETE /identity/v3/users/efa2cc07d5c44ab697be10e098b4874e => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:53:23.667279 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3894ec7a-8b73-4c16-93ab-3d73df384c1f admin admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:23.669076 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-3894ec7a-8b73-4c16-93ab-3d73df384c1f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:23.735228 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-07649f55-65ba-41cb-90a0-621ae76d980b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c7dba31575ec4e0dbd90067d4ff53c7f', 'request_id': 'req-07649f55-65ba-41cb-90a0-621ae76d980b'} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:23.742651 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-07649f55-65ba-41cb-90a0-621ae76d980b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c7dba31575ec4e0dbd90067d4ff53c7f', 'request_id': 'req-07649f55-65ba-41cb-90a0-621ae76d980b'} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:23.756418 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-07649f55-65ba-41cb-90a0-621ae76d980b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c7dba31575ec4e0dbd90067d4ff53c7f', 'request_id': 'req-07649f55-65ba-41cb-90a0-621ae76d980b'} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:23.773445 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-07649f55-65ba-41cb-90a0-621ae76d980b admin admin] The token cache is being invalidate because project c7dba31575ec4e0dbd90067d4ff53c7f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86655) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 10:53:23.774090 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-07649f55-65ba-41cb-90a0-621ae76d980b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:23.774844 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-07649f55-65ba-41cb-90a0-621ae76d980b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:23.780433 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 929/1847] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Jul 14 10:53:23 2022] DELETE /identity/v3/projects/c7dba31575ec4e0dbd90067d4ff53c7f => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:53:23.786547 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f489df84-edb0-4ef2-b2d5-f049d3f6c4fe None None] REQUEST_METHOD: `POST` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:23.786855 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f489df84-edb0-4ef2-b2d5-f049d3f6c4fe None None] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:23.787136 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f489df84-edb0-4ef2-b2d5-f049d3f6c4fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:23.802894 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3894ec7a-8b73-4c16-93ab-3d73df384c1f admin admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:23.828626 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:53:23.830525 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:53:23.874540 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.auth.core [None req-f489df84-edb0-4ef2-b2d5-f049d3f6c4fe None None] MFA Rules not processed for user `ae4bcdd8106d4bebbdcae96be33505bc`. Rule list: `[]` (Enabled: `True`). {{(pid=86655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:53:23.876167 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-f489df84-edb0-4ef2-b2d5-f049d3f6c4fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:23.931918 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257bb78d-7ace-4224-b82c-7d9857b79936 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68382432147a48c3b62271fd2a2eab04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59391272ecbe48b0aa736cb43807be1d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:23.932637 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257bb78d-7ace-4224-b82c-7d9857b79936 service cinder] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:23.935381 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257bb78d-7ace-4224-b82c-7d9857b79936 service cinder] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:23.935821 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257bb78d-7ace-4224-b82c-7d9857b79936 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:23.939668 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-257bb78d-7ace-4224-b82c-7d9857b79936 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:24.011741 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 930/1848] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jul 14 10:53:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:53:24.022443 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be6ee4e-c9dc-474d-907c-49a07a4af8e6 None None] REQUEST_METHOD: `POST` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:24.023244 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be6ee4e-c9dc-474d-907c-49a07a4af8e6 None None] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:24.023665 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be6ee4e-c9dc-474d-907c-49a07a4af8e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:24.040586 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257bb78d-7ace-4224-b82c-7d9857b79936 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:24.043983 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257bb78d-7ace-4224-b82c-7d9857b79936 service cinder] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:24.066289 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.auth.core [None req-4be6ee4e-c9dc-474d-907c-49a07a4af8e6 None None] MFA Rules not processed for user `ae4bcdd8106d4bebbdcae96be33505bc`. Rule list: `[]` (Enabled: `True`). {{(pid=86655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:53:24.067148 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-4be6ee4e-c9dc-474d-907c-49a07a4af8e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:24.068398 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 919/1849] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jul 14 10:53:23 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:53:24.090431 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 931/1850] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jul 14 10:53:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:53:24.090852 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257bb78d-7ace-4224-b82c-7d9857b79936 service cinder] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:24.111741 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257bb78d-7ace-4224-b82c-7d9857b79936 service cinder] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:24.118483 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05551272-3537-4b5d-9ae7-c3d6515c30e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:24.120572 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05551272-3537-4b5d-9ae7-c3d6515c30e7 admin admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:24.120572 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05551272-3537-4b5d-9ae7-c3d6515c30e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:24.121258 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05551272-3537-4b5d-9ae7-c3d6515c30e7 admin admin] PATH_INFO: `/v3/domains` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:24.122444 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05551272-3537-4b5d-9ae7-c3d6515c30e7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:53:24.124125 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05551272-3537-4b5d-9ae7-c3d6515c30e7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:24.129404 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05551272-3537-4b5d-9ae7-c3d6515c30e7 admin admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:24.158472 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 920/1851] 10.222.0.16 () {58 vars in 1152 bytes} [Thu Jul 14 10:53:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:53:24.165098 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be6ee4e-c9dc-474d-907c-49a07a4af8e6 None None] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:24.180682 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be6ee4e-c9dc-474d-907c-49a07a4af8e6 None None] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:24.199323 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1cfec4-9b4b-4b64-9a59-39703f56ac0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:24.203835 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1cfec4-9b4b-4b64-9a59-39703f56ac0f admin admin] REQUEST_METHOD: `POST` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:24.204402 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1cfec4-9b4b-4b64-9a59-39703f56ac0f admin admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:24.204705 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1cfec4-9b4b-4b64-9a59-39703f56ac0f admin admin] PATH_INFO: `/v3/projects` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:24.208678 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1cfec4-9b4b-4b64-9a59-39703f56ac0f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:24.211211 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1cfec4-9b4b-4b64-9a59-39703f56ac0f admin admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:24.232249 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05551272-3537-4b5d-9ae7-c3d6515c30e7 admin admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:24.236647 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-05551272-3537-4b5d-9ae7-c3d6515c30e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:24.266002 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 932/1852] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Jul 14 10:53:24 2022] POST /identity/v3/projects => generated 383 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:53:24.272350 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1cfec4-9b4b-4b64-9a59-39703f56ac0f admin admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:24.294479 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05551272-3537-4b5d-9ae7-c3d6515c30e7 admin admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:24.404881 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1cfec4-9b4b-4b64-9a59-39703f56ac0f admin admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:24.418308 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4307a481-402a-4064-ba47-58a8e86c19ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:24.419293 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4307a481-402a-4064-ba47-58a8e86c19ab admin admin] REQUEST_METHOD: `POST` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:24.419719 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4307a481-402a-4064-ba47-58a8e86c19ab admin admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:24.421274 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4307a481-402a-4064-ba47-58a8e86c19ab admin admin] PATH_INFO: `/v3/users` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:24.422014 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4307a481-402a-4064-ba47-58a8e86c19ab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:24.424494 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4307a481-402a-4064-ba47-58a8e86c19ab admin admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:24.437686 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e1b65f-87c9-4f35-b5ab-d531be1b12fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:24.439189 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e1b65f-87c9-4f35-b5ab-d531be1b12fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:24.439800 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e1b65f-87c9-4f35-b5ab-d531be1b12fc admin admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:24.440665 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e1b65f-87c9-4f35-b5ab-d531be1b12fc admin admin] PATH_INFO: `/v3/projects/d2f835d6065944d19f572f2b0c739bd0` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:24.442105 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e1b65f-87c9-4f35-b5ab-d531be1b12fc admin admin] RBAC: Authorizing `identity:delete_project(project_id=d2f835d6065944d19f572f2b0c739bd0)` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:24.444967 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e1b65f-87c9-4f35-b5ab-d531be1b12fc admin admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:24.453580 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 933/1853] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Jul 14 10:53:24 2022] POST /identity/v3/users => generated 292 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 10:53:24.458850 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4307a481-402a-4064-ba47-58a8e86c19ab admin admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:24.478803 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4307a481-402a-4064-ba47-58a8e86c19ab admin admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:24.495975 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901f1dc3-555f-4716-867f-de7ad9c88caa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:24.496889 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901f1dc3-555f-4716-867f-de7ad9c88caa admin admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:24.497444 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901f1dc3-555f-4716-867f-de7ad9c88caa admin admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:24.499551 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901f1dc3-555f-4716-867f-de7ad9c88caa admin admin] PATH_INFO: `/v3/roles` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:24.500534 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901f1dc3-555f-4716-867f-de7ad9c88caa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:24.503707 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901f1dc3-555f-4716-867f-de7ad9c88caa admin admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:24.527976 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 934/1854] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jul 14 10:53:24 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 10:53:24.529870 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901f1dc3-555f-4716-867f-de7ad9c88caa admin admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:24.530019 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-16e1b65f-87c9-4f35-b5ab-d531be1b12fc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd2f835d6065944d19f572f2b0c739bd0', 'request_id': 'req-16e1b65f-87c9-4f35-b5ab-d531be1b12fc'} {{(pid=86656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:24.541762 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-16e1b65f-87c9-4f35-b5ab-d531be1b12fc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd2f835d6065944d19f572f2b0c739bd0', 'request_id': 'req-16e1b65f-87c9-4f35-b5ab-d531be1b12fc'} {{(pid=86656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:24.542383 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901f1dc3-555f-4716-867f-de7ad9c88caa admin admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:24.553033 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-16e1b65f-87c9-4f35-b5ab-d531be1b12fc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd2f835d6065944d19f572f2b0c739bd0', 'request_id': 'req-16e1b65f-87c9-4f35-b5ab-d531be1b12fc'} {{(pid=86656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:24.555425 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:53:24.571616 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-16e1b65f-87c9-4f35-b5ab-d531be1b12fc admin admin] The token cache is being invalidate because project d2f835d6065944d19f572f2b0c739bd0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86656) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 10:53:24.573155 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-16e1b65f-87c9-4f35-b5ab-d531be1b12fc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:24.574145 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-16e1b65f-87c9-4f35-b5ab-d531be1b12fc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:24.576949 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 921/1855] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Jul 14 10:53:24 2022] DELETE /identity/v3/projects/d2f835d6065944d19f572f2b0c739bd0 => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:53:24.583667 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e0e38e-8d9d-4596-af23-7789efbdaf45 None None] REQUEST_METHOD: `POST` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:24.583954 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e0e38e-8d9d-4596-af23-7789efbdaf45 None None] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:24.584240 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e0e38e-8d9d-4596-af23-7789efbdaf45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:24.619866 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.auth.core [None req-69e0e38e-8d9d-4596-af23-7789efbdaf45 None None] MFA Rules not processed for user `ae4bcdd8106d4bebbdcae96be33505bc`. Rule list: `[]` (Enabled: `True`). {{(pid=86656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:53:24.621218 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-69e0e38e-8d9d-4596-af23-7789efbdaf45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:24.646421 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:53:24.655892 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ffbbc9-38ca-4325-aea3-77b46363a334 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:24.656474 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ffbbc9-38ca-4325-aea3-77b46363a334 admin admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:24.657214 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ffbbc9-38ca-4325-aea3-77b46363a334 admin admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:24.657513 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ffbbc9-38ca-4325-aea3-77b46363a334 admin admin] PATH_INFO: `/v3/roles` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:24.658336 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ffbbc9-38ca-4325-aea3-77b46363a334 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:24.660424 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ffbbc9-38ca-4325-aea3-77b46363a334 admin admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:24.673175 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 935/1856] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jul 14 10:53:24 2022] GET /identity/v3/roles => generated 1420 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:53:24.682424 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ffbbc9-38ca-4325-aea3-77b46363a334 admin admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:24.687482 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-c6ffbbc9-38ca-4325-aea3-77b46363a334 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:24.704568 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ffbbc9-38ca-4325-aea3-77b46363a334 admin admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:24.720957 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 922/1857] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jul 14 10:53:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 10:53:24.721361 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2183d8-fd2f-4829-867d-9abb0ff3f695 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:24.722183 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2183d8-fd2f-4829-867d-9abb0ff3f695 admin admin] REQUEST_METHOD: `PUT` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:24.722473 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2183d8-fd2f-4829-867d-9abb0ff3f695 admin admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:24.723283 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2183d8-fd2f-4829-867d-9abb0ff3f695 admin admin] PATH_INFO: `/v3/projects/2d9c51fa45224c2e913824764093edf7/users/83a0879cfa5848d0b1faafd6eb3e4333/roles/0da46c267d354cce81495dfdd56c1ec2` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:24.725979 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6390167-dac6-4d87-853f-5e43256d4621 None None] REQUEST_METHOD: `POST` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:24.727342 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6390167-dac6-4d87-853f-5e43256d4621 None None] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:24.728103 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6390167-dac6-4d87-853f-5e43256d4621 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:24.749503 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2183d8-fd2f-4829-867d-9abb0ff3f695 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2d9c51fa45224c2e913824764093edf7, user_id=83a0879cfa5848d0b1faafd6eb3e4333, role_id=0da46c267d354cce81495dfdd56c1ec2)` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:24.750910 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.auth.core [None req-f6390167-dac6-4d87-853f-5e43256d4621 None None] MFA Rules not processed for user `ae4bcdd8106d4bebbdcae96be33505bc`. Rule list: `[]` (Enabled: `True`). {{(pid=86656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:53:24.752136 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-f6390167-dac6-4d87-853f-5e43256d4621 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:24.760758 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2183d8-fd2f-4829-867d-9abb0ff3f695 admin admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:24.765184 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 923/1858] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jul 14 10:53:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:53:24.767572 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6390167-dac6-4d87-853f-5e43256d4621 None None] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:24.779655 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6390167-dac6-4d87-853f-5e43256d4621 None None] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:24.784315 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 936/1859] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Jul 14 10:53:24 2022] PUT /identity/v3/projects/2d9c51fa45224c2e913824764093edf7/users/83a0879cfa5848d0b1faafd6eb3e4333/roles/0da46c267d354cce81495dfdd56c1ec2 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:53:24.796822 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875d2e45-b240-4fb5-9630-b91d5971d5fe None None] REQUEST_METHOD: `POST` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:24.796822 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875d2e45-b240-4fb5-9630-b91d5971d5fe None None] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:24.796822 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875d2e45-b240-4fb5-9630-b91d5971d5fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:24.839574 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.auth.core [None req-875d2e45-b240-4fb5-9630-b91d5971d5fe None None] MFA Rules not processed for user `83a0879cfa5848d0b1faafd6eb3e4333`. Rule list: `[]` (Enabled: `True`). {{(pid=86655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:53:24.841218 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-875d2e45-b240-4fb5-9630-b91d5971d5fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:24.873448 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e393ea5c-b46d-4672-bf46-e6fc2b596cb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:24.874191 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e393ea5c-b46d-4672-bf46-e6fc2b596cb8 admin admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:24.874473 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e393ea5c-b46d-4672-bf46-e6fc2b596cb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:24.874750 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e393ea5c-b46d-4672-bf46-e6fc2b596cb8 admin admin] PATH_INFO: `/v3/domains` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:24.875621 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e393ea5c-b46d-4672-bf46-e6fc2b596cb8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:53:24.876268 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e393ea5c-b46d-4672-bf46-e6fc2b596cb8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:24.878184 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e393ea5c-b46d-4672-bf46-e6fc2b596cb8 admin admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:24.892087 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 924/1860] 10.222.0.16 () {58 vars in 1152 bytes} [Thu Jul 14 10:53:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:53:24.897039 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e393ea5c-b46d-4672-bf46-e6fc2b596cb8 admin admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:24.909950 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e393ea5c-b46d-4672-bf46-e6fc2b596cb8 admin admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:24.917434 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63a8d78-2079-4420-affb-4a4fb3581462 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:24.918623 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63a8d78-2079-4420-affb-4a4fb3581462 admin admin] REQUEST_METHOD: `POST` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:24.918778 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63a8d78-2079-4420-affb-4a4fb3581462 admin admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:24.919374 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63a8d78-2079-4420-affb-4a4fb3581462 admin admin] PATH_INFO: `/v3/projects` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:24.920646 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63a8d78-2079-4420-affb-4a4fb3581462 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:24.922947 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63a8d78-2079-4420-affb-4a4fb3581462 admin admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:24.938205 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 937/1861] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jul 14 10:53:24 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:53:24.942438 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875d2e45-b240-4fb5-9630-b91d5971d5fe None None] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:24.965926 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 925/1862] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Jul 14 10:53:24 2022] POST /identity/v3/projects => generated 407 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:53:24.970192 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875d2e45-b240-4fb5-9630-b91d5971d5fe None None] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:24.971172 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63a8d78-2079-4420-affb-4a4fb3581462 admin admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:25.081162 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=98,keystone:DELETE=1,keystone:INSERT=1 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:53:25.086820 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63a8d78-2079-4420-affb-4a4fb3581462 admin admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:25.091813 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0c97fa-53bf-4e90-860a-da88b38532c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:25.092518 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0c97fa-53bf-4e90-860a-da88b38532c6 admin admin] REQUEST_METHOD: `POST` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:25.092851 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0c97fa-53bf-4e90-860a-da88b38532c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:25.093137 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0c97fa-53bf-4e90-860a-da88b38532c6 admin admin] PATH_INFO: `/v3/projects` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:25.094153 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0c97fa-53bf-4e90-860a-da88b38532c6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:25.094339 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42eb86f3-b465-4908-92e3-d629d846f2fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:25.095076 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42eb86f3-b465-4908-92e3-d629d846f2fb admin admin] REQUEST_METHOD: `POST` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:25.095695 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42eb86f3-b465-4908-92e3-d629d846f2fb admin admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:25.096089 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0c97fa-53bf-4e90-860a-da88b38532c6 admin admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:25.096385 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42eb86f3-b465-4908-92e3-d629d846f2fb admin admin] PATH_INFO: `/v3/users` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:25.098765 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42eb86f3-b465-4908-92e3-d629d846f2fb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:25.101363 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42eb86f3-b465-4908-92e3-d629d846f2fb admin admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:25.136596 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 926/1863] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Jul 14 10:53:24 2022] POST /identity/v3/users => generated 304 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 10:53:25.139196 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 938/1864] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Jul 14 10:53:24 2022] POST /identity/v3/projects => generated 381 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 10:53:25.148947 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0c97fa-53bf-4e90-860a-da88b38532c6 admin admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:25.149056 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42eb86f3-b465-4908-92e3-d629d846f2fb admin admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:25.161048 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42eb86f3-b465-4908-92e3-d629d846f2fb admin admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:25.198896 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:53:25.220106 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0c97fa-53bf-4e90-860a-da88b38532c6 admin admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:25.225822 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bea260b-4b2b-49e8-8e83-16dcbb0a1c04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:25.226589 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bea260b-4b2b-49e8-8e83-16dcbb0a1c04 admin admin] REQUEST_METHOD: `POST` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:25.226785 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bea260b-4b2b-49e8-8e83-16dcbb0a1c04 admin admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:25.227057 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bea260b-4b2b-49e8-8e83-16dcbb0a1c04 admin admin] PATH_INFO: `/v3/users` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:25.227758 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bea260b-4b2b-49e8-8e83-16dcbb0a1c04 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:25.229976 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bea260b-4b2b-49e8-8e83-16dcbb0a1c04 admin admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:25.245899 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fca9ed-7913-499d-b519-968a2ce0c18f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:25.247071 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fca9ed-7913-499d-b519-968a2ce0c18f admin admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:25.247522 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fca9ed-7913-499d-b519-968a2ce0c18f admin admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:25.247995 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fca9ed-7913-499d-b519-968a2ce0c18f admin admin] PATH_INFO: `/v3/roles` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:25.248886 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19fca9ed-7913-499d-b519-968a2ce0c18f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:25.250702 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19fca9ed-7913-499d-b519-968a2ce0c18f admin admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:25.262801 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 927/1865] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jul 14 10:53:25 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:53:25.265537 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 939/1866] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Jul 14 10:53:25 2022] POST /identity/v3/users => generated 297 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:53:25.267517 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fca9ed-7913-499d-b519-968a2ce0c18f admin admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:25.270826 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bea260b-4b2b-49e8-8e83-16dcbb0a1c04 admin admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:25.279646 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fca9ed-7913-499d-b519-968a2ce0c18f admin admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:25.283933 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bea260b-4b2b-49e8-8e83-16dcbb0a1c04 admin admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:25.288032 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3391bbe3-32d4-441a-a50b-bfd0a9f120a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:25.288721 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3391bbe3-32d4-441a-a50b-bfd0a9f120a5 admin admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:25.289052 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3391bbe3-32d4-441a-a50b-bfd0a9f120a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:25.289331 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3391bbe3-32d4-441a-a50b-bfd0a9f120a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:25.290098 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3391bbe3-32d4-441a-a50b-bfd0a9f120a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:25.290204 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499bb14a-49a1-4523-8115-49c528439076 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:25.291208 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499bb14a-49a1-4523-8115-49c528439076 admin admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:25.291541 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499bb14a-49a1-4523-8115-49c528439076 admin admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:25.291688 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3391bbe3-32d4-441a-a50b-bfd0a9f120a5 admin admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:25.291810 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499bb14a-49a1-4523-8115-49c528439076 admin admin] PATH_INFO: `/v3/roles` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:25.292619 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499bb14a-49a1-4523-8115-49c528439076 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:25.294602 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499bb14a-49a1-4523-8115-49c528439076 admin admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:25.303649 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 928/1867] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jul 14 10:53:25 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:53:25.307507 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 940/1868] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jul 14 10:53:25 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:53:25.308727 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3391bbe3-32d4-441a-a50b-bfd0a9f120a5 admin admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:25.312678 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499bb14a-49a1-4523-8115-49c528439076 admin admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:25.321325 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3391bbe3-32d4-441a-a50b-bfd0a9f120a5 admin admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:25.327224 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499bb14a-49a1-4523-8115-49c528439076 admin admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:25.328541 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5db8b60-a435-4dc5-a2e4-7398b0d6a7eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:25.329491 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5db8b60-a435-4dc5-a2e4-7398b0d6a7eb admin admin] REQUEST_METHOD: `PUT` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:25.329794 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5db8b60-a435-4dc5-a2e4-7398b0d6a7eb admin admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:25.330122 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5db8b60-a435-4dc5-a2e4-7398b0d6a7eb admin admin] PATH_INFO: `/v3/projects/24c3d6f578174d40a62243569dcaaeca/users/558f2e6979fc4d79955b98d50d6fedf0/roles/0da46c267d354cce81495dfdd56c1ec2` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:25.334100 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13629a61-4731-4cab-b3af-87d415cd332c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:25.335235 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13629a61-4731-4cab-b3af-87d415cd332c admin admin] REQUEST_METHOD: `PUT` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:25.335538 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13629a61-4731-4cab-b3af-87d415cd332c admin admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:25.337054 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13629a61-4731-4cab-b3af-87d415cd332c admin admin] PATH_INFO: `/v3/projects/d0a7fc85322347b385a27bef18286b81/users/cfcbe336526d480e94498493a5c18d13/roles/153539819e5542df99269d2913bbecfb` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:25.347078 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5db8b60-a435-4dc5-a2e4-7398b0d6a7eb admin admin] RBAC: Authorizing `identity:create_grant(project_id=24c3d6f578174d40a62243569dcaaeca, user_id=558f2e6979fc4d79955b98d50d6fedf0, role_id=0da46c267d354cce81495dfdd56c1ec2)` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:25.350068 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5db8b60-a435-4dc5-a2e4-7398b0d6a7eb admin admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:25.360521 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13629a61-4731-4cab-b3af-87d415cd332c admin admin] RBAC: Authorizing `identity:create_grant(project_id=d0a7fc85322347b385a27bef18286b81, user_id=cfcbe336526d480e94498493a5c18d13, role_id=153539819e5542df99269d2913bbecfb)` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:25.364130 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13629a61-4731-4cab-b3af-87d415cd332c admin admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:25.379235 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 941/1869] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Jul 14 10:53:25 2022] PUT /identity/v3/projects/d0a7fc85322347b385a27bef18286b81/users/cfcbe336526d480e94498493a5c18d13/roles/153539819e5542df99269d2913bbecfb => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:53:25.383495 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13629a61-4731-4cab-b3af-87d415cd332c admin admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:25.385427 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 929/1870] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Jul 14 10:53:25 2022] PUT /identity/v3/projects/24c3d6f578174d40a62243569dcaaeca/users/558f2e6979fc4d79955b98d50d6fedf0/roles/0da46c267d354cce81495dfdd56c1ec2 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:53:25.406426 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f42049-c783-4c9a-95c0-6733ba964838 None None] REQUEST_METHOD: `POST` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:25.406973 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f42049-c783-4c9a-95c0-6733ba964838 None None] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:25.407217 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f42049-c783-4c9a-95c0-6733ba964838 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:25.443083 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.auth.core [None req-49f42049-c783-4c9a-95c0-6733ba964838 None None] MFA Rules not processed for user `558f2e6979fc4d79955b98d50d6fedf0`. Rule list: `[]` (Enabled: `True`). {{(pid=86656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:53:25.444730 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-49f42049-c783-4c9a-95c0-6733ba964838 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:25.469533 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13629a61-4731-4cab-b3af-87d415cd332c admin admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:25.474710 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e911d5d-9eeb-4790-b20e-abd3baead754 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:25.475537 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e911d5d-9eeb-4790-b20e-abd3baead754 admin admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:25.475820 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e911d5d-9eeb-4790-b20e-abd3baead754 admin admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:25.476208 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e911d5d-9eeb-4790-b20e-abd3baead754 admin admin] PATH_INFO: `/v3/roles` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:25.476861 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e911d5d-9eeb-4790-b20e-abd3baead754 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:25.478574 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e911d5d-9eeb-4790-b20e-abd3baead754 admin admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:25.492296 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 942/1871] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jul 14 10:53:25 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:53:25.496166 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e911d5d-9eeb-4790-b20e-abd3baead754 admin admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:25.506599 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e911d5d-9eeb-4790-b20e-abd3baead754 admin admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:25.511596 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11573fce-5fca-4dd6-8eac-832d31d3d0e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:25.512484 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11573fce-5fca-4dd6-8eac-832d31d3d0e7 admin admin] REQUEST_METHOD: `PUT` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:25.512786 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11573fce-5fca-4dd6-8eac-832d31d3d0e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:25.513069 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11573fce-5fca-4dd6-8eac-832d31d3d0e7 admin admin] PATH_INFO: `/v3/projects/d0a7fc85322347b385a27bef18286b81/users/cfcbe336526d480e94498493a5c18d13/roles/153539819e5542df99269d2913bbecfb` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:25.515662 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11573fce-5fca-4dd6-8eac-832d31d3d0e7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d0a7fc85322347b385a27bef18286b81, user_id=cfcbe336526d480e94498493a5c18d13, role_id=153539819e5542df99269d2913bbecfb)` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:25.519163 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 930/1872] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jul 14 10:53:25 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:53:25.525063 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f42049-c783-4c9a-95c0-6733ba964838 None None] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:25.527115 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11573fce-5fca-4dd6-8eac-832d31d3d0e7 admin admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:25.537441 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f42049-c783-4c9a-95c0-6733ba964838 None None] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:25.548919 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 943/1873] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Jul 14 10:53:25 2022] PUT /identity/v3/projects/d0a7fc85322347b385a27bef18286b81/users/cfcbe336526d480e94498493a5c18d13/roles/153539819e5542df99269d2913bbecfb => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 10:53:25.555309 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cede0b9-e95b-474d-b025-826ab224a3f2 None None] REQUEST_METHOD: `POST` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:25.555715 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cede0b9-e95b-474d-b025-826ab224a3f2 None None] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:25.556099 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cede0b9-e95b-474d-b025-826ab224a3f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:25.589593 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:53:25.593399 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.auth.core [None req-2cede0b9-e95b-474d-b025-826ab224a3f2 None None] MFA Rules not processed for user `cfcbe336526d480e94498493a5c18d13`. Rule list: `[]` (Enabled: `True`). {{(pid=86655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:53:25.595117 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-2cede0b9-e95b-474d-b025-826ab224a3f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:25.630012 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115d6556-ed38-45bc-9c74-1edc1ace8ade admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:25.631015 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115d6556-ed38-45bc-9c74-1edc1ace8ade admin admin] REQUEST_METHOD: `POST` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:25.631452 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115d6556-ed38-45bc-9c74-1edc1ace8ade admin admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:25.631858 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115d6556-ed38-45bc-9c74-1edc1ace8ade admin admin] PATH_INFO: `/v3/projects` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:25.632732 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115d6556-ed38-45bc-9c74-1edc1ace8ade admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:25.634931 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115d6556-ed38-45bc-9c74-1edc1ace8ade admin admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:25.679930 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 931/1874] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Jul 14 10:53:25 2022] POST /identity/v3/projects => generated 409 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 10:53:25.683954 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115d6556-ed38-45bc-9c74-1edc1ace8ade admin admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:25.693075 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 944/1875] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jul 14 10:53:25 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 10:53:25.722569 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cede0b9-e95b-474d-b025-826ab224a3f2 None None] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:25.724066 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-2cede0b9-e95b-474d-b025-826ab224a3f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:25.734369 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:53:25.759063 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115d6556-ed38-45bc-9c74-1edc1ace8ade admin admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:25.766336 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c974d795-33fa-428d-b11e-6191b10ce11b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:25.767025 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c974d795-33fa-428d-b11e-6191b10ce11b admin admin] REQUEST_METHOD: `POST` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:25.767313 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c974d795-33fa-428d-b11e-6191b10ce11b admin admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:25.767591 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c974d795-33fa-428d-b11e-6191b10ce11b admin admin] PATH_INFO: `/v3/users` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:25.768353 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c974d795-33fa-428d-b11e-6191b10ce11b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:25.770678 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c974d795-33fa-428d-b11e-6191b10ce11b admin admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:25.792596 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cede0b9-e95b-474d-b025-826ab224a3f2 None None] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:25.797066 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 932/1876] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Jul 14 10:53:25 2022] POST /identity/v3/users => generated 311 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 10:53:25.801650 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c974d795-33fa-428d-b11e-6191b10ce11b admin admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:25.815990 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c974d795-33fa-428d-b11e-6191b10ce11b admin admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:25.824454 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c7ed79-a742-408f-8f05-3ea88c129397 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:25.825115 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c7ed79-a742-408f-8f05-3ea88c129397 admin admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:25.825384 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c7ed79-a742-408f-8f05-3ea88c129397 admin admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:25.825717 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c7ed79-a742-408f-8f05-3ea88c129397 admin admin] PATH_INFO: `/v3/roles` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:25.826776 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c7ed79-a742-408f-8f05-3ea88c129397 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:25.828391 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c7ed79-a742-408f-8f05-3ea88c129397 admin admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:25.848932 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 933/1877] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jul 14 10:53:25 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:53:25.850074 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c7ed79-a742-408f-8f05-3ea88c129397 admin admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:25.860198 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58680d80-a011-4cc0-b8d6-2dd6df4a9ee9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68382432147a48c3b62271fd2a2eab04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59391272ecbe48b0aa736cb43807be1d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:25.860918 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58680d80-a011-4cc0-b8d6-2dd6df4a9ee9 service cinder] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:25.861354 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58680d80-a011-4cc0-b8d6-2dd6df4a9ee9 service cinder] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:25.861675 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58680d80-a011-4cc0-b8d6-2dd6df4a9ee9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:25.862226 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c7ed79-a742-408f-8f05-3ea88c129397 admin admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:25.867544 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e8a977-4191-4169-852f-7c889df07542 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:25.868457 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e8a977-4191-4169-852f-7c889df07542 admin admin] REQUEST_METHOD: `PUT` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:25.868746 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e8a977-4191-4169-852f-7c889df07542 admin admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:25.869050 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e8a977-4191-4169-852f-7c889df07542 admin admin] PATH_INFO: `/v3/projects/454f3487d08e45b8be123ee8b6cd7127/users/9af1e4f780b044afa682d10f986104ef/roles/153539819e5542df99269d2913bbecfb` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:25.889200 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e8a977-4191-4169-852f-7c889df07542 admin admin] RBAC: Authorizing `identity:create_grant(project_id=454f3487d08e45b8be123ee8b6cd7127, user_id=9af1e4f780b044afa682d10f986104ef, role_id=153539819e5542df99269d2913bbecfb)` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:25.895006 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e8a977-4191-4169-852f-7c889df07542 admin admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:25.912890 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 934/1878] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Jul 14 10:53:25 2022] PUT /identity/v3/projects/454f3487d08e45b8be123ee8b6cd7127/users/9af1e4f780b044afa682d10f986104ef/roles/153539819e5542df99269d2913bbecfb => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:53:25.928014 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e8a977-4191-4169-852f-7c889df07542 admin admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:25.960169 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58680d80-a011-4cc0-b8d6-2dd6df4a9ee9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:25.962229 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58680d80-a011-4cc0-b8d6-2dd6df4a9ee9 service cinder] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:25.985022 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 945/1879] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jul 14 10:53:25 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 263 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:53:26.020172 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e8a977-4191-4169-852f-7c889df07542 admin admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:26.028763 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba1bf97-70e6-4da7-bf9b-0eb829a9df45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:26.038830 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba1bf97-70e6-4da7-bf9b-0eb829a9df45 admin admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:26.039377 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba1bf97-70e6-4da7-bf9b-0eb829a9df45 admin admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:26.041267 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba1bf97-70e6-4da7-bf9b-0eb829a9df45 admin admin] PATH_INFO: `/v3/roles` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:26.042813 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba1bf97-70e6-4da7-bf9b-0eb829a9df45 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:26.047104 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba1bf97-70e6-4da7-bf9b-0eb829a9df45 admin admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:26.074795 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 935/1880] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jul 14 10:53:25 2022] GET /identity/v3/roles => generated 1420 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:53:26.077397 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58680d80-a011-4cc0-b8d6-2dd6df4a9ee9 service cinder] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:26.095068 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58680d80-a011-4cc0-b8d6-2dd6df4a9ee9 service cinder] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:26.111110 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d05f0f4-cd74-47be-973a-454a76ea4c47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:26.112341 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d05f0f4-cd74-47be-973a-454a76ea4c47 admin admin] REQUEST_METHOD: `PUT` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:26.113027 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d05f0f4-cd74-47be-973a-454a76ea4c47 admin admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:26.113316 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d05f0f4-cd74-47be-973a-454a76ea4c47 admin admin] PATH_INFO: `/v3/projects/454f3487d08e45b8be123ee8b6cd7127/users/9af1e4f780b044afa682d10f986104ef/roles/153539819e5542df99269d2913bbecfb` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:26.116345 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d05f0f4-cd74-47be-973a-454a76ea4c47 admin admin] RBAC: Authorizing `identity:create_grant(project_id=454f3487d08e45b8be123ee8b6cd7127, user_id=9af1e4f780b044afa682d10f986104ef, role_id=153539819e5542df99269d2913bbecfb)` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:26.123924 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d05f0f4-cd74-47be-973a-454a76ea4c47 admin admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:26.139395 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba1bf97-70e6-4da7-bf9b-0eb829a9df45 admin admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:26.141385 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-3ba1bf97-70e6-4da7-bf9b-0eb829a9df45 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:26.144748 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 946/1881] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Jul 14 10:53:26 2022] PUT /identity/v3/projects/454f3487d08e45b8be123ee8b6cd7127/users/9af1e4f780b044afa682d10f986104ef/roles/153539819e5542df99269d2913bbecfb => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:53:26.156081 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ef78a6-52ea-4fa6-b467-1cd555b65fbe None None] REQUEST_METHOD: `POST` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:26.156413 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ef78a6-52ea-4fa6-b467-1cd555b65fbe None None] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:26.156703 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ef78a6-52ea-4fa6-b467-1cd555b65fbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:26.159858 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:53:26.206651 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.auth.core [None req-47ef78a6-52ea-4fa6-b467-1cd555b65fbe None None] MFA Rules not processed for user `9af1e4f780b044afa682d10f986104ef`. Rule list: `[]` (Enabled: `True`). {{(pid=86655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:53:26.207890 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-47ef78a6-52ea-4fa6-b467-1cd555b65fbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:26.289034 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba1bf97-70e6-4da7-bf9b-0eb829a9df45 admin admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:26.299103 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:53:26.339434 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 947/1882] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jul 14 10:53:26 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 10:53:26.374054 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800b107c-b26c-4a06-8fc9-bccb6cacf213 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68382432147a48c3b62271fd2a2eab04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59391272ecbe48b0aa736cb43807be1d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:26.375420 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800b107c-b26c-4a06-8fc9-bccb6cacf213 service cinder] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:26.375709 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800b107c-b26c-4a06-8fc9-bccb6cacf213 service cinder] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:26.376068 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800b107c-b26c-4a06-8fc9-bccb6cacf213 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:26.439055 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800b107c-b26c-4a06-8fc9-bccb6cacf213 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:26.440420 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800b107c-b26c-4a06-8fc9-bccb6cacf213 service cinder] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:26.460933 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 936/1883] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jul 14 10:53:26 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 10:53:26.475797 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ef78a6-52ea-4fa6-b467-1cd555b65fbe None None] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:26.477775 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-47ef78a6-52ea-4fa6-b467-1cd555b65fbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:26.589158 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ef78a6-52ea-4fa6-b467-1cd555b65fbe None None] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:26.604700 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5fe053-3374-48a0-b090-03d020bfa01b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:26.605875 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5fe053-3374-48a0-b090-03d020bfa01b admin admin] REQUEST_METHOD: `DELETE` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:26.606169 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5fe053-3374-48a0-b090-03d020bfa01b admin admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:26.606611 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5fe053-3374-48a0-b090-03d020bfa01b admin admin] PATH_INFO: `/v3/users/4f89ddcda7304b38ae33c6e5abb450be` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:26.609472 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5fe053-3374-48a0-b090-03d020bfa01b admin admin] RBAC: Authorizing `identity:delete_user(user_id=4f89ddcda7304b38ae33c6e5abb450be)` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:26.611536 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5fe053-3374-48a0-b090-03d020bfa01b admin admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:26.662776 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800b107c-b26c-4a06-8fc9-bccb6cacf213 service cinder] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:26.682720 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-4f5fe053-3374-48a0-b090-03d020bfa01b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4f89ddcda7304b38ae33c6e5abb450be'} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:26.694391 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-4f5fe053-3374-48a0-b090-03d020bfa01b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4f89ddcda7304b38ae33c6e5abb450be'} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:26.695147 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-4f5fe053-3374-48a0-b090-03d020bfa01b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4f89ddcda7304b38ae33c6e5abb450be'} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:26.704307 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800b107c-b26c-4a06-8fc9-bccb6cacf213 service cinder] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:26.707464 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-4f5fe053-3374-48a0-b090-03d020bfa01b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4f89ddcda7304b38ae33c6e5abb450be'} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:26.708411 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-4f5fe053-3374-48a0-b090-03d020bfa01b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4f89ddcda7304b38ae33c6e5abb450be'} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:26.710718 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2eaaf9a-70fd-40b6-b7e3-66ac48d78e05 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68382432147a48c3b62271fd2a2eab04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59391272ecbe48b0aa736cb43807be1d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:26.711691 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2eaaf9a-70fd-40b6-b7e3-66ac48d78e05 service cinder] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:26.712538 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2eaaf9a-70fd-40b6-b7e3-66ac48d78e05 service cinder] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:26.713286 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2eaaf9a-70fd-40b6-b7e3-66ac48d78e05 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:26.716744 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-c2eaaf9a-70fd-40b6-b7e3-66ac48d78e05 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:26.733705 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2eaaf9a-70fd-40b6-b7e3-66ac48d78e05 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:26.735172 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2eaaf9a-70fd-40b6-b7e3-66ac48d78e05 service cinder] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:26.737115 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 948/1884] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Jul 14 10:53:26 2022] DELETE /identity/v3/users/4f89ddcda7304b38ae33c6e5abb450be => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:53:26.741587 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cb0fa0-b069-40a0-a30d-ee5b04a7b0ba None None] REQUEST_METHOD: `POST` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:26.741890 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cb0fa0-b069-40a0-a30d-ee5b04a7b0ba None None] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:26.742245 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cb0fa0-b069-40a0-a30d-ee5b04a7b0ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:26.757116 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 937/1885] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jul 14 10:53:26 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:53:26.782195 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.auth.core [None req-85cb0fa0-b069-40a0-a30d-ee5b04a7b0ba None None] MFA Rules not processed for user `ae4bcdd8106d4bebbdcae96be33505bc`. Rule list: `[]` (Enabled: `True`). {{(pid=86655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:53:26.782857 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-85cb0fa0-b069-40a0-a30d-ee5b04a7b0ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:26.893959 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 949/1886] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jul 14 10:53:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 10:53:26.899380 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2eaaf9a-70fd-40b6-b7e3-66ac48d78e05 service cinder] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:26.903177 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-c2eaaf9a-70fd-40b6-b7e3-66ac48d78e05 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:27.052722 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2eaaf9a-70fd-40b6-b7e3-66ac48d78e05 service cinder] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:27.087087 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=100 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:53:27.132449 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3bdced-d4c2-46f6-8b85-5912c2b5749c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dddf93691844886982c91fea974385d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59391272ecbe48b0aa736cb43807be1d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:27.132449 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3bdced-d4c2-46f6-8b85-5912c2b5749c service neutron] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:27.132449 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3bdced-d4c2-46f6-8b85-5912c2b5749c service neutron] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:27.132449 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3bdced-d4c2-46f6-8b85-5912c2b5749c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:27.146092 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3bdced-d4c2-46f6-8b85-5912c2b5749c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:27.151575 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3bdced-d4c2-46f6-8b85-5912c2b5749c service neutron] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:27.165949 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 938/1887] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jul 14 10:53:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 267 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:53:27.268084 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cb0fa0-b069-40a0-a30d-ee5b04a7b0ba None None] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:27.274276 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-85cb0fa0-b069-40a0-a30d-ee5b04a7b0ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:27.282532 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:53:27.356521 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cb0fa0-b069-40a0-a30d-ee5b04a7b0ba None None] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:27.365638 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fb7a93-7651-437d-b667-2976b6ff94bc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68382432147a48c3b62271fd2a2eab04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59391272ecbe48b0aa736cb43807be1d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:27.366374 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fb7a93-7651-437d-b667-2976b6ff94bc service cinder] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:27.366634 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fb7a93-7651-437d-b667-2976b6ff94bc service cinder] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:27.366916 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fb7a93-7651-437d-b667-2976b6ff94bc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:27.369844 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-79fb7a93-7651-437d-b667-2976b6ff94bc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:27.510135 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79fb7a93-7651-437d-b667-2976b6ff94bc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:27.511607 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79fb7a93-7651-437d-b667-2976b6ff94bc service cinder] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:27.524378 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 950/1888] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jul 14 10:53:27 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 257 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:53:27.662145 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3bdced-d4c2-46f6-8b85-5912c2b5749c service neutron] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:27.663847 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-2b3bdced-d4c2-46f6-8b85-5912c2b5749c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:27.690637 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3bdced-d4c2-46f6-8b85-5912c2b5749c service neutron] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:27.713252 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a2db35-dc94-4cf3-8415-b0ed6a772348 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:27.715135 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a2db35-dc94-4cf3-8415-b0ed6a772348 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:27.715546 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a2db35-dc94-4cf3-8415-b0ed6a772348 admin admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:27.715913 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a2db35-dc94-4cf3-8415-b0ed6a772348 admin admin] PATH_INFO: `/v3/projects/5a26d19ad5324a3e80a0da6bf54c361f` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:27.717471 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a2db35-dc94-4cf3-8415-b0ed6a772348 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5a26d19ad5324a3e80a0da6bf54c361f)` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:27.720090 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a2db35-dc94-4cf3-8415-b0ed6a772348 admin admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:27.772853 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fb7a93-7651-437d-b667-2976b6ff94bc service cinder] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:27.775372 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-79fb7a93-7651-437d-b667-2976b6ff94bc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:27.789358 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-a0a2db35-dc94-4cf3-8415-b0ed6a772348 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5a26d19ad5324a3e80a0da6bf54c361f', 'request_id': 'req-a0a2db35-dc94-4cf3-8415-b0ed6a772348'} {{(pid=86656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:27.806241 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fb7a93-7651-437d-b667-2976b6ff94bc service cinder] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:27.813790 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-a0a2db35-dc94-4cf3-8415-b0ed6a772348 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5a26d19ad5324a3e80a0da6bf54c361f', 'request_id': 'req-a0a2db35-dc94-4cf3-8415-b0ed6a772348'} {{(pid=86656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:27.827553 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-a0a2db35-dc94-4cf3-8415-b0ed6a772348 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5a26d19ad5324a3e80a0da6bf54c361f', 'request_id': 'req-a0a2db35-dc94-4cf3-8415-b0ed6a772348'} {{(pid=86656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:27.841194 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-a0a2db35-dc94-4cf3-8415-b0ed6a772348 admin admin] The token cache is being invalidate because project 5a26d19ad5324a3e80a0da6bf54c361f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86656) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 10:53:27.841652 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-a0a2db35-dc94-4cf3-8415-b0ed6a772348 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:27.842305 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-a0a2db35-dc94-4cf3-8415-b0ed6a772348 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:27.844184 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 939/1889] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Jul 14 10:53:27 2022] DELETE /identity/v3/projects/5a26d19ad5324a3e80a0da6bf54c361f => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:53:27.849526 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a2db35-dc94-4cf3-8415-b0ed6a772348 admin admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:27.856217 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-a0a2db35-dc94-4cf3-8415-b0ed6a772348 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:27.914467 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b07f38-2fe2-4108-98db-065388863f87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:27.915264 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b07f38-2fe2-4108-98db-065388863f87 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:27.915685 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b07f38-2fe2-4108-98db-065388863f87 admin admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:27.916077 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b07f38-2fe2-4108-98db-065388863f87 admin admin] PATH_INFO: `/v3/users/7a9a3eed9c2e4e03b955758a5a7b4ecb` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:27.918686 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b07f38-2fe2-4108-98db-065388863f87 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7a9a3eed9c2e4e03b955758a5a7b4ecb)` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:27.921865 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b07f38-2fe2-4108-98db-065388863f87 admin admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:28.015048 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-74b07f38-2fe2-4108-98db-065388863f87 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7a9a3eed9c2e4e03b955758a5a7b4ecb'} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:28.017537 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a2db35-dc94-4cf3-8415-b0ed6a772348 admin admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:28.025675 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f82254-d016-45c5-a5e8-f5299da40a68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:28.027232 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f82254-d016-45c5-a5e8-f5299da40a68 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:28.027621 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f82254-d016-45c5-a5e8-f5299da40a68 admin admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:28.028317 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f82254-d016-45c5-a5e8-f5299da40a68 admin admin] PATH_INFO: `/v3/users/fccc6d65fc1b414db5ece99218736c1a` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:28.030725 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f82254-d016-45c5-a5e8-f5299da40a68 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fccc6d65fc1b414db5ece99218736c1a)` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:28.033215 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f82254-d016-45c5-a5e8-f5299da40a68 admin admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:28.039701 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-74b07f38-2fe2-4108-98db-065388863f87 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7a9a3eed9c2e4e03b955758a5a7b4ecb'} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:28.042816 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-74b07f38-2fe2-4108-98db-065388863f87 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7a9a3eed9c2e4e03b955758a5a7b4ecb'} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:28.059307 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:53:28.066579 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-74b07f38-2fe2-4108-98db-065388863f87 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7a9a3eed9c2e4e03b955758a5a7b4ecb'} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:28.067697 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-74b07f38-2fe2-4108-98db-065388863f87 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7a9a3eed9c2e4e03b955758a5a7b4ecb'} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:28.118300 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-88f82254-d016-45c5-a5e8-f5299da40a68 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fccc6d65fc1b414db5ece99218736c1a'} {{(pid=86656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:28.124484 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 951/1890] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Jul 14 10:53:27 2022] DELETE /identity/v3/users/7a9a3eed9c2e4e03b955758a5a7b4ecb => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 10:53:28.131351 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f44215-5840-4e6c-9247-3127a3c7e777 None None] REQUEST_METHOD: `POST` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:28.131642 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f44215-5840-4e6c-9247-3127a3c7e777 None None] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:28.132877 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f44215-5840-4e6c-9247-3127a3c7e777 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:28.138423 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-88f82254-d016-45c5-a5e8-f5299da40a68 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fccc6d65fc1b414db5ece99218736c1a'} {{(pid=86656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:28.140974 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-88f82254-d016-45c5-a5e8-f5299da40a68 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fccc6d65fc1b414db5ece99218736c1a'} {{(pid=86656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:28.145661 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:53:28.168712 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-88f82254-d016-45c5-a5e8-f5299da40a68 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fccc6d65fc1b414db5ece99218736c1a'} {{(pid=86656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:28.172271 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-88f82254-d016-45c5-a5e8-f5299da40a68 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fccc6d65fc1b414db5ece99218736c1a'} {{(pid=86656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:28.174143 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.auth.core [None req-00f44215-5840-4e6c-9247-3127a3c7e777 None None] MFA Rules not processed for user `ae4bcdd8106d4bebbdcae96be33505bc`. Rule list: `[]` (Enabled: `True`). {{(pid=86655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:53:28.175985 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-00f44215-5840-4e6c-9247-3127a3c7e777 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:28.197278 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 940/1891] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Jul 14 10:53:27 2022] DELETE /identity/v3/users/fccc6d65fc1b414db5ece99218736c1a => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:53:28.265414 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 952/1892] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jul 14 10:53:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:53:28.306680 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f82254-d016-45c5-a5e8-f5299da40a68 admin admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:28.308370 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-88f82254-d016-45c5-a5e8-f5299da40a68 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:28.378287 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8570f8c6-a7e9-4b37-b359-de041668d384 None None] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:28.378909 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8570f8c6-a7e9-4b37-b359-de041668d384 None None] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:28.379387 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8570f8c6-a7e9-4b37-b359-de041668d384 None None] PATH_INFO: `/` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:28.381323 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 953/1893] 10.222.0.16 () {54 vars in 921 bytes} [Thu Jul 14 10:53:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:53:28.397000 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba063bc1-1bac-437e-b680-7ad7b241d861 None None] REQUEST_METHOD: `POST` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:28.397630 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba063bc1-1bac-437e-b680-7ad7b241d861 None None] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:28.398400 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba063bc1-1bac-437e-b680-7ad7b241d861 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:28.452364 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.auth.core [None req-ba063bc1-1bac-437e-b680-7ad7b241d861 None None] MFA Rules not processed for user `26aa294c913c408499a913ec25bb677d`. Rule list: `[]` (Enabled: `True`). {{(pid=86655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:53:28.453556 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-ba063bc1-1bac-437e-b680-7ad7b241d861 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:28.461030 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f82254-d016-45c5-a5e8-f5299da40a68 admin admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:28.466460 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c94dba-7613-40f3-b4e6-8c96a5cdddbb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dddf93691844886982c91fea974385d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59391272ecbe48b0aa736cb43807be1d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:28.467675 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c94dba-7613-40f3-b4e6-8c96a5cdddbb service neutron] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:28.468147 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c94dba-7613-40f3-b4e6-8c96a5cdddbb service neutron] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:28.468615 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c94dba-7613-40f3-b4e6-8c96a5cdddbb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:28.655168 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 954/1894] 10.222.0.16 () {58 vars in 1018 bytes} [Thu Jul 14 10:53:28 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 10:53:28.661477 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c94dba-7613-40f3-b4e6-8c96a5cdddbb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:28.663201 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c94dba-7613-40f3-b4e6-8c96a5cdddbb service neutron] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:28.688222 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba063bc1-1bac-437e-b680-7ad7b241d861 None None] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:28.689578 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-ba063bc1-1bac-437e-b680-7ad7b241d861 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:28.691001 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 941/1895] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jul 14 10:53:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:53:28.718311 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba063bc1-1bac-437e-b680-7ad7b241d861 None None] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:28.731230 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99f1aad-383a-421c-b72d-26992e1fd19d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26aa294c913c408499a913ec25bb677d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59391272ecbe48b0aa736cb43807be1d', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:28.731877 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99f1aad-383a-421c-b72d-26992e1fd19d service nova] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:28.732826 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99f1aad-383a-421c-b72d-26992e1fd19d service nova] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:28.733123 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99f1aad-383a-421c-b72d-26992e1fd19d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:28.738689 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c94dba-7613-40f3-b4e6-8c96a5cdddbb service neutron] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:28.740244 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-02c94dba-7613-40f3-b4e6-8c96a5cdddbb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:28.756629 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99f1aad-383a-421c-b72d-26992e1fd19d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:28.758519 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99f1aad-383a-421c-b72d-26992e1fd19d service nova] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:28.766096 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c94dba-7613-40f3-b4e6-8c96a5cdddbb service neutron] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:28.784126 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a98846b-aaa6-4578-963f-0f647202e2db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:28.785805 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a98846b-aaa6-4578-963f-0f647202e2db admin admin] REQUEST_METHOD: `DELETE` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:28.787090 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a98846b-aaa6-4578-963f-0f647202e2db admin admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:28.787660 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a98846b-aaa6-4578-963f-0f647202e2db admin admin] PATH_INFO: `/v3/projects/0b97288b035f4eeea866a9e78509274d` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:28.791280 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a98846b-aaa6-4578-963f-0f647202e2db admin admin] RBAC: Authorizing `identity:delete_project(project_id=0b97288b035f4eeea866a9e78509274d)` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:28.793532 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a98846b-aaa6-4578-963f-0f647202e2db admin admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:28.795824 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 955/1896] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jul 14 10:53:28 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:53:28.926385 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-5a98846b-aaa6-4578-963f-0f647202e2db admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0b97288b035f4eeea866a9e78509274d', 'request_id': 'req-5a98846b-aaa6-4578-963f-0f647202e2db'} {{(pid=86656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:28.938877 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-5a98846b-aaa6-4578-963f-0f647202e2db admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0b97288b035f4eeea866a9e78509274d', 'request_id': 'req-5a98846b-aaa6-4578-963f-0f647202e2db'} {{(pid=86656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:28.964538 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-5a98846b-aaa6-4578-963f-0f647202e2db admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0b97288b035f4eeea866a9e78509274d', 'request_id': 'req-5a98846b-aaa6-4578-963f-0f647202e2db'} {{(pid=86656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:29.003580 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-5a98846b-aaa6-4578-963f-0f647202e2db admin admin] The token cache is being invalidate because project 0b97288b035f4eeea866a9e78509274d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86656) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 10:53:29.004164 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-5a98846b-aaa6-4578-963f-0f647202e2db admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:29.005174 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-5a98846b-aaa6-4578-963f-0f647202e2db admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:29.008330 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 942/1897] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Jul 14 10:53:28 2022] DELETE /identity/v3/projects/0b97288b035f4eeea866a9e78509274d => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 10:53:29.014030 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a040862c-009e-4aba-a6c5-a610d8aac534 None None] REQUEST_METHOD: `POST` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:29.014985 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a040862c-009e-4aba-a6c5-a610d8aac534 None None] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:29.016063 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a040862c-009e-4aba-a6c5-a610d8aac534 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:29.063301 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.auth.core [None req-a040862c-009e-4aba-a6c5-a610d8aac534 None None] MFA Rules not processed for user `ae4bcdd8106d4bebbdcae96be33505bc`. Rule list: `[]` (Enabled: `True`). {{(pid=86655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:53:29.065851 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-a040862c-009e-4aba-a6c5-a610d8aac534 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:29.169122 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:53:29.184731 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 956/1898] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jul 14 10:53:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:53:29.194360 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69bcf13-4b1d-4bcd-809b-d8c4450a88b0 None None] REQUEST_METHOD: `POST` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:29.194664 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69bcf13-4b1d-4bcd-809b-d8c4450a88b0 None None] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:29.194952 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69bcf13-4b1d-4bcd-809b-d8c4450a88b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:29.204610 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:53:29.229448 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.auth.core [None req-e69bcf13-4b1d-4bcd-809b-d8c4450a88b0 None None] MFA Rules not processed for user `ae4bcdd8106d4bebbdcae96be33505bc`. Rule list: `[]` (Enabled: `True`). {{(pid=86656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:53:29.232477 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-e69bcf13-4b1d-4bcd-809b-d8c4450a88b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:29.245636 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 943/1899] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jul 14 10:53:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:53:29.251041 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a040862c-009e-4aba-a6c5-a610d8aac534 None None] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:29.266367 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a040862c-009e-4aba-a6c5-a610d8aac534 None None] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:29.274541 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1422723-909c-4a9f-b290-1009dc64e6de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:29.275546 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1422723-909c-4a9f-b290-1009dc64e6de admin admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:29.277783 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1422723-909c-4a9f-b290-1009dc64e6de admin admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:29.278890 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1422723-909c-4a9f-b290-1009dc64e6de admin admin] PATH_INFO: `/v3/domains` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:29.280366 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1422723-909c-4a9f-b290-1009dc64e6de admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:53:29.281079 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1422723-909c-4a9f-b290-1009dc64e6de admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:29.282933 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1422723-909c-4a9f-b290-1009dc64e6de admin admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:29.309578 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 957/1900] 10.222.0.16 () {58 vars in 1152 bytes} [Thu Jul 14 10:53:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:53:29.313936 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69bcf13-4b1d-4bcd-809b-d8c4450a88b0 None None] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:29.329120 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69bcf13-4b1d-4bcd-809b-d8c4450a88b0 None None] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:29.339644 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727433b5-9a17-49b6-a86e-9ec121f098e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:29.340737 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727433b5-9a17-49b6-a86e-9ec121f098e5 admin admin] REQUEST_METHOD: `POST` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:29.343174 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727433b5-9a17-49b6-a86e-9ec121f098e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:29.344360 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727433b5-9a17-49b6-a86e-9ec121f098e5 admin admin] PATH_INFO: `/v3/projects` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:29.347381 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727433b5-9a17-49b6-a86e-9ec121f098e5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:29.351063 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727433b5-9a17-49b6-a86e-9ec121f098e5 admin admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:29.403103 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1422723-909c-4a9f-b290-1009dc64e6de admin admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:29.405688 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 944/1901] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Jul 14 10:53:29 2022] POST /identity/v3/projects => generated 373 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 10:53:29.421206 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1422723-909c-4a9f-b290-1009dc64e6de admin admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:29.508374 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe00ed9-56b7-4de7-9cc2-d61e0c41a2f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:29.509181 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe00ed9-56b7-4de7-9cc2-d61e0c41a2f1 admin admin] REQUEST_METHOD: `POST` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:29.509551 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe00ed9-56b7-4de7-9cc2-d61e0c41a2f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:29.509924 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe00ed9-56b7-4de7-9cc2-d61e0c41a2f1 admin admin] PATH_INFO: `/v3/users` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:29.510772 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe00ed9-56b7-4de7-9cc2-d61e0c41a2f1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:29.513032 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe00ed9-56b7-4de7-9cc2-d61e0c41a2f1 admin admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:29.538183 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 958/1902] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Jul 14 10:53:29 2022] POST /identity/v3/users => generated 287 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 10:53:29.542425 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727433b5-9a17-49b6-a86e-9ec121f098e5 admin admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:29.558476 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727433b5-9a17-49b6-a86e-9ec121f098e5 admin admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:29.566352 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962ac0c7-415d-4876-b626-88c2d5058f92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:29.567720 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962ac0c7-415d-4876-b626-88c2d5058f92 admin admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:29.568479 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962ac0c7-415d-4876-b626-88c2d5058f92 admin admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:29.568895 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962ac0c7-415d-4876-b626-88c2d5058f92 admin admin] PATH_INFO: `/v3/roles` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:29.572533 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962ac0c7-415d-4876-b626-88c2d5058f92 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:29.572533 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962ac0c7-415d-4876-b626-88c2d5058f92 admin admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:29.588024 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 945/1903] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jul 14 10:53:29 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:53:29.590134 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe00ed9-56b7-4de7-9cc2-d61e0c41a2f1 admin admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:29.605461 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe00ed9-56b7-4de7-9cc2-d61e0c41a2f1 admin admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:29.613020 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd595655-f184-4d5f-a7bd-7cc5dbf5900f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:29.615699 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd595655-f184-4d5f-a7bd-7cc5dbf5900f admin admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:29.616151 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd595655-f184-4d5f-a7bd-7cc5dbf5900f admin admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:29.617161 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd595655-f184-4d5f-a7bd-7cc5dbf5900f admin admin] PATH_INFO: `/v3/roles` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:29.618084 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd595655-f184-4d5f-a7bd-7cc5dbf5900f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:29.625802 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd595655-f184-4d5f-a7bd-7cc5dbf5900f admin admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:29.650083 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 959/1904] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jul 14 10:53:29 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:53:29.652522 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962ac0c7-415d-4876-b626-88c2d5058f92 admin admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:29.667071 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962ac0c7-415d-4876-b626-88c2d5058f92 admin admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:29.672413 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f19746-f14d-4a8a-876b-d5ff32a67213 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:29.673517 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f19746-f14d-4a8a-876b-d5ff32a67213 admin admin] REQUEST_METHOD: `PUT` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:29.673873 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f19746-f14d-4a8a-876b-d5ff32a67213 admin admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:29.674270 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f19746-f14d-4a8a-876b-d5ff32a67213 admin admin] PATH_INFO: `/v3/projects/30e2ca082e514ba2b3a6a96f3d6e3df4/users/7a8d60520be840a181ffc48b3811255a/roles/0da46c267d354cce81495dfdd56c1ec2` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:29.692864 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f19746-f14d-4a8a-876b-d5ff32a67213 admin admin] RBAC: Authorizing `identity:create_grant(project_id=30e2ca082e514ba2b3a6a96f3d6e3df4, user_id=7a8d60520be840a181ffc48b3811255a, role_id=0da46c267d354cce81495dfdd56c1ec2)` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:29.696827 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f19746-f14d-4a8a-876b-d5ff32a67213 admin admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:29.720941 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 946/1905] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Jul 14 10:53:29 2022] PUT /identity/v3/projects/30e2ca082e514ba2b3a6a96f3d6e3df4/users/7a8d60520be840a181ffc48b3811255a/roles/0da46c267d354cce81495dfdd56c1ec2 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:53:29.726482 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd4f082-0fbd-496d-a873-f720e8b04230 None None] REQUEST_METHOD: `POST` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:29.727014 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd4f082-0fbd-496d-a873-f720e8b04230 None None] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:29.727159 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd4f082-0fbd-496d-a873-f720e8b04230 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:29.747152 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.auth.core [None req-fdd4f082-0fbd-496d-a873-f720e8b04230 None None] MFA Rules not processed for user `ae4bcdd8106d4bebbdcae96be33505bc`. Rule list: `[]` (Enabled: `True`). {{(pid=86655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:53:29.749850 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-fdd4f082-0fbd-496d-a873-f720e8b04230 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:29.756515 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f19746-f14d-4a8a-876b-d5ff32a67213 admin admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:29.758029 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-31f19746-f14d-4a8a-876b-d5ff32a67213 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:29.836439 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 960/1906] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jul 14 10:53:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:53:29.839871 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f19746-f14d-4a8a-876b-d5ff32a67213 admin admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:29.845378 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fa4387-cfcb-4839-b51e-86c9e7e58762 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:29.846378 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fa4387-cfcb-4839-b51e-86c9e7e58762 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:29.846599 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd4f082-0fbd-496d-a873-f720e8b04230 None None] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:29.846804 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fa4387-cfcb-4839-b51e-86c9e7e58762 admin admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:29.847241 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fa4387-cfcb-4839-b51e-86c9e7e58762 admin admin] PATH_INFO: `/v3/projects/7f97f27e4863462cba1ca1792e865315` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:29.848582 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45fa4387-cfcb-4839-b51e-86c9e7e58762 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7f97f27e4863462cba1ca1792e865315)` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:29.848752 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-fdd4f082-0fbd-496d-a873-f720e8b04230 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:29.850655 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45fa4387-cfcb-4839-b51e-86c9e7e58762 admin admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:29.908086 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-45fa4387-cfcb-4839-b51e-86c9e7e58762 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7f97f27e4863462cba1ca1792e865315', 'request_id': 'req-45fa4387-cfcb-4839-b51e-86c9e7e58762'} {{(pid=86656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:29.910818 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd4f082-0fbd-496d-a873-f720e8b04230 None None] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:29.916579 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-45fa4387-cfcb-4839-b51e-86c9e7e58762 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7f97f27e4863462cba1ca1792e865315', 'request_id': 'req-45fa4387-cfcb-4839-b51e-86c9e7e58762'} {{(pid=86656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:29.925051 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-45fa4387-cfcb-4839-b51e-86c9e7e58762 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7f97f27e4863462cba1ca1792e865315', 'request_id': 'req-45fa4387-cfcb-4839-b51e-86c9e7e58762'} {{(pid=86656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:29.931578 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:53:29.940538 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-45fa4387-cfcb-4839-b51e-86c9e7e58762 admin admin] The token cache is being invalidate because project 7f97f27e4863462cba1ca1792e865315 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86656) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 10:53:29.940872 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-45fa4387-cfcb-4839-b51e-86c9e7e58762 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:29.941573 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-45fa4387-cfcb-4839-b51e-86c9e7e58762 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:29.943481 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 947/1907] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Jul 14 10:53:29 2022] DELETE /identity/v3/projects/7f97f27e4863462cba1ca1792e865315 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 10:53:29.944266 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fa4387-cfcb-4839-b51e-86c9e7e58762 admin admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:29.945812 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-45fa4387-cfcb-4839-b51e-86c9e7e58762 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:29.974506 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf850a1-6bc4-458e-bfe5-f66b586ade89 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dddf93691844886982c91fea974385d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59391272ecbe48b0aa736cb43807be1d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:29.976025 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf850a1-6bc4-458e-bfe5-f66b586ade89 service neutron] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:29.976025 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf850a1-6bc4-458e-bfe5-f66b586ade89 service neutron] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:29.976025 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf850a1-6bc4-458e-bfe5-f66b586ade89 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:29.978897 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-7bf850a1-6bc4-458e-bfe5-f66b586ade89 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:29.985347 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:53:30.029856 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fa4387-cfcb-4839-b51e-86c9e7e58762 admin admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:30.035700 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924264f7-3038-426e-afe4-54eaff5479f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:30.036896 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924264f7-3038-426e-afe4-54eaff5479f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:30.037401 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924264f7-3038-426e-afe4-54eaff5479f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:30.037768 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924264f7-3038-426e-afe4-54eaff5479f4 admin admin] PATH_INFO: `/v3/users/83a0879cfa5848d0b1faafd6eb3e4333` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:30.039347 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924264f7-3038-426e-afe4-54eaff5479f4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=83a0879cfa5848d0b1faafd6eb3e4333)` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:30.041721 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924264f7-3038-426e-afe4-54eaff5479f4 admin admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:30.056496 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf850a1-6bc4-458e-bfe5-f66b586ade89 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:30.058112 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf850a1-6bc4-458e-bfe5-f66b586ade89 service neutron] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:30.072100 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 961/1908] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jul 14 10:53:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 10:53:30.073132 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf850a1-6bc4-458e-bfe5-f66b586ade89 service neutron] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:30.074606 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-7bf850a1-6bc4-458e-bfe5-f66b586ade89 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:30.093492 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf850a1-6bc4-458e-bfe5-f66b586ade89 service neutron] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:30.100898 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7413f72d-450d-4647-ab37-6a570a7e2577 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:30.102437 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7413f72d-450d-4647-ab37-6a570a7e2577 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:30.103436 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7413f72d-450d-4647-ab37-6a570a7e2577 admin admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:30.103585 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7413f72d-450d-4647-ab37-6a570a7e2577 admin admin] PATH_INFO: `/v3/users/c127470dd85545eeb9f9dbb4afd4ce3c` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:30.105137 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7413f72d-450d-4647-ab37-6a570a7e2577 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c127470dd85545eeb9f9dbb4afd4ce3c)` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:30.109857 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7413f72d-450d-4647-ab37-6a570a7e2577 admin admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:30.115208 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-924264f7-3038-426e-afe4-54eaff5479f4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '83a0879cfa5848d0b1faafd6eb3e4333'} {{(pid=86656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:30.126399 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-924264f7-3038-426e-afe4-54eaff5479f4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '83a0879cfa5848d0b1faafd6eb3e4333'} {{(pid=86656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:30.127657 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-924264f7-3038-426e-afe4-54eaff5479f4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '83a0879cfa5848d0b1faafd6eb3e4333'} {{(pid=86656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:30.140271 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-924264f7-3038-426e-afe4-54eaff5479f4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '83a0879cfa5848d0b1faafd6eb3e4333'} {{(pid=86656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:30.151697 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-924264f7-3038-426e-afe4-54eaff5479f4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '83a0879cfa5848d0b1faafd6eb3e4333'} {{(pid=86656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:30.201388 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 948/1909] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Jul 14 10:53:29 2022] DELETE /identity/v3/users/83a0879cfa5848d0b1faafd6eb3e4333 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:53:30.207596 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39024cc-b1ab-49ea-9a71-1b2c1cade914 None None] REQUEST_METHOD: `POST` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:30.207902 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39024cc-b1ab-49ea-9a71-1b2c1cade914 None None] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:30.208192 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39024cc-b1ab-49ea-9a71-1b2c1cade914 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:30.230546 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-7413f72d-450d-4647-ab37-6a570a7e2577 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c127470dd85545eeb9f9dbb4afd4ce3c'} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:30.252203 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.auth.core [None req-d39024cc-b1ab-49ea-9a71-1b2c1cade914 None None] MFA Rules not processed for user `ae4bcdd8106d4bebbdcae96be33505bc`. Rule list: `[]` (Enabled: `True`). {{(pid=86656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:53:30.254375 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-d39024cc-b1ab-49ea-9a71-1b2c1cade914 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:30.266506 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-7413f72d-450d-4647-ab37-6a570a7e2577 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c127470dd85545eeb9f9dbb4afd4ce3c'} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:30.267336 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-7413f72d-450d-4647-ab37-6a570a7e2577 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c127470dd85545eeb9f9dbb4afd4ce3c'} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:30.282641 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-7413f72d-450d-4647-ab37-6a570a7e2577 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c127470dd85545eeb9f9dbb4afd4ce3c'} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:30.284431 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-7413f72d-450d-4647-ab37-6a570a7e2577 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c127470dd85545eeb9f9dbb4afd4ce3c'} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:30.333847 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 962/1910] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Jul 14 10:53:30 2022] DELETE /identity/v3/users/c127470dd85545eeb9f9dbb4afd4ce3c => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:53:30.363615 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 949/1911] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jul 14 10:53:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:53:30.384377 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7413f72d-450d-4647-ab37-6a570a7e2577 admin admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:30.387579 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-7413f72d-450d-4647-ab37-6a570a7e2577 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:30.475735 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:53:30.496792 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7413f72d-450d-4647-ab37-6a570a7e2577 admin admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:30.517008 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f54a72-f0e8-474c-bfd5-5832410581f6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dddf93691844886982c91fea974385d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59391272ecbe48b0aa736cb43807be1d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:30.518055 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f54a72-f0e8-474c-bfd5-5832410581f6 service neutron] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:30.518676 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f54a72-f0e8-474c-bfd5-5832410581f6 service neutron] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:30.519534 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f54a72-f0e8-474c-bfd5-5832410581f6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:30.644304 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f54a72-f0e8-474c-bfd5-5832410581f6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:30.645797 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f54a72-f0e8-474c-bfd5-5832410581f6 service neutron] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:30.658337 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 963/1912] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jul 14 10:53:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 274 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:53:31.034892 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39024cc-b1ab-49ea-9a71-1b2c1cade914 None None] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:31.036572 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-d39024cc-b1ab-49ea-9a71-1b2c1cade914 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:31.063835 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39024cc-b1ab-49ea-9a71-1b2c1cade914 None None] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:31.074947 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafad610-64cd-4e4d-979c-c98c6afdbfba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:31.082847 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafad610-64cd-4e4d-979c-c98c6afdbfba admin admin] REQUEST_METHOD: `DELETE` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:31.082847 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafad610-64cd-4e4d-979c-c98c6afdbfba admin admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:31.082847 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafad610-64cd-4e4d-979c-c98c6afdbfba admin admin] PATH_INFO: `/v3/projects/a5807ba4901249a9baf9a4ffba173244` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:31.085284 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dafad610-64cd-4e4d-979c-c98c6afdbfba admin admin] RBAC: Authorizing `identity:delete_project(project_id=a5807ba4901249a9baf9a4ffba173244)` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:31.094641 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dafad610-64cd-4e4d-979c-c98c6afdbfba admin admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:31.206986 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:53:31.228605 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-dafad610-64cd-4e4d-979c-c98c6afdbfba admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a5807ba4901249a9baf9a4ffba173244', 'request_id': 'req-dafad610-64cd-4e4d-979c-c98c6afdbfba'} {{(pid=86656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:31.252848 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-dafad610-64cd-4e4d-979c-c98c6afdbfba admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a5807ba4901249a9baf9a4ffba173244', 'request_id': 'req-dafad610-64cd-4e4d-979c-c98c6afdbfba'} {{(pid=86656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:31.267572 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-dafad610-64cd-4e4d-979c-c98c6afdbfba admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a5807ba4901249a9baf9a4ffba173244', 'request_id': 'req-dafad610-64cd-4e4d-979c-c98c6afdbfba'} {{(pid=86656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:31.279661 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-dafad610-64cd-4e4d-979c-c98c6afdbfba admin admin] The token cache is being invalidate because project a5807ba4901249a9baf9a4ffba173244 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86656) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 10:53:31.280004 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-dafad610-64cd-4e4d-979c-c98c6afdbfba admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:31.280687 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-dafad610-64cd-4e4d-979c-c98c6afdbfba admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:31.283462 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 950/1913] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Jul 14 10:53:31 2022] DELETE /identity/v3/projects/a5807ba4901249a9baf9a4ffba173244 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:53:31.288266 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecfa5e6-bc70-4327-909c-e99de6b3b394 None None] REQUEST_METHOD: `POST` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:31.288894 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecfa5e6-bc70-4327-909c-e99de6b3b394 None None] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:31.289039 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecfa5e6-bc70-4327-909c-e99de6b3b394 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:31.319603 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.auth.core [None req-1ecfa5e6-bc70-4327-909c-e99de6b3b394 None None] MFA Rules not processed for user `ae4bcdd8106d4bebbdcae96be33505bc`. Rule list: `[]` (Enabled: `True`). {{(pid=86655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:53:31.322890 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-1ecfa5e6-bc70-4327-909c-e99de6b3b394 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:31.399050 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 964/1914] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jul 14 10:53:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:53:31.407990 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f2387a-1518-4956-8b68-8857bfe60007 None None] REQUEST_METHOD: `POST` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:31.408284 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f2387a-1518-4956-8b68-8857bfe60007 None None] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:31.408566 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f2387a-1518-4956-8b68-8857bfe60007 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:31.427235 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.auth.core [None req-c3f2387a-1518-4956-8b68-8857bfe60007 None None] MFA Rules not processed for user `ae4bcdd8106d4bebbdcae96be33505bc`. Rule list: `[]` (Enabled: `True`). {{(pid=86656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:53:31.428480 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-c3f2387a-1518-4956-8b68-8857bfe60007 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:31.437196 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 951/1915] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jul 14 10:53:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:53:31.441595 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecfa5e6-bc70-4327-909c-e99de6b3b394 None None] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:31.452427 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecfa5e6-bc70-4327-909c-e99de6b3b394 None None] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:31.457556 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bb4cdc-7cd8-47f1-b692-b33274e7ec8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:31.458253 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bb4cdc-7cd8-47f1-b692-b33274e7ec8c admin admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:31.458528 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bb4cdc-7cd8-47f1-b692-b33274e7ec8c admin admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:31.458832 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bb4cdc-7cd8-47f1-b692-b33274e7ec8c admin admin] PATH_INFO: `/v3/domains` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:31.459636 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68bb4cdc-7cd8-47f1-b692-b33274e7ec8c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:53:31.460147 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68bb4cdc-7cd8-47f1-b692-b33274e7ec8c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:31.461890 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68bb4cdc-7cd8-47f1-b692-b33274e7ec8c admin admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:31.476920 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 965/1916] 10.222.0.16 () {58 vars in 1152 bytes} [Thu Jul 14 10:53:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 10:53:31.481306 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f2387a-1518-4956-8b68-8857bfe60007 None None] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:31.487491 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bb4cdc-7cd8-47f1-b692-b33274e7ec8c admin admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:31.489510 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-68bb4cdc-7cd8-47f1-b692-b33274e7ec8c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:31.493817 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f2387a-1518-4956-8b68-8857bfe60007 None None] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:31.499938 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfcea0b6-b2a5-4088-bf87-66c68d061b3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:31.500684 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcea0b6-b2a5-4088-bf87-66c68d061b3b admin admin] REQUEST_METHOD: `POST` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:31.501067 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcea0b6-b2a5-4088-bf87-66c68d061b3b admin admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:31.501435 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcea0b6-b2a5-4088-bf87-66c68d061b3b admin admin] PATH_INFO: `/v3/projects` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:31.502565 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfcea0b6-b2a5-4088-bf87-66c68d061b3b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:31.504660 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfcea0b6-b2a5-4088-bf87-66c68d061b3b admin admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:31.525569 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bb4cdc-7cd8-47f1-b692-b33274e7ec8c admin admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:31.545225 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba05da6-de0c-44b6-b378-2ef0ec39a1f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:31.546414 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba05da6-de0c-44b6-b378-2ef0ec39a1f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:31.546921 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba05da6-de0c-44b6-b378-2ef0ec39a1f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:31.547638 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 952/1917] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Jul 14 10:53:31 2022] POST /identity/v3/projects => generated 385 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:53:31.547891 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba05da6-de0c-44b6-b378-2ef0ec39a1f7 admin admin] PATH_INFO: `/v3/projects/2d9c51fa45224c2e913824764093edf7` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:31.550168 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba05da6-de0c-44b6-b378-2ef0ec39a1f7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2d9c51fa45224c2e913824764093edf7)` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:31.552954 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfcea0b6-b2a5-4088-bf87-66c68d061b3b admin admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:31.554421 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba05da6-de0c-44b6-b378-2ef0ec39a1f7 admin admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:31.649548 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-1ba05da6-de0c-44b6-b378-2ef0ec39a1f7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2d9c51fa45224c2e913824764093edf7', 'request_id': 'req-1ba05da6-de0c-44b6-b378-2ef0ec39a1f7'} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:31.659269 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-1ba05da6-de0c-44b6-b378-2ef0ec39a1f7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2d9c51fa45224c2e913824764093edf7', 'request_id': 'req-1ba05da6-de0c-44b6-b378-2ef0ec39a1f7'} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:31.674169 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-1ba05da6-de0c-44b6-b378-2ef0ec39a1f7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2d9c51fa45224c2e913824764093edf7', 'request_id': 'req-1ba05da6-de0c-44b6-b378-2ef0ec39a1f7'} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:31.676468 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfcea0b6-b2a5-4088-bf87-66c68d061b3b admin admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:31.698962 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-1ba05da6-de0c-44b6-b378-2ef0ec39a1f7 admin admin] The token cache is being invalidate because project 2d9c51fa45224c2e913824764093edf7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86655) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 10:53:31.699160 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-1ba05da6-de0c-44b6-b378-2ef0ec39a1f7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:31.699926 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-1ba05da6-de0c-44b6-b378-2ef0ec39a1f7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:31.703337 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 966/1918] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Jul 14 10:53:31 2022] DELETE /identity/v3/projects/2d9c51fa45224c2e913824764093edf7 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 10:53:31.704951 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3883a69d-e208-47ea-af57-9a56077a95e5 None None] REQUEST_METHOD: `POST` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:31.705392 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3883a69d-e208-47ea-af57-9a56077a95e5 None None] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:31.705819 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3883a69d-e208-47ea-af57-9a56077a95e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:31.713086 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:53:31.746993 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.auth.core [None req-3883a69d-e208-47ea-af57-9a56077a95e5 None None] MFA Rules not processed for user `7a8d60520be840a181ffc48b3811255a`. Rule list: `[]` (Enabled: `True`). {{(pid=86655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:53:31.749506 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-3883a69d-e208-47ea-af57-9a56077a95e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:31.776015 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ce5525-81f3-484c-a3c5-280b4c4b2846 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:31.777037 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ce5525-81f3-484c-a3c5-280b4c4b2846 admin admin] REQUEST_METHOD: `POST` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:31.777504 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ce5525-81f3-484c-a3c5-280b4c4b2846 admin admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:31.779616 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ce5525-81f3-484c-a3c5-280b4c4b2846 admin admin] PATH_INFO: `/v3/users` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:31.780731 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ce5525-81f3-484c-a3c5-280b4c4b2846 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:31.783693 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ce5525-81f3-484c-a3c5-280b4c4b2846 admin admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:31.820663 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 953/1919] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Jul 14 10:53:31 2022] POST /identity/v3/users => generated 293 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:53:31.821444 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ce5525-81f3-484c-a3c5-280b4c4b2846 admin admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:31.831277 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-60ce5525-81f3-484c-a3c5-280b4c4b2846 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:31.854058 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ce5525-81f3-484c-a3c5-280b4c4b2846 admin admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:31.862255 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2122c2f8-f09a-443d-b281-9a4bf1f43a07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:31.863177 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2122c2f8-f09a-443d-b281-9a4bf1f43a07 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:31.863506 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2122c2f8-f09a-443d-b281-9a4bf1f43a07 admin admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:31.863917 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2122c2f8-f09a-443d-b281-9a4bf1f43a07 admin admin] PATH_INFO: `/v3/users/cfcbe336526d480e94498493a5c18d13` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:31.865277 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2122c2f8-f09a-443d-b281-9a4bf1f43a07 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cfcbe336526d480e94498493a5c18d13)` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:31.867318 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2122c2f8-f09a-443d-b281-9a4bf1f43a07 admin admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:31.905758 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 967/1920] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jul 14 10:53:31 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:53:31.906674 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3883a69d-e208-47ea-af57-9a56077a95e5 None None] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:31.908156 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-3883a69d-e208-47ea-af57-9a56077a95e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:31.917794 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:DELETE=9,keystone:SELECT=86,keystone:INSERT=5 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:53:31.923666 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3883a69d-e208-47ea-af57-9a56077a95e5 None None] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:31.928474 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed689016-c9c9-4bbd-9550-c3f3414bcf1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:31.929212 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed689016-c9c9-4bbd-9550-c3f3414bcf1e admin admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:31.929509 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed689016-c9c9-4bbd-9550-c3f3414bcf1e admin admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:31.929841 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed689016-c9c9-4bbd-9550-c3f3414bcf1e admin admin] PATH_INFO: `/v3/roles` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:31.930556 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed689016-c9c9-4bbd-9550-c3f3414bcf1e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:31.931888 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-2122c2f8-f09a-443d-b281-9a4bf1f43a07 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cfcbe336526d480e94498493a5c18d13'} {{(pid=86656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:31.932719 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed689016-c9c9-4bbd-9550-c3f3414bcf1e admin admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:31.960385 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-2122c2f8-f09a-443d-b281-9a4bf1f43a07 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cfcbe336526d480e94498493a5c18d13'} {{(pid=86656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:31.962013 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 968/1921] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jul 14 10:53:31 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:53:31.962486 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-2122c2f8-f09a-443d-b281-9a4bf1f43a07 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cfcbe336526d480e94498493a5c18d13'} {{(pid=86656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:31.962861 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed689016-c9c9-4bbd-9550-c3f3414bcf1e admin admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:31.965242 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-ed689016-c9c9-4bbd-9550-c3f3414bcf1e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:31.976075 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-2122c2f8-f09a-443d-b281-9a4bf1f43a07 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cfcbe336526d480e94498493a5c18d13'} {{(pid=86656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:31.976075 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-2122c2f8-f09a-443d-b281-9a4bf1f43a07 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cfcbe336526d480e94498493a5c18d13'} {{(pid=86656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:31.980741 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed689016-c9c9-4bbd-9550-c3f3414bcf1e admin admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:31.986605 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6e0634-7ea9-43d2-b3b5-d9bdcf593b8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:31.987899 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6e0634-7ea9-43d2-b3b5-d9bdcf593b8a admin admin] REQUEST_METHOD: `POST` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:31.988204 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6e0634-7ea9-43d2-b3b5-d9bdcf593b8a admin admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:31.988501 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6e0634-7ea9-43d2-b3b5-d9bdcf593b8a admin admin] PATH_INFO: `/v3/projects` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:31.989396 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6e0634-7ea9-43d2-b3b5-d9bdcf593b8a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:31.992546 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6e0634-7ea9-43d2-b3b5-d9bdcf593b8a admin admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:31.997558 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 954/1922] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Jul 14 10:53:31 2022] DELETE /identity/v3/users/cfcbe336526d480e94498493a5c18d13 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:53:32.002172 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2122c2f8-f09a-443d-b281-9a4bf1f43a07 admin admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:32.003985 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-2122c2f8-f09a-443d-b281-9a4bf1f43a07 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:32.049201 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 969/1923] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Jul 14 10:53:31 2022] POST /identity/v3/projects => generated 371 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:53:32.050675 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6e0634-7ea9-43d2-b3b5-d9bdcf593b8a admin admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:32.058116 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-be6e0634-7ea9-43d2-b3b5-d9bdcf593b8a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:32.163389 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2122c2f8-f09a-443d-b281-9a4bf1f43a07 admin admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:32.217218 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6e0634-7ea9-43d2-b3b5-d9bdcf593b8a admin admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:32.222739 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb8f1e7-54d6-495d-bf70-0db4527f81df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:32.224129 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb8f1e7-54d6-495d-bf70-0db4527f81df admin admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:32.224809 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb8f1e7-54d6-495d-bf70-0db4527f81df admin admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:32.224809 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb8f1e7-54d6-495d-bf70-0db4527f81df admin admin] PATH_INFO: `/v3/roles` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:32.226842 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb8f1e7-54d6-495d-bf70-0db4527f81df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:32.229311 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb8f1e7-54d6-495d-bf70-0db4527f81df admin admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:32.243702 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 970/1924] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jul 14 10:53:32 2022] GET /identity/v3/roles => generated 1420 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:53:32.248563 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb8f1e7-54d6-495d-bf70-0db4527f81df admin admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:32.250195 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d396c5-8e27-4ce7-880a-c4f450a6e3a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:32.253401 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d396c5-8e27-4ce7-880a-c4f450a6e3a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:32.253709 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d396c5-8e27-4ce7-880a-c4f450a6e3a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:32.256680 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d396c5-8e27-4ce7-880a-c4f450a6e3a7 admin admin] PATH_INFO: `/v3/users/ed95849b71054890a7c303145facaf53` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:32.259770 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d396c5-8e27-4ce7-880a-c4f450a6e3a7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ed95849b71054890a7c303145facaf53)` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:32.261819 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb8f1e7-54d6-495d-bf70-0db4527f81df admin admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:32.264386 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d396c5-8e27-4ce7-880a-c4f450a6e3a7 admin admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:32.270824 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc50c391-f9c0-45c5-acc0-2ae172bb3bac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:32.271529 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc50c391-f9c0-45c5-acc0-2ae172bb3bac admin admin] REQUEST_METHOD: `POST` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:32.271946 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc50c391-f9c0-45c5-acc0-2ae172bb3bac admin admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:32.272515 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc50c391-f9c0-45c5-acc0-2ae172bb3bac admin admin] PATH_INFO: `/v3/users` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:32.273770 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc50c391-f9c0-45c5-acc0-2ae172bb3bac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:32.276663 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc50c391-f9c0-45c5-acc0-2ae172bb3bac admin admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:32.318816 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 971/1925] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Jul 14 10:53:32 2022] POST /identity/v3/users => generated 292 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:53:32.319871 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc50c391-f9c0-45c5-acc0-2ae172bb3bac admin admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:32.333014 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc50c391-f9c0-45c5-acc0-2ae172bb3bac admin admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:32.340590 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225f9d9e-9a5c-4799-9b8c-d0d15bfadb4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:32.342838 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225f9d9e-9a5c-4799-9b8c-d0d15bfadb4d admin admin] REQUEST_METHOD: `PUT` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:32.343227 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225f9d9e-9a5c-4799-9b8c-d0d15bfadb4d admin admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:32.343516 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225f9d9e-9a5c-4799-9b8c-d0d15bfadb4d admin admin] PATH_INFO: `/v3/projects/82adf628cb3340f28896e12df0694024/users/cc0686d3f8944283818fdb33c2c3a439/roles/0da46c267d354cce81495dfdd56c1ec2` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:32.375350 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225f9d9e-9a5c-4799-9b8c-d0d15bfadb4d admin admin] RBAC: Authorizing `identity:create_grant(project_id=82adf628cb3340f28896e12df0694024, user_id=cc0686d3f8944283818fdb33c2c3a439, role_id=0da46c267d354cce81495dfdd56c1ec2)` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:32.380619 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225f9d9e-9a5c-4799-9b8c-d0d15bfadb4d admin admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:32.390383 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-e3d396c5-8e27-4ce7-880a-c4f450a6e3a7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ed95849b71054890a7c303145facaf53'} {{(pid=86656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:32.411227 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 972/1926] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Jul 14 10:53:32 2022] PUT /identity/v3/projects/82adf628cb3340f28896e12df0694024/users/cc0686d3f8944283818fdb33c2c3a439/roles/0da46c267d354cce81495dfdd56c1ec2 => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:53:32.411770 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-e3d396c5-8e27-4ce7-880a-c4f450a6e3a7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ed95849b71054890a7c303145facaf53'} {{(pid=86656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:32.412642 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-e3d396c5-8e27-4ce7-880a-c4f450a6e3a7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ed95849b71054890a7c303145facaf53'} {{(pid=86656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:32.412969 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225f9d9e-9a5c-4799-9b8c-d0d15bfadb4d admin admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:32.432644 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-e3d396c5-8e27-4ce7-880a-c4f450a6e3a7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ed95849b71054890a7c303145facaf53'} {{(pid=86656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:32.433398 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-225f9d9e-9a5c-4799-9b8c-d0d15bfadb4d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:32.433775 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-e3d396c5-8e27-4ce7-880a-c4f450a6e3a7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ed95849b71054890a7c303145facaf53'} {{(pid=86656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:32.436153 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:53:32.472120 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 955/1927] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Jul 14 10:53:31 2022] DELETE /identity/v3/users/ed95849b71054890a7c303145facaf53 => generated 0 bytes in 471 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:53:32.472120 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97c9740-4b39-43dd-bc0f-1475bc0d2e39 None None] REQUEST_METHOD: `POST` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:32.472120 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97c9740-4b39-43dd-bc0f-1475bc0d2e39 None None] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:32.472120 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97c9740-4b39-43dd-bc0f-1475bc0d2e39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:32.477054 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:53:32.535971 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.auth.core [None req-f97c9740-4b39-43dd-bc0f-1475bc0d2e39 None None] MFA Rules not processed for user `cc0686d3f8944283818fdb33c2c3a439`. Rule list: `[]` (Enabled: `True`). {{(pid=86656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:53:32.539444 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-f97c9740-4b39-43dd-bc0f-1475bc0d2e39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:32.583024 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225f9d9e-9a5c-4799-9b8c-d0d15bfadb4d admin admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:32.625458 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 956/1928] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jul 14 10:53:32 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:53:32.627012 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41c47c4-1360-49e2-88b0-71dab76698f1 None None] REQUEST_METHOD: `POST` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:32.627354 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41c47c4-1360-49e2-88b0-71dab76698f1 None None] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:32.627645 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41c47c4-1360-49e2-88b0-71dab76698f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:32.646449 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.auth.core [None req-a41c47c4-1360-49e2-88b0-71dab76698f1 None None] MFA Rules not processed for user `ae4bcdd8106d4bebbdcae96be33505bc`. Rule list: `[]` (Enabled: `True`). {{(pid=86656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:53:32.647719 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-a41c47c4-1360-49e2-88b0-71dab76698f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:32.650039 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99d9676-b250-49c3-a2a8-e072d3bb14bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:32.650717 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99d9676-b250-49c3-a2a8-e072d3bb14bb admin admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:32.651054 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99d9676-b250-49c3-a2a8-e072d3bb14bb admin admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:32.651279 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99d9676-b250-49c3-a2a8-e072d3bb14bb admin admin] PATH_INFO: `/v3/roles` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:32.652068 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99d9676-b250-49c3-a2a8-e072d3bb14bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:32.653693 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99d9676-b250-49c3-a2a8-e072d3bb14bb admin admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:32.656018 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 957/1929] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jul 14 10:53:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:53:32.656822 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41c47c4-1360-49e2-88b0-71dab76698f1 None None] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:32.660088 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-a41c47c4-1360-49e2-88b0-71dab76698f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:32.665309 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 973/1930] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jul 14 10:53:32 2022] GET /identity/v3/roles => generated 1420 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:53:32.666432 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99d9676-b250-49c3-a2a8-e072d3bb14bb admin admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:32.668399 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-e99d9676-b250-49c3-a2a8-e072d3bb14bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:32.674320 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41c47c4-1360-49e2-88b0-71dab76698f1 None None] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:32.679212 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9e4831-d5b7-4d2e-9c72-3f442ca243bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:32.680249 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9e4831-d5b7-4d2e-9c72-3f442ca243bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:32.680536 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9e4831-d5b7-4d2e-9c72-3f442ca243bf admin admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:32.680849 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9e4831-d5b7-4d2e-9c72-3f442ca243bf admin admin] PATH_INFO: `/v3/projects/d0a7fc85322347b385a27bef18286b81` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:32.682039 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99d9676-b250-49c3-a2a8-e072d3bb14bb admin admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:32.682173 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9e4831-d5b7-4d2e-9c72-3f442ca243bf admin admin] RBAC: Authorizing `identity:delete_project(project_id=d0a7fc85322347b385a27bef18286b81)` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:32.684269 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9e4831-d5b7-4d2e-9c72-3f442ca243bf admin admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:32.688593 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbc09ab-ddd1-40ae-9695-02c4c933c70f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:32.689392 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbc09ab-ddd1-40ae-9695-02c4c933c70f admin admin] REQUEST_METHOD: `POST` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:32.689683 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbc09ab-ddd1-40ae-9695-02c4c933c70f admin admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:32.690004 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbc09ab-ddd1-40ae-9695-02c4c933c70f admin admin] PATH_INFO: `/v3/projects` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:32.690777 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebbc09ab-ddd1-40ae-9695-02c4c933c70f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:32.692829 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebbc09ab-ddd1-40ae-9695-02c4c933c70f admin admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:32.723677 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 974/1931] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Jul 14 10:53:32 2022] POST /identity/v3/projects => generated 387 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:53:32.723677 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbc09ab-ddd1-40ae-9695-02c4c933c70f admin admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:32.741296 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-4c9e4831-d5b7-4d2e-9c72-3f442ca243bf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd0a7fc85322347b385a27bef18286b81', 'request_id': 'req-4c9e4831-d5b7-4d2e-9c72-3f442ca243bf'} {{(pid=86656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:32.751440 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-4c9e4831-d5b7-4d2e-9c72-3f442ca243bf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd0a7fc85322347b385a27bef18286b81', 'request_id': 'req-4c9e4831-d5b7-4d2e-9c72-3f442ca243bf'} {{(pid=86656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:32.758615 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-4c9e4831-d5b7-4d2e-9c72-3f442ca243bf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd0a7fc85322347b385a27bef18286b81', 'request_id': 'req-4c9e4831-d5b7-4d2e-9c72-3f442ca243bf'} {{(pid=86656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:32.774464 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-4c9e4831-d5b7-4d2e-9c72-3f442ca243bf admin admin] The token cache is being invalidate because project d0a7fc85322347b385a27bef18286b81 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86656) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 10:53:32.774768 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-4c9e4831-d5b7-4d2e-9c72-3f442ca243bf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:32.775451 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-4c9e4831-d5b7-4d2e-9c72-3f442ca243bf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:32.786682 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 958/1932] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Jul 14 10:53:32 2022] DELETE /identity/v3/projects/d0a7fc85322347b385a27bef18286b81 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:53:32.787643 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9e4831-d5b7-4d2e-9c72-3f442ca243bf admin admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:32.789488 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-4c9e4831-d5b7-4d2e-9c72-3f442ca243bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:32.799014 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbc09ab-ddd1-40ae-9695-02c4c933c70f admin admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:32.803988 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca7fe16-299c-41e3-ba7a-46f00555ade5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:32.804825 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca7fe16-299c-41e3-ba7a-46f00555ade5 admin admin] REQUEST_METHOD: `PUT` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:32.805385 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca7fe16-299c-41e3-ba7a-46f00555ade5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:32.805561 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca7fe16-299c-41e3-ba7a-46f00555ade5 admin admin] PATH_INFO: `/v3/projects/e2b26230df5047bcba725e41934f02f1/users/56505ea13745436ba9e0d35b7e481732/roles/153539819e5542df99269d2913bbecfb` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:32.822695 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca7fe16-299c-41e3-ba7a-46f00555ade5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e2b26230df5047bcba725e41934f02f1, user_id=56505ea13745436ba9e0d35b7e481732, role_id=153539819e5542df99269d2913bbecfb)` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:32.825559 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca7fe16-299c-41e3-ba7a-46f00555ade5 admin admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:32.848857 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 975/1933] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Jul 14 10:53:32 2022] PUT /identity/v3/projects/e2b26230df5047bcba725e41934f02f1/users/56505ea13745436ba9e0d35b7e481732/roles/153539819e5542df99269d2913bbecfb => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:53:32.849724 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca7fe16-299c-41e3-ba7a-46f00555ade5 admin admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:32.851528 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-3ca7fe16-299c-41e3-ba7a-46f00555ade5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:32.863973 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:53:32.870609 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9e4831-d5b7-4d2e-9c72-3f442ca243bf admin admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:32.878927 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:53:32.930782 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6116f316-ecaf-4e33-b53a-5a3db0fa359b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dddf93691844886982c91fea974385d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59391272ecbe48b0aa736cb43807be1d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:32.931459 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6116f316-ecaf-4e33-b53a-5a3db0fa359b service neutron] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:32.931784 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6116f316-ecaf-4e33-b53a-5a3db0fa359b service neutron] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:32.932073 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6116f316-ecaf-4e33-b53a-5a3db0fa359b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:32.933974 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-6116f316-ecaf-4e33-b53a-5a3db0fa359b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:32.934328 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca7fe16-299c-41e3-ba7a-46f00555ade5 admin admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:32.939132 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0b1da4-1ca5-4abd-9ba2-5ce58f26e3d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:32.939806 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0b1da4-1ca5-4abd-9ba2-5ce58f26e3d1 admin admin] REQUEST_METHOD: `POST` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:32.940206 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0b1da4-1ca5-4abd-9ba2-5ce58f26e3d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:32.940490 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0b1da4-1ca5-4abd-9ba2-5ce58f26e3d1 admin admin] PATH_INFO: `/v3/users` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:32.941225 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0b1da4-1ca5-4abd-9ba2-5ce58f26e3d1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:32.943531 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0b1da4-1ca5-4abd-9ba2-5ce58f26e3d1 admin admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:32.946499 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6116f316-ecaf-4e33-b53a-5a3db0fa359b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:32.947946 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6116f316-ecaf-4e33-b53a-5a3db0fa359b service neutron] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:32.958582 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 959/1934] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jul 14 10:53:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:53:32.959931 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9acad13-7338-44f9-9840-baa016c0be93 None None] REQUEST_METHOD: `POST` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:32.960311 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9acad13-7338-44f9-9840-baa016c0be93 None None] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:32.960594 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9acad13-7338-44f9-9840-baa016c0be93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:32.972390 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 976/1935] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Jul 14 10:53:32 2022] POST /identity/v3/users => generated 300 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:53:32.973503 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0b1da4-1ca5-4abd-9ba2-5ce58f26e3d1 admin admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:32.975524 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-6f0b1da4-1ca5-4abd-9ba2-5ce58f26e3d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:32.979741 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.auth.core [None req-a9acad13-7338-44f9-9840-baa016c0be93 None None] MFA Rules not processed for user `ae4bcdd8106d4bebbdcae96be33505bc`. Rule list: `[]` (Enabled: `True`). {{(pid=86656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:53:32.980970 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-a9acad13-7338-44f9-9840-baa016c0be93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:32.988342 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0b1da4-1ca5-4abd-9ba2-5ce58f26e3d1 admin admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:32.991978 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 960/1936] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jul 14 10:53:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:53:32.993251 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9acad13-7338-44f9-9840-baa016c0be93 None None] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:32.993622 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601b4d6b-4e3e-4f98-b638-1ae0293d87e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:32.994298 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601b4d6b-4e3e-4f98-b638-1ae0293d87e2 admin admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:32.994586 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601b4d6b-4e3e-4f98-b638-1ae0293d87e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:32.994870 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601b4d6b-4e3e-4f98-b638-1ae0293d87e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:32.995611 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601b4d6b-4e3e-4f98-b638-1ae0293d87e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:32.997250 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601b4d6b-4e3e-4f98-b638-1ae0293d87e2 admin admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:33.004585 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9acad13-7338-44f9-9840-baa016c0be93 None None] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:33.009063 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 977/1937] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jul 14 10:53:32 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:53:33.010392 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f36de8-091b-485f-97cd-a290587d40a8 None None] REQUEST_METHOD: `POST` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:33.010694 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f36de8-091b-485f-97cd-a290587d40a8 None None] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:33.011096 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f36de8-091b-485f-97cd-a290587d40a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:33.013662 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f12047-e98f-40ca-8ee3-98a124c03bd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:33.014863 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f12047-e98f-40ca-8ee3-98a124c03bd9 admin admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:33.015195 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f12047-e98f-40ca-8ee3-98a124c03bd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:33.015466 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f12047-e98f-40ca-8ee3-98a124c03bd9 admin admin] PATH_INFO: `/v3/roles` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:33.016327 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f12047-e98f-40ca-8ee3-98a124c03bd9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:33.018700 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f12047-e98f-40ca-8ee3-98a124c03bd9 admin admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:33.034724 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 961/1938] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jul 14 10:53:32 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:53:33.034724 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f12047-e98f-40ca-8ee3-98a124c03bd9 admin admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:33.040941 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.auth.core [None req-79f36de8-091b-485f-97cd-a290587d40a8 None None] MFA Rules not processed for user `ae4bcdd8106d4bebbdcae96be33505bc`. Rule list: `[]` (Enabled: `True`). {{(pid=86655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:53:33.042982 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-79f36de8-091b-485f-97cd-a290587d40a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:33.044879 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f12047-e98f-40ca-8ee3-98a124c03bd9 admin admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:33.051047 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575f7e70-e89d-467f-b1e2-8b2f4267ed2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:33.052410 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575f7e70-e89d-467f-b1e2-8b2f4267ed2d admin admin] REQUEST_METHOD: `PUT` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:33.052811 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575f7e70-e89d-467f-b1e2-8b2f4267ed2d admin admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:33.053147 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575f7e70-e89d-467f-b1e2-8b2f4267ed2d admin admin] PATH_INFO: `/v3/projects/e2b26230df5047bcba725e41934f02f1/users/56505ea13745436ba9e0d35b7e481732/roles/153539819e5542df99269d2913bbecfb` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:33.054240 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 978/1939] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jul 14 10:53:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:53:33.058815 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f36de8-091b-485f-97cd-a290587d40a8 None None] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:33.059507 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575f7e70-e89d-467f-b1e2-8b2f4267ed2d admin admin] RBAC: Authorizing `identity:create_grant(project_id=e2b26230df5047bcba725e41934f02f1, user_id=56505ea13745436ba9e0d35b7e481732, role_id=153539819e5542df99269d2913bbecfb)` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:33.063192 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575f7e70-e89d-467f-b1e2-8b2f4267ed2d admin admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:33.070449 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f36de8-091b-485f-97cd-a290587d40a8 None None] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:33.079097 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 962/1940] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Jul 14 10:53:33 2022] PUT /identity/v3/projects/e2b26230df5047bcba725e41934f02f1/users/56505ea13745436ba9e0d35b7e481732/roles/153539819e5542df99269d2913bbecfb => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:53:33.080018 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575f7e70-e89d-467f-b1e2-8b2f4267ed2d admin admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:33.160325 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd6b8b7-c279-42b4-9185-417f21ca7ba2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:33.162152 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd6b8b7-c279-42b4-9185-417f21ca7ba2 admin admin] REQUEST_METHOD: `PUT` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:33.162775 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd6b8b7-c279-42b4-9185-417f21ca7ba2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:33.163541 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd6b8b7-c279-42b4-9185-417f21ca7ba2 admin admin] PATH_INFO: `/v3/projects/bf830f37b31e4a75a00f02b56f77f429/users/095f4f994f444c33a8f6dcaa66b6d0e1/roles/153539819e5542df99269d2913bbecfb` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:33.182937 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575f7e70-e89d-467f-b1e2-8b2f4267ed2d admin admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:33.187771 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd6b8b7-c279-42b4-9185-417f21ca7ba2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bf830f37b31e4a75a00f02b56f77f429, user_id=095f4f994f444c33a8f6dcaa66b6d0e1, role_id=153539819e5542df99269d2913bbecfb)` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:33.189140 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c81c5f-31ff-4d2c-882f-73dfbb737e31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:33.190614 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c81c5f-31ff-4d2c-882f-73dfbb737e31 admin admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:33.191120 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd6b8b7-c279-42b4-9185-417f21ca7ba2 admin admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:33.191240 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c81c5f-31ff-4d2c-882f-73dfbb737e31 admin admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:33.191793 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c81c5f-31ff-4d2c-882f-73dfbb737e31 admin admin] PATH_INFO: `/v3/domains` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:33.192912 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c81c5f-31ff-4d2c-882f-73dfbb737e31 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:53:33.193493 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c81c5f-31ff-4d2c-882f-73dfbb737e31 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:33.196481 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c81c5f-31ff-4d2c-882f-73dfbb737e31 admin admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:33.217118 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 963/1941] 10.222.0.16 () {58 vars in 1152 bytes} [Thu Jul 14 10:53:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:53:33.218445 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c81c5f-31ff-4d2c-882f-73dfbb737e31 admin admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:33.223446 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 979/1942] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Jul 14 10:53:33 2022] PUT /identity/v3/projects/bf830f37b31e4a75a00f02b56f77f429/users/095f4f994f444c33a8f6dcaa66b6d0e1/roles/153539819e5542df99269d2913bbecfb => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:53:33.227395 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd6b8b7-c279-42b4-9185-417f21ca7ba2 admin admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:33.239394 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c81c5f-31ff-4d2c-882f-73dfbb737e31 admin admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:33.337956 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd6b8b7-c279-42b4-9185-417f21ca7ba2 admin admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:33.340345 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11dae47-aa6f-4ad7-b10a-3eb97128c9c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:33.343254 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11dae47-aa6f-4ad7-b10a-3eb97128c9c6 admin admin] REQUEST_METHOD: `POST` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:33.343656 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11dae47-aa6f-4ad7-b10a-3eb97128c9c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:33.344759 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11dae47-aa6f-4ad7-b10a-3eb97128c9c6 admin admin] PATH_INFO: `/v3/projects` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:33.345648 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11dae47-aa6f-4ad7-b10a-3eb97128c9c6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:33.346678 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92817f7-7879-405b-8bd7-c555dd2b3213 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:33.349078 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92817f7-7879-405b-8bd7-c555dd2b3213 admin admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:33.349647 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92817f7-7879-405b-8bd7-c555dd2b3213 admin admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:33.350245 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92817f7-7879-405b-8bd7-c555dd2b3213 admin admin] PATH_INFO: `/v3/roles` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:33.351110 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92817f7-7879-405b-8bd7-c555dd2b3213 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:33.353549 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92817f7-7879-405b-8bd7-c555dd2b3213 admin admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:33.361892 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11dae47-aa6f-4ad7-b10a-3eb97128c9c6 admin admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:33.373622 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 980/1943] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jul 14 10:53:33 2022] GET /identity/v3/roles => generated 1420 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 10:53:33.377812 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92817f7-7879-405b-8bd7-c555dd2b3213 admin admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:33.399827 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:53:33.404292 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92817f7-7879-405b-8bd7-c555dd2b3213 admin admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:33.421538 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8be53ae-7689-499a-afd9-0d1522b3bbfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:33.422570 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8be53ae-7689-499a-afd9-0d1522b3bbfd admin admin] REQUEST_METHOD: `PUT` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:33.422754 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8be53ae-7689-499a-afd9-0d1522b3bbfd admin admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:33.423583 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8be53ae-7689-499a-afd9-0d1522b3bbfd admin admin] PATH_INFO: `/v3/projects/bf830f37b31e4a75a00f02b56f77f429/users/095f4f994f444c33a8f6dcaa66b6d0e1/roles/153539819e5542df99269d2913bbecfb` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:33.425367 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8be53ae-7689-499a-afd9-0d1522b3bbfd admin admin] RBAC: Authorizing `identity:create_grant(project_id=bf830f37b31e4a75a00f02b56f77f429, user_id=095f4f994f444c33a8f6dcaa66b6d0e1, role_id=153539819e5542df99269d2913bbecfb)` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:33.431787 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 964/1944] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Jul 14 10:53:33 2022] POST /identity/v3/projects => generated 375 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:53:33.436580 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11dae47-aa6f-4ad7-b10a-3eb97128c9c6 admin admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:33.455190 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8be53ae-7689-499a-afd9-0d1522b3bbfd admin admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:33.464637 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:53:33.480942 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 981/1945] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Jul 14 10:53:33 2022] PUT /identity/v3/projects/bf830f37b31e4a75a00f02b56f77f429/users/095f4f994f444c33a8f6dcaa66b6d0e1/roles/153539819e5542df99269d2913bbecfb => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:53:33.495880 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affd8021-1730-4185-bec5-77c235a6300a None None] REQUEST_METHOD: `POST` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:33.496280 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affd8021-1730-4185-bec5-77c235a6300a None None] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:33.496657 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affd8021-1730-4185-bec5-77c235a6300a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:33.548530 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.auth.core [None req-affd8021-1730-4185-bec5-77c235a6300a None None] MFA Rules not processed for user `095f4f994f444c33a8f6dcaa66b6d0e1`. Rule list: `[]` (Enabled: `True`). {{(pid=86655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:53:33.550671 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-affd8021-1730-4185-bec5-77c235a6300a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:33.574557 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11dae47-aa6f-4ad7-b10a-3eb97128c9c6 admin admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:33.649334 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 982/1946] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jul 14 10:53:33 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 10:53:33.650432 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affd8021-1730-4185-bec5-77c235a6300a None None] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:33.651970 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-affd8021-1730-4185-bec5-77c235a6300a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:33.712261 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52921035-1050-40a5-be33-fd540cc22b87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:33.713327 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52921035-1050-40a5-be33-fd540cc22b87 admin admin] REQUEST_METHOD: `POST` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:33.713797 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52921035-1050-40a5-be33-fd540cc22b87 admin admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:33.714370 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52921035-1050-40a5-be33-fd540cc22b87 admin admin] PATH_INFO: `/v3/users` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:33.715364 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52921035-1050-40a5-be33-fd540cc22b87 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:33.717721 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52921035-1050-40a5-be33-fd540cc22b87 admin admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:33.745413 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affd8021-1730-4185-bec5-77c235a6300a None None] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:33.752035 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d213bc-5987-4ff6-8c6e-69b83bb3704f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:33.753257 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d213bc-5987-4ff6-8c6e-69b83bb3704f admin admin] REQUEST_METHOD: `DELETE` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:33.753611 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d213bc-5987-4ff6-8c6e-69b83bb3704f admin admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:33.753983 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d213bc-5987-4ff6-8c6e-69b83bb3704f admin admin] PATH_INFO: `/v3/projects/6290ebf76b4e4934a9fd6234b93a4b53` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:33.755401 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d213bc-5987-4ff6-8c6e-69b83bb3704f admin admin] RBAC: Authorizing `identity:delete_project(project_id=6290ebf76b4e4934a9fd6234b93a4b53)` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:33.757880 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d213bc-5987-4ff6-8c6e-69b83bb3704f admin admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:33.758711 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 965/1947] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Jul 14 10:53:33 2022] POST /identity/v3/users => generated 288 bytes in 323 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:53:33.762785 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52921035-1050-40a5-be33-fd540cc22b87 admin admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:33.786880 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52921035-1050-40a5-be33-fd540cc22b87 admin admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:33.805520 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb354696-ffb2-4d36-a2e3-a73231621363 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:33.806501 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb354696-ffb2-4d36-a2e3-a73231621363 admin admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:33.806937 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb354696-ffb2-4d36-a2e3-a73231621363 admin admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:33.807362 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb354696-ffb2-4d36-a2e3-a73231621363 admin admin] PATH_INFO: `/v3/roles` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:33.809011 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb354696-ffb2-4d36-a2e3-a73231621363 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:33.814928 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb354696-ffb2-4d36-a2e3-a73231621363 admin admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:33.824879 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-59d213bc-5987-4ff6-8c6e-69b83bb3704f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6290ebf76b4e4934a9fd6234b93a4b53', 'request_id': 'req-59d213bc-5987-4ff6-8c6e-69b83bb3704f'} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:33.833456 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-59d213bc-5987-4ff6-8c6e-69b83bb3704f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6290ebf76b4e4934a9fd6234b93a4b53', 'request_id': 'req-59d213bc-5987-4ff6-8c6e-69b83bb3704f'} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:33.843966 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 966/1948] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jul 14 10:53:33 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 10:53:33.845096 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb354696-ffb2-4d36-a2e3-a73231621363 admin admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:33.848842 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-eb354696-ffb2-4d36-a2e3-a73231621363 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:33.857277 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-59d213bc-5987-4ff6-8c6e-69b83bb3704f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6290ebf76b4e4934a9fd6234b93a4b53', 'request_id': 'req-59d213bc-5987-4ff6-8c6e-69b83bb3704f'} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:33.871925 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-59d213bc-5987-4ff6-8c6e-69b83bb3704f admin admin] The token cache is being invalidate because project 6290ebf76b4e4934a9fd6234b93a4b53 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86655) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 10:53:33.872325 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-59d213bc-5987-4ff6-8c6e-69b83bb3704f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:33.873766 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-59d213bc-5987-4ff6-8c6e-69b83bb3704f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:33.875465 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 983/1949] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Jul 14 10:53:33 2022] DELETE /identity/v3/projects/6290ebf76b4e4934a9fd6234b93a4b53 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:53:33.878741 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d213bc-5987-4ff6-8c6e-69b83bb3704f admin admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:33.878741 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-59d213bc-5987-4ff6-8c6e-69b83bb3704f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:33.895112 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:53:33.938996 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb354696-ffb2-4d36-a2e3-a73231621363 admin admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:33.987232 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:53:34.004059 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d213bc-5987-4ff6-8c6e-69b83bb3704f admin admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:34.010690 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5e58b5-6d46-4364-b6bc-e4fa51da9764 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:34.011744 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5e58b5-6d46-4364-b6bc-e4fa51da9764 admin admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:34.012208 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5e58b5-6d46-4364-b6bc-e4fa51da9764 admin admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:34.012860 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5e58b5-6d46-4364-b6bc-e4fa51da9764 admin admin] PATH_INFO: `/v3/roles` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:34.013864 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5e58b5-6d46-4364-b6bc-e4fa51da9764 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:34.014753 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec83277-8209-41c3-9868-07fce6e24cbf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68382432147a48c3b62271fd2a2eab04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59391272ecbe48b0aa736cb43807be1d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:34.015539 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec83277-8209-41c3-9868-07fce6e24cbf service cinder] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:34.015900 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec83277-8209-41c3-9868-07fce6e24cbf service cinder] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:34.016259 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec83277-8209-41c3-9868-07fce6e24cbf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:34.016449 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5e58b5-6d46-4364-b6bc-e4fa51da9764 admin admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:34.018600 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-aec83277-8209-41c3-9868-07fce6e24cbf service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:34.030181 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 984/1950] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jul 14 10:53:33 2022] GET /identity/v3/roles => generated 1420 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:53:34.031400 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5e58b5-6d46-4364-b6bc-e4fa51da9764 admin admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:34.034534 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-ca5e58b5-6d46-4364-b6bc-e4fa51da9764 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:34.055735 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5e58b5-6d46-4364-b6bc-e4fa51da9764 admin admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:34.070914 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b892cf0-dc43-46cd-b3e4-5660c1fda967 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:34.074787 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b892cf0-dc43-46cd-b3e4-5660c1fda967 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:34.074787 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b892cf0-dc43-46cd-b3e4-5660c1fda967 admin admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:34.074787 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b892cf0-dc43-46cd-b3e4-5660c1fda967 admin admin] PATH_INFO: `/v3/users/4bc70bc60d7c40ea9e786eac195fc300` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:34.074787 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b892cf0-dc43-46cd-b3e4-5660c1fda967 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4bc70bc60d7c40ea9e786eac195fc300)` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:34.076551 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b892cf0-dc43-46cd-b3e4-5660c1fda967 admin admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:34.140017 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec83277-8209-41c3-9868-07fce6e24cbf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:34.141676 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec83277-8209-41c3-9868-07fce6e24cbf service cinder] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:34.154690 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 967/1951] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jul 14 10:53:33 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:53:34.155608 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec83277-8209-41c3-9868-07fce6e24cbf service cinder] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:34.168802 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec83277-8209-41c3-9868-07fce6e24cbf service cinder] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:34.176513 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735c3379-d795-4193-a5af-042fa49faa92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:34.177646 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735c3379-d795-4193-a5af-042fa49faa92 admin admin] REQUEST_METHOD: `PUT` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:34.178174 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735c3379-d795-4193-a5af-042fa49faa92 admin admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:34.178313 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735c3379-d795-4193-a5af-042fa49faa92 admin admin] PATH_INFO: `/v3/projects/462cd1b38d634237b6b7747e1399a014/users/11d6a1804f804f9db11c42c314da04f9/roles/0da46c267d354cce81495dfdd56c1ec2` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:34.197735 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-0b892cf0-dc43-46cd-b3e4-5660c1fda967 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4bc70bc60d7c40ea9e786eac195fc300'} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:34.224494 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735c3379-d795-4193-a5af-042fa49faa92 admin admin] RBAC: Authorizing `identity:create_grant(project_id=462cd1b38d634237b6b7747e1399a014, user_id=11d6a1804f804f9db11c42c314da04f9, role_id=0da46c267d354cce81495dfdd56c1ec2)` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:34.225112 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-0b892cf0-dc43-46cd-b3e4-5660c1fda967 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4bc70bc60d7c40ea9e786eac195fc300'} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:34.225854 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-0b892cf0-dc43-46cd-b3e4-5660c1fda967 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4bc70bc60d7c40ea9e786eac195fc300'} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:34.230630 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735c3379-d795-4193-a5af-042fa49faa92 admin admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:34.236317 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-0b892cf0-dc43-46cd-b3e4-5660c1fda967 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4bc70bc60d7c40ea9e786eac195fc300'} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:34.237338 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-0b892cf0-dc43-46cd-b3e4-5660c1fda967 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4bc70bc60d7c40ea9e786eac195fc300'} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:34.262452 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 968/1952] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Jul 14 10:53:34 2022] PUT /identity/v3/projects/462cd1b38d634237b6b7747e1399a014/users/11d6a1804f804f9db11c42c314da04f9/roles/0da46c267d354cce81495dfdd56c1ec2 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:53:34.263616 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735c3379-d795-4193-a5af-042fa49faa92 admin admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:34.276161 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 985/1953] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Jul 14 10:53:34 2022] DELETE /identity/v3/users/4bc70bc60d7c40ea9e786eac195fc300 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:53:34.276338 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-735c3379-d795-4193-a5af-042fa49faa92 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:34.276459 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1821ee-c4fe-4762-abad-b2bbc9252f7c None None] REQUEST_METHOD: `POST` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:34.276459 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1821ee-c4fe-4762-abad-b2bbc9252f7c None None] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:34.276459 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1821ee-c4fe-4762-abad-b2bbc9252f7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:34.334048 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.auth.core [None req-9e1821ee-c4fe-4762-abad-b2bbc9252f7c None None] MFA Rules not processed for user `11d6a1804f804f9db11c42c314da04f9`. Rule list: `[]` (Enabled: `True`). {{(pid=86655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:53:34.337961 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-9e1821ee-c4fe-4762-abad-b2bbc9252f7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:34.415606 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735c3379-d795-4193-a5af-042fa49faa92 admin admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:34.493266 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 986/1954] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jul 14 10:53:34 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:53:34.495908 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1821ee-c4fe-4762-abad-b2bbc9252f7c None None] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:34.498934 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-9e1821ee-c4fe-4762-abad-b2bbc9252f7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:34.507746 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c433ac-3a5c-49b6-b8e7-26839f2df87f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:34.509777 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c433ac-3a5c-49b6-b8e7-26839f2df87f admin admin] REQUEST_METHOD: `DELETE` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:34.510203 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c433ac-3a5c-49b6-b8e7-26839f2df87f admin admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:34.510916 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c433ac-3a5c-49b6-b8e7-26839f2df87f admin admin] PATH_INFO: `/v3/users/558f2e6979fc4d79955b98d50d6fedf0` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:34.514342 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c433ac-3a5c-49b6-b8e7-26839f2df87f admin admin] RBAC: Authorizing `identity:delete_user(user_id=558f2e6979fc4d79955b98d50d6fedf0)` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:34.516728 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c433ac-3a5c-49b6-b8e7-26839f2df87f admin admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:34.517252 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:53:34.529885 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:53:34.601361 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1821ee-c4fe-4762-abad-b2bbc9252f7c None None] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:34.606278 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9eb533f-0155-41ef-8f17-88b210336ccb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:34.607494 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-73c433ac-3a5c-49b6-b8e7-26839f2df87f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '558f2e6979fc4d79955b98d50d6fedf0'} {{(pid=86656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:34.607738 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9eb533f-0155-41ef-8f17-88b210336ccb admin admin] REQUEST_METHOD: `DELETE` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:34.608022 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9eb533f-0155-41ef-8f17-88b210336ccb admin admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:34.608301 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9eb533f-0155-41ef-8f17-88b210336ccb admin admin] PATH_INFO: `/v3/users/cc0686d3f8944283818fdb33c2c3a439` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:34.609570 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9eb533f-0155-41ef-8f17-88b210336ccb admin admin] RBAC: Authorizing `identity:delete_user(user_id=cc0686d3f8944283818fdb33c2c3a439)` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:34.611516 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9eb533f-0155-41ef-8f17-88b210336ccb admin admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:34.624827 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-73c433ac-3a5c-49b6-b8e7-26839f2df87f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '558f2e6979fc4d79955b98d50d6fedf0'} {{(pid=86656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:34.637344 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-73c433ac-3a5c-49b6-b8e7-26839f2df87f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '558f2e6979fc4d79955b98d50d6fedf0'} {{(pid=86656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:34.648209 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-73c433ac-3a5c-49b6-b8e7-26839f2df87f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '558f2e6979fc4d79955b98d50d6fedf0'} {{(pid=86656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:34.649111 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-73c433ac-3a5c-49b6-b8e7-26839f2df87f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '558f2e6979fc4d79955b98d50d6fedf0'} {{(pid=86656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:34.675090 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 969/1955] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Jul 14 10:53:34 2022] DELETE /identity/v3/users/558f2e6979fc4d79955b98d50d6fedf0 => generated 0 bytes in 412 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:53:34.675540 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c433ac-3a5c-49b6-b8e7-26839f2df87f admin admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:34.677028 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-73c433ac-3a5c-49b6-b8e7-26839f2df87f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:34.690021 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-c9eb533f-0155-41ef-8f17-88b210336ccb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cc0686d3f8944283818fdb33c2c3a439'} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:34.699411 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-c9eb533f-0155-41ef-8f17-88b210336ccb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cc0686d3f8944283818fdb33c2c3a439'} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:34.700671 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-c9eb533f-0155-41ef-8f17-88b210336ccb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cc0686d3f8944283818fdb33c2c3a439'} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:34.712346 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-c9eb533f-0155-41ef-8f17-88b210336ccb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cc0686d3f8944283818fdb33c2c3a439'} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:34.713160 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-c9eb533f-0155-41ef-8f17-88b210336ccb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cc0686d3f8944283818fdb33c2c3a439'} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:34.739146 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 987/1956] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Jul 14 10:53:34 2022] DELETE /identity/v3/users/cc0686d3f8944283818fdb33c2c3a439 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:53:34.740328 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9eb533f-0155-41ef-8f17-88b210336ccb admin admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:34.741444 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-c9eb533f-0155-41ef-8f17-88b210336ccb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:34.769540 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c433ac-3a5c-49b6-b8e7-26839f2df87f admin admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:34.823673 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9eb533f-0155-41ef-8f17-88b210336ccb admin admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:34.828543 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fe7fa0-4a3c-41ec-9cc1-949f46b85938 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:34.829263 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fe7fa0-4a3c-41ec-9cc1-949f46b85938 admin admin] REQUEST_METHOD: `POST` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:34.829553 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fe7fa0-4a3c-41ec-9cc1-949f46b85938 admin admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:34.829859 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fe7fa0-4a3c-41ec-9cc1-949f46b85938 admin admin] PATH_INFO: `/v3/projects` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:34.830590 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95fe7fa0-4a3c-41ec-9cc1-949f46b85938 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:34.832204 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245c0c43-5f84-4798-a4d1-52d960561cfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:34.832499 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95fe7fa0-4a3c-41ec-9cc1-949f46b85938 admin admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:34.833121 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245c0c43-5f84-4798-a4d1-52d960561cfc admin admin] REQUEST_METHOD: `DELETE` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:34.833423 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245c0c43-5f84-4798-a4d1-52d960561cfc admin admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:34.833695 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245c0c43-5f84-4798-a4d1-52d960561cfc admin admin] PATH_INFO: `/v3/users/1381e3cf93fa446da8747ed91c3f4ed4` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:34.834946 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245c0c43-5f84-4798-a4d1-52d960561cfc admin admin] RBAC: Authorizing `identity:delete_user(user_id=1381e3cf93fa446da8747ed91c3f4ed4)` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:34.836962 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245c0c43-5f84-4798-a4d1-52d960561cfc admin admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:34.861928 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 988/1957] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Jul 14 10:53:34 2022] POST /identity/v3/projects => generated 373 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:53:34.866563 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6be0564-ad59-49b3-89dd-f8ee77503567 None None] REQUEST_METHOD: `POST` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:34.866924 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6be0564-ad59-49b3-89dd-f8ee77503567 None None] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:34.867213 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6be0564-ad59-49b3-89dd-f8ee77503567 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:34.886819 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:DELETE=15,keystone:SELECT=84,keystone:INSERT=1 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:53:34.894432 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:53:34.897828 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.auth.core [None req-c6be0564-ad59-49b3-89dd-f8ee77503567 None None] MFA Rules not processed for user `56505ea13745436ba9e0d35b7e481732`. Rule list: `[]` (Enabled: `True`). {{(pid=86655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:53:34.900135 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-c6be0564-ad59-49b3-89dd-f8ee77503567 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:34.903463 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-245c0c43-5f84-4798-a4d1-52d960561cfc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1381e3cf93fa446da8747ed91c3f4ed4'} {{(pid=86656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:34.913247 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-245c0c43-5f84-4798-a4d1-52d960561cfc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1381e3cf93fa446da8747ed91c3f4ed4'} {{(pid=86656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:34.913899 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-245c0c43-5f84-4798-a4d1-52d960561cfc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1381e3cf93fa446da8747ed91c3f4ed4'} {{(pid=86656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:34.923979 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-245c0c43-5f84-4798-a4d1-52d960561cfc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1381e3cf93fa446da8747ed91c3f4ed4'} {{(pid=86656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:34.924697 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-245c0c43-5f84-4798-a4d1-52d960561cfc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1381e3cf93fa446da8747ed91c3f4ed4'} {{(pid=86656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:34.949299 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 970/1958] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Jul 14 10:53:34 2022] DELETE /identity/v3/users/1381e3cf93fa446da8747ed91c3f4ed4 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:53:34.949911 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245c0c43-5f84-4798-a4d1-52d960561cfc admin admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:34.953838 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-245c0c43-5f84-4798-a4d1-52d960561cfc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:34.975231 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 989/1959] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jul 14 10:53:34 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:53:34.976660 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f34c29-f0af-4c18-8661-ac93caf59c0e None None] REQUEST_METHOD: `POST` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:34.977048 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f34c29-f0af-4c18-8661-ac93caf59c0e None None] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:34.977674 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f34c29-f0af-4c18-8661-ac93caf59c0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:35.001250 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.auth.core [None req-54f34c29-f0af-4c18-8661-ac93caf59c0e None None] MFA Rules not processed for user `ae4bcdd8106d4bebbdcae96be33505bc`. Rule list: `[]` (Enabled: `True`). {{(pid=86655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:53:35.002571 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-54f34c29-f0af-4c18-8661-ac93caf59c0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:35.030248 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245c0c43-5f84-4798-a4d1-52d960561cfc admin admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:35.035398 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85c2274-d1e6-41f4-9e57-6f9add563075 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:35.036440 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85c2274-d1e6-41f4-9e57-6f9add563075 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:35.036962 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85c2274-d1e6-41f4-9e57-6f9add563075 admin admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:35.037328 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85c2274-d1e6-41f4-9e57-6f9add563075 admin admin] PATH_INFO: `/v3/projects/ac1d0d3dc7de4566b7064c81668c8853` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:35.038631 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85c2274-d1e6-41f4-9e57-6f9add563075 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ac1d0d3dc7de4566b7064c81668c8853)` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:35.040738 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85c2274-d1e6-41f4-9e57-6f9add563075 admin admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:35.075518 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 990/1960] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jul 14 10:53:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:53:35.078567 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23d8d7b-d103-4cbb-9fdd-2236645b0105 None None] REQUEST_METHOD: `POST` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:35.078938 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23d8d7b-d103-4cbb-9fdd-2236645b0105 None None] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:35.079348 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23d8d7b-d103-4cbb-9fdd-2236645b0105 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:35.096275 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-f85c2274-d1e6-41f4-9e57-6f9add563075 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ac1d0d3dc7de4566b7064c81668c8853', 'request_id': 'req-f85c2274-d1e6-41f4-9e57-6f9add563075'} {{(pid=86656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:35.099292 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.auth.core [None req-a23d8d7b-d103-4cbb-9fdd-2236645b0105 None None] MFA Rules not processed for user `ae4bcdd8106d4bebbdcae96be33505bc`. Rule list: `[]` (Enabled: `True`). {{(pid=86655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:53:35.100956 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-a23d8d7b-d103-4cbb-9fdd-2236645b0105 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:35.105291 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-f85c2274-d1e6-41f4-9e57-6f9add563075 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ac1d0d3dc7de4566b7064c81668c8853', 'request_id': 'req-f85c2274-d1e6-41f4-9e57-6f9add563075'} {{(pid=86656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:35.115688 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-f85c2274-d1e6-41f4-9e57-6f9add563075 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ac1d0d3dc7de4566b7064c81668c8853', 'request_id': 'req-f85c2274-d1e6-41f4-9e57-6f9add563075'} {{(pid=86656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:35.125624 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-f85c2274-d1e6-41f4-9e57-6f9add563075 admin admin] The token cache is being invalidate because project ac1d0d3dc7de4566b7064c81668c8853 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86656) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 10:53:35.126042 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-f85c2274-d1e6-41f4-9e57-6f9add563075 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:35.126859 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-f85c2274-d1e6-41f4-9e57-6f9add563075 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:35.133175 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 971/1961] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Jul 14 10:53:34 2022] DELETE /identity/v3/projects/ac1d0d3dc7de4566b7064c81668c8853 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:53:35.133175 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85c2274-d1e6-41f4-9e57-6f9add563075 admin admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:35.134625 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-f85c2274-d1e6-41f4-9e57-6f9add563075 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:35.174029 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 991/1962] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jul 14 10:53:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:53:35.175614 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1963826f-cb7c-44ff-a9eb-0bb90b48c0c4 None None] REQUEST_METHOD: `POST` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:35.175902 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1963826f-cb7c-44ff-a9eb-0bb90b48c0c4 None None] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:35.176176 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1963826f-cb7c-44ff-a9eb-0bb90b48c0c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:35.198274 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:53:35.203898 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.auth.core [None req-1963826f-cb7c-44ff-a9eb-0bb90b48c0c4 None None] MFA Rules not processed for user `ae4bcdd8106d4bebbdcae96be33505bc`. Rule list: `[]` (Enabled: `True`). {{(pid=86655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:53:35.205278 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-1963826f-cb7c-44ff-a9eb-0bb90b48c0c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:35.216943 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 992/1963] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jul 14 10:53:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:53:35.216943 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bb54ba-f164-4ffe-bb3f-f5eb4093ddb6 None None] REQUEST_METHOD: `POST` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:35.216943 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bb54ba-f164-4ffe-bb3f-f5eb4093ddb6 None None] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:35.216943 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bb54ba-f164-4ffe-bb3f-f5eb4093ddb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:35.238100 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.auth.core [None req-b8bb54ba-f164-4ffe-bb3f-f5eb4093ddb6 None None] MFA Rules not processed for user `7a8d60520be840a181ffc48b3811255a`. Rule list: `[]` (Enabled: `True`). {{(pid=86655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:53:35.239412 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-b8bb54ba-f164-4ffe-bb3f-f5eb4093ddb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:35.241040 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85c2274-d1e6-41f4-9e57-6f9add563075 admin admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:35.247513 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da781322-a214-4c26-b630-856384c511db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:35.248159 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da781322-a214-4c26-b630-856384c511db admin admin] REQUEST_METHOD: `POST` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:35.248534 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da781322-a214-4c26-b630-856384c511db admin admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:35.248927 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da781322-a214-4c26-b630-856384c511db admin admin] PATH_INFO: `/v3/users` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:35.249719 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da781322-a214-4c26-b630-856384c511db admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:35.254493 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da781322-a214-4c26-b630-856384c511db admin admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:35.276706 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=100 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:53:35.290727 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 972/1964] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Jul 14 10:53:35 2022] POST /identity/v3/users => generated 293 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:53:35.292016 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da781322-a214-4c26-b630-856384c511db admin admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:35.293886 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-da781322-a214-4c26-b630-856384c511db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:35.328084 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 993/1965] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jul 14 10:53:35 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:53:35.328084 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812653c7-a88d-49a6-9f3d-c46ebf0477c9 None None] REQUEST_METHOD: `POST` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:35.328084 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812653c7-a88d-49a6-9f3d-c46ebf0477c9 None None] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:35.328084 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812653c7-a88d-49a6-9f3d-c46ebf0477c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:35.356571 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.auth.core [None req-812653c7-a88d-49a6-9f3d-c46ebf0477c9 None None] MFA Rules not processed for user `ae4bcdd8106d4bebbdcae96be33505bc`. Rule list: `[]` (Enabled: `True`). {{(pid=86655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:53:35.358420 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-812653c7-a88d-49a6-9f3d-c46ebf0477c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:35.369508 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 994/1966] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jul 14 10:53:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:53:35.370919 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812653c7-a88d-49a6-9f3d-c46ebf0477c9 None None] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:35.373162 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-812653c7-a88d-49a6-9f3d-c46ebf0477c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:35.393318 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da781322-a214-4c26-b630-856384c511db admin admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:35.399036 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52259ac-8f09-44ff-a06b-f19c8275afce service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dddf93691844886982c91fea974385d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59391272ecbe48b0aa736cb43807be1d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:35.399832 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52259ac-8f09-44ff-a06b-f19c8275afce service neutron] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:35.400116 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52259ac-8f09-44ff-a06b-f19c8275afce service neutron] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:35.400394 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52259ac-8f09-44ff-a06b-f19c8275afce service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:35.402323 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-b52259ac-8f09-44ff-a06b-f19c8275afce service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:35.419040 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52259ac-8f09-44ff-a06b-f19c8275afce service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:35.421045 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52259ac-8f09-44ff-a06b-f19c8275afce service neutron] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:35.434633 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 973/1967] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jul 14 10:53:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:53:35.436711 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52259ac-8f09-44ff-a06b-f19c8275afce service neutron] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:35.452954 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52259ac-8f09-44ff-a06b-f19c8275afce service neutron] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:35.456931 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de8bd5f-6e05-4abf-bcab-29431155f734 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dddf93691844886982c91fea974385d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59391272ecbe48b0aa736cb43807be1d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:35.457736 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de8bd5f-6e05-4abf-bcab-29431155f734 service neutron] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:35.458025 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de8bd5f-6e05-4abf-bcab-29431155f734 service neutron] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:35.458307 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de8bd5f-6e05-4abf-bcab-29431155f734 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:35.469035 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de8bd5f-6e05-4abf-bcab-29431155f734 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:35.470493 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de8bd5f-6e05-4abf-bcab-29431155f734 service neutron] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:35.481428 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 974/1968] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jul 14 10:53:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:53:35.481715 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812653c7-a88d-49a6-9f3d-c46ebf0477c9 None None] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:35.483015 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de8bd5f-6e05-4abf-bcab-29431155f734 service neutron] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:35.486669 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7592fc-6e0e-474f-a815-3143ffc7a997 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dddf93691844886982c91fea974385d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59391272ecbe48b0aa736cb43807be1d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:35.487399 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7592fc-6e0e-474f-a815-3143ffc7a997 service neutron] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:35.487757 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7592fc-6e0e-474f-a815-3143ffc7a997 service neutron] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:35.488099 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7592fc-6e0e-474f-a815-3143ffc7a997 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:35.493363 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de8bd5f-6e05-4abf-bcab-29431155f734 service neutron] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:35.498124 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7592fc-6e0e-474f-a815-3143ffc7a997 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:35.498961 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c4ac89-97f2-4f20-81fe-85ab8a151fb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:35.499687 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c4ac89-97f2-4f20-81fe-85ab8a151fb7 admin admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:35.500029 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c4ac89-97f2-4f20-81fe-85ab8a151fb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:35.500149 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7592fc-6e0e-474f-a815-3143ffc7a997 service neutron] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:35.500369 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c4ac89-97f2-4f20-81fe-85ab8a151fb7 admin admin] PATH_INFO: `/v3/roles` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:35.501280 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c4ac89-97f2-4f20-81fe-85ab8a151fb7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:35.503282 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c4ac89-97f2-4f20-81fe-85ab8a151fb7 admin admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:35.513293 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 995/1969] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jul 14 10:53:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:53:35.515258 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81582226-44a7-4793-8842-5c06a8a20d77 None None] REQUEST_METHOD: `POST` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:35.515605 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 975/1970] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jul 14 10:53:35 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:53:35.515721 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81582226-44a7-4793-8842-5c06a8a20d77 None None] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:35.516081 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81582226-44a7-4793-8842-5c06a8a20d77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:35.519967 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c4ac89-97f2-4f20-81fe-85ab8a151fb7 admin admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:35.521870 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-d7c4ac89-97f2-4f20-81fe-85ab8a151fb7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:35.545530 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.auth.core [None req-81582226-44a7-4793-8842-5c06a8a20d77 None None] MFA Rules not processed for user `ae4bcdd8106d4bebbdcae96be33505bc`. Rule list: `[]` (Enabled: `True`). {{(pid=86655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:53:35.546942 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-81582226-44a7-4793-8842-5c06a8a20d77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:35.557438 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 996/1971] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jul 14 10:53:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:53:35.562235 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81582226-44a7-4793-8842-5c06a8a20d77 None None] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:35.581006 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81582226-44a7-4793-8842-5c06a8a20d77 None None] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:35.586862 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4409848e-3c72-453e-9b12-69b75e645d8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:35.588097 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4409848e-3c72-453e-9b12-69b75e645d8b admin admin] REQUEST_METHOD: `PUT` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:35.588477 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4409848e-3c72-453e-9b12-69b75e645d8b admin admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:35.588943 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4409848e-3c72-453e-9b12-69b75e645d8b admin admin] PATH_INFO: `/v3/projects/8e3f0f6e8b8a4b3cb3e889b5dc618356/users/b541528c5f8c4ce4bc6d92bce3e8c46b/roles/153539819e5542df99269d2913bbecfb` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:35.613938 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4409848e-3c72-453e-9b12-69b75e645d8b admin admin] RBAC: Authorizing `identity:create_grant(project_id=8e3f0f6e8b8a4b3cb3e889b5dc618356, user_id=b541528c5f8c4ce4bc6d92bce3e8c46b, role_id=153539819e5542df99269d2913bbecfb)` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:35.616803 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4409848e-3c72-453e-9b12-69b75e645d8b admin admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:35.634250 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 997/1972] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Jul 14 10:53:35 2022] PUT /identity/v3/projects/8e3f0f6e8b8a4b3cb3e889b5dc618356/users/b541528c5f8c4ce4bc6d92bce3e8c46b/roles/153539819e5542df99269d2913bbecfb => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:53:35.637067 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4409848e-3c72-453e-9b12-69b75e645d8b admin admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:35.638708 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c4ac89-97f2-4f20-81fe-85ab8a151fb7 admin admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:35.703225 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:53:35.712603 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4409848e-3c72-453e-9b12-69b75e645d8b admin admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:35.717862 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413c6618-1d58-4fb3-84cc-aac44b742961 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:35.719279 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413c6618-1d58-4fb3-84cc-aac44b742961 admin admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:35.719644 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413c6618-1d58-4fb3-84cc-aac44b742961 admin admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:35.719995 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413c6618-1d58-4fb3-84cc-aac44b742961 admin admin] PATH_INFO: `/v3/domains` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:35.720847 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413c6618-1d58-4fb3-84cc-aac44b742961 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:53:35.721233 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413c6618-1d58-4fb3-84cc-aac44b742961 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:35.722962 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413c6618-1d58-4fb3-84cc-aac44b742961 admin admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:35.726859 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6d344a-4784-44d5-a62f-7d90c3015d5d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26aa294c913c408499a913ec25bb677d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59391272ecbe48b0aa736cb43807be1d', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:35.727527 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6d344a-4784-44d5-a62f-7d90c3015d5d service nova] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:35.727833 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6d344a-4784-44d5-a62f-7d90c3015d5d service nova] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:35.728113 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6d344a-4784-44d5-a62f-7d90c3015d5d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:35.729952 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-6f6d344a-4784-44d5-a62f-7d90c3015d5d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:35.738974 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 998/1973] 10.222.0.16 () {58 vars in 1152 bytes} [Thu Jul 14 10:53:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:53:35.738974 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413c6618-1d58-4fb3-84cc-aac44b742961 admin admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:35.753962 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413c6618-1d58-4fb3-84cc-aac44b742961 admin admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:35.760013 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f18b15-f2a5-4ab5-8d6d-e36f3f2e718a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:35.760836 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f18b15-f2a5-4ab5-8d6d-e36f3f2e718a admin admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:35.761521 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f18b15-f2a5-4ab5-8d6d-e36f3f2e718a admin admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:35.761521 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f18b15-f2a5-4ab5-8d6d-e36f3f2e718a admin admin] PATH_INFO: `/v3/roles` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:35.762158 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f18b15-f2a5-4ab5-8d6d-e36f3f2e718a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:35.764315 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f18b15-f2a5-4ab5-8d6d-e36f3f2e718a admin admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:35.776302 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 999/1974] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jul 14 10:53:35 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:53:35.777178 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f18b15-f2a5-4ab5-8d6d-e36f3f2e718a admin admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:35.791307 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f18b15-f2a5-4ab5-8d6d-e36f3f2e718a admin admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:35.803846 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36736836-583b-4562-aae5-f3910e2b2c6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:35.804606 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36736836-583b-4562-aae5-f3910e2b2c6d admin admin] REQUEST_METHOD: `POST` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:35.804981 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36736836-583b-4562-aae5-f3910e2b2c6d admin admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:35.805331 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36736836-583b-4562-aae5-f3910e2b2c6d admin admin] PATH_INFO: `/v3/projects` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:35.806699 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36736836-583b-4562-aae5-f3910e2b2c6d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:35.808983 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36736836-583b-4562-aae5-f3910e2b2c6d admin admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:35.810888 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6d344a-4784-44d5-a62f-7d90c3015d5d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:35.812762 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6d344a-4784-44d5-a62f-7d90c3015d5d service nova] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:35.823293 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 976/1975] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jul 14 10:53:35 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:53:35.824015 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6d344a-4784-44d5-a62f-7d90c3015d5d service nova] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:35.836503 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6d344a-4784-44d5-a62f-7d90c3015d5d service nova] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:35.841365 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 1000/1976] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Jul 14 10:53:35 2022] POST /identity/v3/projects => generated 367 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:53:35.844918 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f66ba0-1445-4618-b5ed-e9c33f818ccf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:35.845263 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36736836-583b-4562-aae5-f3910e2b2c6d admin admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:35.845845 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f66ba0-1445-4618-b5ed-e9c33f818ccf admin admin] REQUEST_METHOD: `PUT` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:35.846137 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f66ba0-1445-4618-b5ed-e9c33f818ccf admin admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:35.846466 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f66ba0-1445-4618-b5ed-e9c33f818ccf admin admin] PATH_INFO: `/v3/projects/8e3f0f6e8b8a4b3cb3e889b5dc618356/users/b541528c5f8c4ce4bc6d92bce3e8c46b/roles/153539819e5542df99269d2913bbecfb` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:35.849092 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f66ba0-1445-4618-b5ed-e9c33f818ccf admin admin] RBAC: Authorizing `identity:create_grant(project_id=8e3f0f6e8b8a4b3cb3e889b5dc618356, user_id=b541528c5f8c4ce4bc6d92bce3e8c46b, role_id=153539819e5542df99269d2913bbecfb)` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:35.852165 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:53:35.852826 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f66ba0-1445-4618-b5ed-e9c33f818ccf admin admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:35.880006 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 977/1977] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Jul 14 10:53:35 2022] PUT /identity/v3/projects/8e3f0f6e8b8a4b3cb3e889b5dc618356/users/b541528c5f8c4ce4bc6d92bce3e8c46b/roles/153539819e5542df99269d2913bbecfb => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:53:35.882033 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a1138d-cb6f-458c-b991-cf33a084880f None None] REQUEST_METHOD: `POST` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:35.882335 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a1138d-cb6f-458c-b991-cf33a084880f None None] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:35.882731 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a1138d-cb6f-458c-b991-cf33a084880f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:35.917793 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.auth.core [None req-97a1138d-cb6f-458c-b991-cf33a084880f None None] MFA Rules not processed for user `b541528c5f8c4ce4bc6d92bce3e8c46b`. Rule list: `[]` (Enabled: `True`). {{(pid=86656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:53:35.919959 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-97a1138d-cb6f-458c-b991-cf33a084880f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:35.949206 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36736836-583b-4562-aae5-f3910e2b2c6d admin admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:36.025577 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 978/1978] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jul 14 10:53:35 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 10:53:36.042695 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b88b835-5dad-4dbf-a2cd-9d45d771e5ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:36.043161 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a1138d-cb6f-458c-b991-cf33a084880f None None] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:36.043455 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b88b835-5dad-4dbf-a2cd-9d45d771e5ba admin admin] REQUEST_METHOD: `POST` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:36.044843 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b88b835-5dad-4dbf-a2cd-9d45d771e5ba admin admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:36.045278 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b88b835-5dad-4dbf-a2cd-9d45d771e5ba admin admin] PATH_INFO: `/v3/users` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:36.046197 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b88b835-5dad-4dbf-a2cd-9d45d771e5ba admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:36.047308 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-97a1138d-cb6f-458c-b991-cf33a084880f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:36.048371 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b88b835-5dad-4dbf-a2cd-9d45d771e5ba admin admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:36.079664 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 1001/1979] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Jul 14 10:53:35 2022] POST /identity/v3/users => generated 284 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 10:53:36.083439 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b88b835-5dad-4dbf-a2cd-9d45d771e5ba admin admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:36.101310 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b88b835-5dad-4dbf-a2cd-9d45d771e5ba admin admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:36.108117 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8d02ef-9ac8-4510-b690-6225e74dde0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:36.108823 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8d02ef-9ac8-4510-b690-6225e74dde0e admin admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:36.109120 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8d02ef-9ac8-4510-b690-6225e74dde0e admin admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:36.109401 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8d02ef-9ac8-4510-b690-6225e74dde0e admin admin] PATH_INFO: `/v3/roles` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:36.110152 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8d02ef-9ac8-4510-b690-6225e74dde0e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:36.111775 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8d02ef-9ac8-4510-b690-6225e74dde0e admin admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:36.134982 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 1002/1980] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jul 14 10:53:36 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:53:36.139539 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8d02ef-9ac8-4510-b690-6225e74dde0e admin admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:36.143223 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a1138d-cb6f-458c-b991-cf33a084880f None None] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:36.147270 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20ab0c9-7914-47b2-9d1a-bb5f0fab5a80 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68382432147a48c3b62271fd2a2eab04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59391272ecbe48b0aa736cb43807be1d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:36.148080 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20ab0c9-7914-47b2-9d1a-bb5f0fab5a80 service cinder] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:36.148614 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20ab0c9-7914-47b2-9d1a-bb5f0fab5a80 service cinder] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:36.148991 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20ab0c9-7914-47b2-9d1a-bb5f0fab5a80 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:36.151765 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8d02ef-9ac8-4510-b690-6225e74dde0e admin admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:36.151986 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-c20ab0c9-7914-47b2-9d1a-bb5f0fab5a80 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:36.158130 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e30362f-15d0-4238-a6cd-3812c0af5331 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:36.159178 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e30362f-15d0-4238-a6cd-3812c0af5331 admin admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:36.159538 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e30362f-15d0-4238-a6cd-3812c0af5331 admin admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:36.159887 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e30362f-15d0-4238-a6cd-3812c0af5331 admin admin] PATH_INFO: `/v3/roles` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:36.160697 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e30362f-15d0-4238-a6cd-3812c0af5331 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:36.162498 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e30362f-15d0-4238-a6cd-3812c0af5331 admin admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:36.169363 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:53:36.181656 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 1003/1981] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jul 14 10:53:36 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:53:36.182758 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e30362f-15d0-4238-a6cd-3812c0af5331 admin admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:36.196648 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e30362f-15d0-4238-a6cd-3812c0af5331 admin admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:36.219741 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e8137d-150f-4f2d-85c1-ba864a2ec8a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:36.222078 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e8137d-150f-4f2d-85c1-ba864a2ec8a6 admin admin] REQUEST_METHOD: `PUT` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:36.222479 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e8137d-150f-4f2d-85c1-ba864a2ec8a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:36.222878 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e8137d-150f-4f2d-85c1-ba864a2ec8a6 admin admin] PATH_INFO: `/v3/projects/136516421a45480ebf5e92b09ebecfdd/users/ccccf90e7c334aad9deca934f10c1a03/roles/0da46c267d354cce81495dfdd56c1ec2` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:36.258958 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e8137d-150f-4f2d-85c1-ba864a2ec8a6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=136516421a45480ebf5e92b09ebecfdd, user_id=ccccf90e7c334aad9deca934f10c1a03, role_id=0da46c267d354cce81495dfdd56c1ec2)` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:36.262970 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e8137d-150f-4f2d-85c1-ba864a2ec8a6 admin admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:36.264913 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20ab0c9-7914-47b2-9d1a-bb5f0fab5a80 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:36.267467 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20ab0c9-7914-47b2-9d1a-bb5f0fab5a80 service cinder] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:36.281741 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 979/1982] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jul 14 10:53:36 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 239 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 10:53:36.283628 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20ab0c9-7914-47b2-9d1a-bb5f0fab5a80 service cinder] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:36.287862 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-c20ab0c9-7914-47b2-9d1a-bb5f0fab5a80 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:36.299531 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 1004/1983] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Jul 14 10:53:36 2022] PUT /identity/v3/projects/136516421a45480ebf5e92b09ebecfdd/users/ccccf90e7c334aad9deca934f10c1a03/roles/0da46c267d354cce81495dfdd56c1ec2 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:53:36.301192 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cc9383-ce9f-4f31-b1b5-ea1bef44325f None None] REQUEST_METHOD: `POST` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:36.301409 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cc9383-ce9f-4f31-b1b5-ea1bef44325f None None] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:36.301691 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cc9383-ce9f-4f31-b1b5-ea1bef44325f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:36.334070 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20ab0c9-7914-47b2-9d1a-bb5f0fab5a80 service cinder] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:36.386262 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.auth.core [None req-28cc9383-ce9f-4f31-b1b5-ea1bef44325f None None] MFA Rules not processed for user `ccccf90e7c334aad9deca934f10c1a03`. Rule list: `[]` (Enabled: `True`). {{(pid=86655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:53:36.387487 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-28cc9383-ce9f-4f31-b1b5-ea1bef44325f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:36.432814 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7950c011-55b6-4c5e-a5ef-acbe98f4a5d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:36.433852 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7950c011-55b6-4c5e-a5ef-acbe98f4a5d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:36.434290 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7950c011-55b6-4c5e-a5ef-acbe98f4a5d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:36.435609 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7950c011-55b6-4c5e-a5ef-acbe98f4a5d3 admin admin] PATH_INFO: `/v3/projects/24c3d6f578174d40a62243569dcaaeca` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:36.437509 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7950c011-55b6-4c5e-a5ef-acbe98f4a5d3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=24c3d6f578174d40a62243569dcaaeca)` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:36.440214 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7950c011-55b6-4c5e-a5ef-acbe98f4a5d3 admin admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:36.511286 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:53:36.521044 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-7950c011-55b6-4c5e-a5ef-acbe98f4a5d3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '24c3d6f578174d40a62243569dcaaeca', 'request_id': 'req-7950c011-55b6-4c5e-a5ef-acbe98f4a5d3'} {{(pid=86656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:36.533541 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-7950c011-55b6-4c5e-a5ef-acbe98f4a5d3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '24c3d6f578174d40a62243569dcaaeca', 'request_id': 'req-7950c011-55b6-4c5e-a5ef-acbe98f4a5d3'} {{(pid=86656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:36.547343 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 1005/1984] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jul 14 10:53:36 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:53:36.553806 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cc9383-ce9f-4f31-b1b5-ea1bef44325f None None] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:36.554316 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-7950c011-55b6-4c5e-a5ef-acbe98f4a5d3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '24c3d6f578174d40a62243569dcaaeca', 'request_id': 'req-7950c011-55b6-4c5e-a5ef-acbe98f4a5d3'} {{(pid=86656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:36.569605 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cc9383-ce9f-4f31-b1b5-ea1bef44325f None None] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:36.587873 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-7950c011-55b6-4c5e-a5ef-acbe98f4a5d3 admin admin] The token cache is being invalidate because project 24c3d6f578174d40a62243569dcaaeca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86656) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 10:53:36.588170 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-7950c011-55b6-4c5e-a5ef-acbe98f4a5d3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:36.600228 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-7950c011-55b6-4c5e-a5ef-acbe98f4a5d3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:36.604993 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 980/1985] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Jul 14 10:53:36 2022] DELETE /identity/v3/projects/24c3d6f578174d40a62243569dcaaeca => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:53:36.606239 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7950c011-55b6-4c5e-a5ef-acbe98f4a5d3 admin admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:36.608708 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-7950c011-55b6-4c5e-a5ef-acbe98f4a5d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:36.679950 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4867749c-0a5c-4991-b8f2-61326dcd5672 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:36.681166 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4867749c-0a5c-4991-b8f2-61326dcd5672 admin admin] REQUEST_METHOD: `POST` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:36.682295 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4867749c-0a5c-4991-b8f2-61326dcd5672 admin admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:36.683090 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4867749c-0a5c-4991-b8f2-61326dcd5672 admin admin] PATH_INFO: `/v3/projects` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:36.684233 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4867749c-0a5c-4991-b8f2-61326dcd5672 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:36.686860 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4867749c-0a5c-4991-b8f2-61326dcd5672 admin admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:36.729006 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:53:36.739880 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 1006/1986] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Jul 14 10:53:36 2022] POST /identity/v3/projects => generated 369 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 10:53:36.741633 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4867749c-0a5c-4991-b8f2-61326dcd5672 admin admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:36.745011 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-4867749c-0a5c-4991-b8f2-61326dcd5672 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:36.788741 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7950c011-55b6-4c5e-a5ef-acbe98f4a5d3 admin admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:36.835604 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4867749c-0a5c-4991-b8f2-61326dcd5672 admin admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:36.849231 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e89a23-0740-4c9a-973a-7ce6731ae33a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:36.850012 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e89a23-0740-4c9a-973a-7ce6731ae33a admin admin] REQUEST_METHOD: `POST` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:36.850403 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e89a23-0740-4c9a-973a-7ce6731ae33a admin admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:36.850783 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e89a23-0740-4c9a-973a-7ce6731ae33a admin admin] PATH_INFO: `/v3/users` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:36.851697 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e89a23-0740-4c9a-973a-7ce6731ae33a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:36.853937 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e89a23-0740-4c9a-973a-7ce6731ae33a admin admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:36.890623 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 1007/1987] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Jul 14 10:53:36 2022] POST /identity/v3/users => generated 291 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:53:36.891849 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e89a23-0740-4c9a-973a-7ce6731ae33a admin admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:36.893700 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-a2e89a23-0740-4c9a-973a-7ce6731ae33a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:36.909960 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4aa1de3-afd0-4764-8a9a-fadbc4cb45fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:36.910967 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4aa1de3-afd0-4764-8a9a-fadbc4cb45fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:36.911322 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4aa1de3-afd0-4764-8a9a-fadbc4cb45fc admin admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:36.911663 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4aa1de3-afd0-4764-8a9a-fadbc4cb45fc admin admin] PATH_INFO: `/v3/users/9af1e4f780b044afa682d10f986104ef` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:36.912557 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e89a23-0740-4c9a-973a-7ce6731ae33a admin admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:36.913719 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4aa1de3-afd0-4764-8a9a-fadbc4cb45fc admin admin] RBAC: Authorizing `identity:delete_user(user_id=9af1e4f780b044afa682d10f986104ef)` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:36.916143 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4aa1de3-afd0-4764-8a9a-fadbc4cb45fc admin admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:36.920592 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e6ea53-b39e-4cd9-994e-5bc22256dbb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:36.922007 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e6ea53-b39e-4cd9-994e-5bc22256dbb8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:36.922250 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e6ea53-b39e-4cd9-994e-5bc22256dbb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:36.922536 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e6ea53-b39e-4cd9-994e-5bc22256dbb8 admin admin] PATH_INFO: `/v3/projects/a9a8d67b0f6f4bedb4887fab80753846` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:36.926241 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e6ea53-b39e-4cd9-994e-5bc22256dbb8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a9a8d67b0f6f4bedb4887fab80753846)` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:36.928852 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e6ea53-b39e-4cd9-994e-5bc22256dbb8 admin admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:37.015035 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-b4aa1de3-afd0-4764-8a9a-fadbc4cb45fc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9af1e4f780b044afa682d10f986104ef'} {{(pid=86656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:37.031902 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-44e6ea53-b39e-4cd9-994e-5bc22256dbb8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a9a8d67b0f6f4bedb4887fab80753846', 'request_id': 'req-44e6ea53-b39e-4cd9-994e-5bc22256dbb8'} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:37.035345 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-b4aa1de3-afd0-4764-8a9a-fadbc4cb45fc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9af1e4f780b044afa682d10f986104ef'} {{(pid=86656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:37.036410 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-b4aa1de3-afd0-4764-8a9a-fadbc4cb45fc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9af1e4f780b044afa682d10f986104ef'} {{(pid=86656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:37.041206 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=91,keystone:INSERT=4,keystone:DELETE=5 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:53:37.045607 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-44e6ea53-b39e-4cd9-994e-5bc22256dbb8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a9a8d67b0f6f4bedb4887fab80753846', 'request_id': 'req-44e6ea53-b39e-4cd9-994e-5bc22256dbb8'} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:37.050139 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-b4aa1de3-afd0-4764-8a9a-fadbc4cb45fc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9af1e4f780b044afa682d10f986104ef'} {{(pid=86656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:37.051850 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-b4aa1de3-afd0-4764-8a9a-fadbc4cb45fc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9af1e4f780b044afa682d10f986104ef'} {{(pid=86656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:37.094320 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-44e6ea53-b39e-4cd9-994e-5bc22256dbb8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a9a8d67b0f6f4bedb4887fab80753846', 'request_id': 'req-44e6ea53-b39e-4cd9-994e-5bc22256dbb8'} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:37.105475 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 981/1988] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Jul 14 10:53:36 2022] DELETE /identity/v3/users/9af1e4f780b044afa682d10f986104ef => generated 0 bytes in 500 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 10:53:37.108978 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4aa1de3-afd0-4764-8a9a-fadbc4cb45fc admin admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:37.113872 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-b4aa1de3-afd0-4764-8a9a-fadbc4cb45fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:37.136383 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-44e6ea53-b39e-4cd9-994e-5bc22256dbb8 admin admin] The token cache is being invalidate because project a9a8d67b0f6f4bedb4887fab80753846 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86655) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 10:53:37.136685 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-44e6ea53-b39e-4cd9-994e-5bc22256dbb8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:37.137433 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-44e6ea53-b39e-4cd9-994e-5bc22256dbb8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:37.143040 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 1008/1989] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Jul 14 10:53:36 2022] DELETE /identity/v3/projects/a9a8d67b0f6f4bedb4887fab80753846 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:53:37.144943 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e6ea53-b39e-4cd9-994e-5bc22256dbb8 admin admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:37.147648 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-44e6ea53-b39e-4cd9-994e-5bc22256dbb8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:37.253635 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e6ea53-b39e-4cd9-994e-5bc22256dbb8 admin admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:37.272321 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4aa1de3-afd0-4764-8a9a-fadbc4cb45fc admin admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:37.273268 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4064e59e-56e2-4cd0-914a-0d8ec6921e95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:37.274317 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4064e59e-56e2-4cd0-914a-0d8ec6921e95 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:37.274602 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4064e59e-56e2-4cd0-914a-0d8ec6921e95 admin admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:37.274883 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4064e59e-56e2-4cd0-914a-0d8ec6921e95 admin admin] PATH_INFO: `/v3/users/312cfe8eab7f45d7a74ad2d5808ccc48` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:37.279372 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4064e59e-56e2-4cd0-914a-0d8ec6921e95 admin admin] RBAC: Authorizing `identity:delete_user(user_id=312cfe8eab7f45d7a74ad2d5808ccc48)` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:37.281390 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4064e59e-56e2-4cd0-914a-0d8ec6921e95 admin admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:37.287812 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349cdea5-18e9-43aa-a725-7e6b346b9819 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:37.288448 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349cdea5-18e9-43aa-a725-7e6b346b9819 admin admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:37.288766 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349cdea5-18e9-43aa-a725-7e6b346b9819 admin admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:37.289193 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349cdea5-18e9-43aa-a725-7e6b346b9819 admin admin] PATH_INFO: `/v3/roles` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:37.289955 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349cdea5-18e9-43aa-a725-7e6b346b9819 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:37.291726 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349cdea5-18e9-43aa-a725-7e6b346b9819 admin admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:37.322096 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 982/1990] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jul 14 10:53:37 2022] GET /identity/v3/roles => generated 1420 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:53:37.323017 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349cdea5-18e9-43aa-a725-7e6b346b9819 admin admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:37.326987 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-349cdea5-18e9-43aa-a725-7e6b346b9819 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:37.355572 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349cdea5-18e9-43aa-a725-7e6b346b9819 admin admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:37.364017 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feda8100-cb9f-4392-a1a2-3e1e0007642f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:37.365082 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feda8100-cb9f-4392-a1a2-3e1e0007642f admin admin] REQUEST_METHOD: `PUT` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:37.365381 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feda8100-cb9f-4392-a1a2-3e1e0007642f admin admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:37.365674 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feda8100-cb9f-4392-a1a2-3e1e0007642f admin admin] PATH_INFO: `/v3/projects/c1413590403a4e9892ad3b5101e3279d/users/8559443189ee4f55b80900b99dddd9d4/roles/153539819e5542df99269d2913bbecfb` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:37.368883 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:53:37.394348 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-4064e59e-56e2-4cd0-914a-0d8ec6921e95 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '312cfe8eab7f45d7a74ad2d5808ccc48'} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:37.395959 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feda8100-cb9f-4392-a1a2-3e1e0007642f admin admin] RBAC: Authorizing `identity:create_grant(project_id=c1413590403a4e9892ad3b5101e3279d, user_id=8559443189ee4f55b80900b99dddd9d4, role_id=153539819e5542df99269d2913bbecfb)` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:37.403155 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feda8100-cb9f-4392-a1a2-3e1e0007642f admin admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:37.405302 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-4064e59e-56e2-4cd0-914a-0d8ec6921e95 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '312cfe8eab7f45d7a74ad2d5808ccc48'} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:37.406267 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-4064e59e-56e2-4cd0-914a-0d8ec6921e95 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '312cfe8eab7f45d7a74ad2d5808ccc48'} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:37.421755 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-4064e59e-56e2-4cd0-914a-0d8ec6921e95 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '312cfe8eab7f45d7a74ad2d5808ccc48'} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:37.423144 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-4064e59e-56e2-4cd0-914a-0d8ec6921e95 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '312cfe8eab7f45d7a74ad2d5808ccc48'} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:37.432662 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 983/1991] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Jul 14 10:53:37 2022] PUT /identity/v3/projects/c1413590403a4e9892ad3b5101e3279d/users/8559443189ee4f55b80900b99dddd9d4/roles/153539819e5542df99269d2913bbecfb => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:53:37.433647 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feda8100-cb9f-4392-a1a2-3e1e0007642f admin admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:37.437090 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-feda8100-cb9f-4392-a1a2-3e1e0007642f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:37.462692 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 1009/1992] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Jul 14 10:53:37 2022] DELETE /identity/v3/users/312cfe8eab7f45d7a74ad2d5808ccc48 => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:53:37.463847 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4064e59e-56e2-4cd0-914a-0d8ec6921e95 admin admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:37.470264 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-4064e59e-56e2-4cd0-914a-0d8ec6921e95 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:37.610579 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feda8100-cb9f-4392-a1a2-3e1e0007642f admin admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:37.670112 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4064e59e-56e2-4cd0-914a-0d8ec6921e95 admin admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:37.684288 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eda5bbf-e2ed-4216-ba20-bb8bff597832 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:37.686024 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eda5bbf-e2ed-4216-ba20-bb8bff597832 admin admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:37.686472 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eda5bbf-e2ed-4216-ba20-bb8bff597832 admin admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:37.687854 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eda5bbf-e2ed-4216-ba20-bb8bff597832 admin admin] PATH_INFO: `/v3/roles` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:37.688982 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eda5bbf-e2ed-4216-ba20-bb8bff597832 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:37.691094 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eda5bbf-e2ed-4216-ba20-bb8bff597832 admin admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:37.705214 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:DELETE=12,keystone:SELECT=86,keystone:INSERT=2 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:53:37.722112 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 1010/1993] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jul 14 10:53:37 2022] GET /identity/v3/roles => generated 1420 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:53:37.726542 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eda5bbf-e2ed-4216-ba20-bb8bff597832 admin admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:37.740567 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eda5bbf-e2ed-4216-ba20-bb8bff597832 admin admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:37.741491 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caded77c-01f3-41b3-9894-ba4445a3d7ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:37.742494 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caded77c-01f3-41b3-9894-ba4445a3d7ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:37.743145 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caded77c-01f3-41b3-9894-ba4445a3d7ec admin admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:37.743145 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caded77c-01f3-41b3-9894-ba4445a3d7ec admin admin] PATH_INFO: `/v3/projects/82adf628cb3340f28896e12df0694024` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:37.744874 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caded77c-01f3-41b3-9894-ba4445a3d7ec admin admin] RBAC: Authorizing `identity:delete_project(project_id=82adf628cb3340f28896e12df0694024)` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:37.747088 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caded77c-01f3-41b3-9894-ba4445a3d7ec admin admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:37.749785 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6786a9-71ff-4fe3-9aa0-630a911047ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:37.750702 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6786a9-71ff-4fe3-9aa0-630a911047ac admin admin] REQUEST_METHOD: `PUT` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:37.751020 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6786a9-71ff-4fe3-9aa0-630a911047ac admin admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:37.751278 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6786a9-71ff-4fe3-9aa0-630a911047ac admin admin] PATH_INFO: `/v3/projects/c1413590403a4e9892ad3b5101e3279d/users/8559443189ee4f55b80900b99dddd9d4/roles/153539819e5542df99269d2913bbecfb` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:37.754087 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6786a9-71ff-4fe3-9aa0-630a911047ac admin admin] RBAC: Authorizing `identity:create_grant(project_id=c1413590403a4e9892ad3b5101e3279d, user_id=8559443189ee4f55b80900b99dddd9d4, role_id=153539819e5542df99269d2913bbecfb)` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:37.757511 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6786a9-71ff-4fe3-9aa0-630a911047ac admin admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:37.771608 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 1011/1994] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Jul 14 10:53:37 2022] PUT /identity/v3/projects/c1413590403a4e9892ad3b5101e3279d/users/8559443189ee4f55b80900b99dddd9d4/roles/153539819e5542df99269d2913bbecfb => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 10:53:37.781975 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71baaff8-2459-4af6-9729-05a35b3ad141 None None] REQUEST_METHOD: `POST` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:37.782388 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71baaff8-2459-4af6-9729-05a35b3ad141 None None] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:37.783290 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71baaff8-2459-4af6-9729-05a35b3ad141 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:37.817551 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.auth.core [None req-71baaff8-2459-4af6-9729-05a35b3ad141 None None] MFA Rules not processed for user `8559443189ee4f55b80900b99dddd9d4`. Rule list: `[]` (Enabled: `True`). {{(pid=86655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:53:37.819224 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-71baaff8-2459-4af6-9729-05a35b3ad141 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:37.824537 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-caded77c-01f3-41b3-9894-ba4445a3d7ec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '82adf628cb3340f28896e12df0694024', 'request_id': 'req-caded77c-01f3-41b3-9894-ba4445a3d7ec'} {{(pid=86656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:37.840579 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-caded77c-01f3-41b3-9894-ba4445a3d7ec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '82adf628cb3340f28896e12df0694024', 'request_id': 'req-caded77c-01f3-41b3-9894-ba4445a3d7ec'} {{(pid=86656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:37.851287 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-caded77c-01f3-41b3-9894-ba4445a3d7ec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '82adf628cb3340f28896e12df0694024', 'request_id': 'req-caded77c-01f3-41b3-9894-ba4445a3d7ec'} {{(pid=86656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:37.875402 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-caded77c-01f3-41b3-9894-ba4445a3d7ec admin admin] The token cache is being invalidate because project 82adf628cb3340f28896e12df0694024 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86656) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 10:53:37.875772 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-caded77c-01f3-41b3-9894-ba4445a3d7ec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:37.877081 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-caded77c-01f3-41b3-9894-ba4445a3d7ec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:37.880362 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 984/1995] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Jul 14 10:53:37 2022] DELETE /identity/v3/projects/82adf628cb3340f28896e12df0694024 => generated 0 bytes in 447 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:53:37.884125 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caded77c-01f3-41b3-9894-ba4445a3d7ec admin admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:37.889098 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-caded77c-01f3-41b3-9894-ba4445a3d7ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:37.938031 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:53:37.961288 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 1012/1996] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jul 14 10:53:37 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:53:37.962604 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71baaff8-2459-4af6-9729-05a35b3ad141 None None] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:37.964279 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-71baaff8-2459-4af6-9729-05a35b3ad141 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:38.001124 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caded77c-01f3-41b3-9894-ba4445a3d7ec admin admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:38.007254 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d944a8-2c27-4c0f-b325-ad19e6064100 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:38.008184 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d944a8-2c27-4c0f-b325-ad19e6064100 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:38.008494 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d944a8-2c27-4c0f-b325-ad19e6064100 admin admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:38.009028 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d944a8-2c27-4c0f-b325-ad19e6064100 admin admin] PATH_INFO: `/v3/users/095f4f994f444c33a8f6dcaa66b6d0e1` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:38.011161 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d944a8-2c27-4c0f-b325-ad19e6064100 admin admin] RBAC: Authorizing `identity:delete_user(user_id=095f4f994f444c33a8f6dcaa66b6d0e1)` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:38.013830 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d944a8-2c27-4c0f-b325-ad19e6064100 admin admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:38.077333 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71baaff8-2459-4af6-9729-05a35b3ad141 None None] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:38.095377 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-d8d944a8-2c27-4c0f-b325-ad19e6064100 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '095f4f994f444c33a8f6dcaa66b6d0e1'} {{(pid=86656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:38.095526 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaedc7c1-8d8c-4967-89d4-58a9c988f08e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:38.097553 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaedc7c1-8d8c-4967-89d4-58a9c988f08e admin admin] REQUEST_METHOD: `DELETE` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:38.098308 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaedc7c1-8d8c-4967-89d4-58a9c988f08e admin admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:38.098719 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaedc7c1-8d8c-4967-89d4-58a9c988f08e admin admin] PATH_INFO: `/v3/projects/454f3487d08e45b8be123ee8b6cd7127` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:38.100658 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaedc7c1-8d8c-4967-89d4-58a9c988f08e admin admin] RBAC: Authorizing `identity:delete_project(project_id=454f3487d08e45b8be123ee8b6cd7127)` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:38.103365 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaedc7c1-8d8c-4967-89d4-58a9c988f08e admin admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:38.108598 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-d8d944a8-2c27-4c0f-b325-ad19e6064100 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '095f4f994f444c33a8f6dcaa66b6d0e1'} {{(pid=86656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:38.109211 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-d8d944a8-2c27-4c0f-b325-ad19e6064100 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '095f4f994f444c33a8f6dcaa66b6d0e1'} {{(pid=86656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:38.119284 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-d8d944a8-2c27-4c0f-b325-ad19e6064100 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '095f4f994f444c33a8f6dcaa66b6d0e1'} {{(pid=86656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:38.120650 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-d8d944a8-2c27-4c0f-b325-ad19e6064100 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '095f4f994f444c33a8f6dcaa66b6d0e1'} {{(pid=86656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:38.150395 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 985/1997] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Jul 14 10:53:37 2022] DELETE /identity/v3/users/095f4f994f444c33a8f6dcaa66b6d0e1 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 10:53:38.150395 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d944a8-2c27-4c0f-b325-ad19e6064100 admin admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:38.150395 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-d8d944a8-2c27-4c0f-b325-ad19e6064100 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:38.177617 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-eaedc7c1-8d8c-4967-89d4-58a9c988f08e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '454f3487d08e45b8be123ee8b6cd7127', 'request_id': 'req-eaedc7c1-8d8c-4967-89d4-58a9c988f08e'} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:38.195984 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-eaedc7c1-8d8c-4967-89d4-58a9c988f08e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '454f3487d08e45b8be123ee8b6cd7127', 'request_id': 'req-eaedc7c1-8d8c-4967-89d4-58a9c988f08e'} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:38.213548 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-eaedc7c1-8d8c-4967-89d4-58a9c988f08e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '454f3487d08e45b8be123ee8b6cd7127', 'request_id': 'req-eaedc7c1-8d8c-4967-89d4-58a9c988f08e'} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:38.235014 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:53:38.241247 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-eaedc7c1-8d8c-4967-89d4-58a9c988f08e admin admin] The token cache is being invalidate because project 454f3487d08e45b8be123ee8b6cd7127 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86655) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 10:53:38.242958 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-eaedc7c1-8d8c-4967-89d4-58a9c988f08e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:38.243738 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-eaedc7c1-8d8c-4967-89d4-58a9c988f08e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:38.249990 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 1013/1998] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Jul 14 10:53:37 2022] DELETE /identity/v3/projects/454f3487d08e45b8be123ee8b6cd7127 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:53:38.249990 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaedc7c1-8d8c-4967-89d4-58a9c988f08e admin admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:38.254005 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-eaedc7c1-8d8c-4967-89d4-58a9c988f08e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:38.275286 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d944a8-2c27-4c0f-b325-ad19e6064100 admin admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:38.405617 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaedc7c1-8d8c-4967-89d4-58a9c988f08e admin admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:38.411936 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed84b40-9f85-45d8-9a0e-6a0cc1146afd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68382432147a48c3b62271fd2a2eab04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59391272ecbe48b0aa736cb43807be1d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:38.412613 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed84b40-9f85-45d8-9a0e-6a0cc1146afd service cinder] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:38.412935 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed84b40-9f85-45d8-9a0e-6a0cc1146afd service cinder] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:38.413215 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed84b40-9f85-45d8-9a0e-6a0cc1146afd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:38.417506 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78164f5b-8f57-4b7e-b055-b8b20b22340f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:38.418325 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78164f5b-8f57-4b7e-b055-b8b20b22340f admin admin] REQUEST_METHOD: `DELETE` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:38.418613 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78164f5b-8f57-4b7e-b055-b8b20b22340f admin admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:38.418990 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78164f5b-8f57-4b7e-b055-b8b20b22340f admin admin] PATH_INFO: `/v3/projects/e7cc12c08bf64c9eafbb9638668950ad` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:38.420655 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-5ed84b40-9f85-45d8-9a0e-6a0cc1146afd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:38.422314 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78164f5b-8f57-4b7e-b055-b8b20b22340f admin admin] RBAC: Authorizing `identity:delete_project(project_id=e7cc12c08bf64c9eafbb9638668950ad)` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:38.424931 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78164f5b-8f57-4b7e-b055-b8b20b22340f admin admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:38.443775 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:53:38.501116 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-78164f5b-8f57-4b7e-b055-b8b20b22340f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e7cc12c08bf64c9eafbb9638668950ad', 'request_id': 'req-78164f5b-8f57-4b7e-b055-b8b20b22340f'} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:38.509402 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-78164f5b-8f57-4b7e-b055-b8b20b22340f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e7cc12c08bf64c9eafbb9638668950ad', 'request_id': 'req-78164f5b-8f57-4b7e-b055-b8b20b22340f'} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:38.519619 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-78164f5b-8f57-4b7e-b055-b8b20b22340f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e7cc12c08bf64c9eafbb9638668950ad', 'request_id': 'req-78164f5b-8f57-4b7e-b055-b8b20b22340f'} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:38.535686 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-78164f5b-8f57-4b7e-b055-b8b20b22340f admin admin] The token cache is being invalidate because project e7cc12c08bf64c9eafbb9638668950ad was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86655) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 10:53:38.536031 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-78164f5b-8f57-4b7e-b055-b8b20b22340f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:38.537332 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-78164f5b-8f57-4b7e-b055-b8b20b22340f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:38.538485 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 1014/1999] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Jul 14 10:53:38 2022] DELETE /identity/v3/projects/e7cc12c08bf64c9eafbb9638668950ad => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:53:38.543500 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c0f4da-08f2-473f-921b-58239c8673c7 None None] REQUEST_METHOD: `POST` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:38.543796 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c0f4da-08f2-473f-921b-58239c8673c7 None None] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:38.544123 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c0f4da-08f2-473f-921b-58239c8673c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:38.566519 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed84b40-9f85-45d8-9a0e-6a0cc1146afd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:38.568755 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.auth.core [None req-e5c0f4da-08f2-473f-921b-58239c8673c7 None None] MFA Rules not processed for user `ae4bcdd8106d4bebbdcae96be33505bc`. Rule list: `[]` (Enabled: `True`). {{(pid=86655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:53:38.569832 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed84b40-9f85-45d8-9a0e-6a0cc1146afd service cinder] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:38.570197 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-e5c0f4da-08f2-473f-921b-58239c8673c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:38.587778 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 986/2000] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jul 14 10:53:38 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 440 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:53:38.590053 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401cc524-6a25-4d6c-bbfc-2539d2c65bd9 None None] REQUEST_METHOD: `POST` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:38.590526 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401cc524-6a25-4d6c-bbfc-2539d2c65bd9 None None] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:38.592429 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401cc524-6a25-4d6c-bbfc-2539d2c65bd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:38.623064 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.auth.core [None req-401cc524-6a25-4d6c-bbfc-2539d2c65bd9 None None] MFA Rules not processed for user `ae4bcdd8106d4bebbdcae96be33505bc`. Rule list: `[]` (Enabled: `True`). {{(pid=86656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:53:38.624540 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-401cc524-6a25-4d6c-bbfc-2539d2c65bd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:38.671790 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 1015/2001] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jul 14 10:53:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:53:38.671790 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c0f4da-08f2-473f-921b-58239c8673c7 None None] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:38.678227 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-e5c0f4da-08f2-473f-921b-58239c8673c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:38.724215 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:53:38.729227 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 987/2002] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jul 14 10:53:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:53:38.738708 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6938d66-eafa-4b0f-b591-b26789bb1b38 None None] REQUEST_METHOD: `POST` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:38.739009 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6938d66-eafa-4b0f-b591-b26789bb1b38 None None] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:38.739370 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6938d66-eafa-4b0f-b591-b26789bb1b38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:38.763573 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.auth.core [None req-c6938d66-eafa-4b0f-b591-b26789bb1b38 None None] MFA Rules not processed for user `ae4bcdd8106d4bebbdcae96be33505bc`. Rule list: `[]` (Enabled: `True`). {{(pid=86656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:53:38.765082 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-c6938d66-eafa-4b0f-b591-b26789bb1b38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:38.768985 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c0f4da-08f2-473f-921b-58239c8673c7 None None] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:38.777545 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 988/2003] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jul 14 10:53:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:53:38.777545 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6938d66-eafa-4b0f-b591-b26789bb1b38 None None] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:38.778009 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-c6938d66-eafa-4b0f-b591-b26789bb1b38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:38.792286 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6938d66-eafa-4b0f-b591-b26789bb1b38 None None] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:38.798680 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a8c1cd-31f0-4fc6-8366-6add948acd35 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68382432147a48c3b62271fd2a2eab04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59391272ecbe48b0aa736cb43807be1d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:38.799631 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a8c1cd-31f0-4fc6-8366-6add948acd35 service cinder] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:38.800801 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a8c1cd-31f0-4fc6-8366-6add948acd35 service cinder] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:38.804172 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a8c1cd-31f0-4fc6-8366-6add948acd35 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:38.808698 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f28b49a-cf89-46a3-a034-594b0b330211 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:38.810254 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f28b49a-cf89-46a3-a034-594b0b330211 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:38.810254 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f28b49a-cf89-46a3-a034-594b0b330211 admin admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:38.810616 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-59a8c1cd-31f0-4fc6-8366-6add948acd35 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:38.810923 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f28b49a-cf89-46a3-a034-594b0b330211 admin admin] PATH_INFO: `/v3/projects/bf830f37b31e4a75a00f02b56f77f429` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:38.812396 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f28b49a-cf89-46a3-a034-594b0b330211 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bf830f37b31e4a75a00f02b56f77f429)` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:38.815450 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f28b49a-cf89-46a3-a034-594b0b330211 admin admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:38.893848 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-0f28b49a-cf89-46a3-a034-594b0b330211 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bf830f37b31e4a75a00f02b56f77f429', 'request_id': 'req-0f28b49a-cf89-46a3-a034-594b0b330211'} {{(pid=86656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:38.906395 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-0f28b49a-cf89-46a3-a034-594b0b330211 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bf830f37b31e4a75a00f02b56f77f429', 'request_id': 'req-0f28b49a-cf89-46a3-a034-594b0b330211'} {{(pid=86656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:38.911975 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a8c1cd-31f0-4fc6-8366-6add948acd35 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:38.917134 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a8c1cd-31f0-4fc6-8366-6add948acd35 service cinder] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:38.925054 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-0f28b49a-cf89-46a3-a034-594b0b330211 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bf830f37b31e4a75a00f02b56f77f429', 'request_id': 'req-0f28b49a-cf89-46a3-a034-594b0b330211'} {{(pid=86656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:38.942730 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 1016/2004] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jul 14 10:53:38 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 277 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:53:38.944936 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f533089-ea67-4ccd-999a-8821ab379b1b None None] REQUEST_METHOD: `POST` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:38.946401 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f533089-ea67-4ccd-999a-8821ab379b1b None None] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:38.946767 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f533089-ea67-4ccd-999a-8821ab379b1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:38.967684 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-0f28b49a-cf89-46a3-a034-594b0b330211 admin admin] The token cache is being invalidate because project bf830f37b31e4a75a00f02b56f77f429 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86656) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 10:53:38.968001 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-0f28b49a-cf89-46a3-a034-594b0b330211 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:38.976622 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-0f28b49a-cf89-46a3-a034-594b0b330211 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:38.979671 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 989/2005] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Jul 14 10:53:38 2022] DELETE /identity/v3/projects/bf830f37b31e4a75a00f02b56f77f429 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:53:38.985644 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.auth.core [None req-1f533089-ea67-4ccd-999a-8821ab379b1b None None] MFA Rules not processed for user `ae4bcdd8106d4bebbdcae96be33505bc`. Rule list: `[]` (Enabled: `True`). {{(pid=86655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:53:38.986205 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f28b49a-cf89-46a3-a034-594b0b330211 admin admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:38.987550 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-1f533089-ea67-4ccd-999a-8821ab379b1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:38.988006 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-0f28b49a-cf89-46a3-a034-594b0b330211 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:39.034259 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:53:39.084688 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 1017/2006] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jul 14 10:53:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:53:39.087637 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664744bc-a9fd-41b0-a75f-a6aa1dcda8f1 None None] REQUEST_METHOD: `POST` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:39.088118 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664744bc-a9fd-41b0-a75f-a6aa1dcda8f1 None None] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:39.088587 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664744bc-a9fd-41b0-a75f-a6aa1dcda8f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:39.116095 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.auth.core [None req-664744bc-a9fd-41b0-a75f-a6aa1dcda8f1 None None] MFA Rules not processed for user `ae4bcdd8106d4bebbdcae96be33505bc`. Rule list: `[]` (Enabled: `True`). {{(pid=86655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:53:39.118927 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-664744bc-a9fd-41b0-a75f-a6aa1dcda8f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:39.125586 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f28b49a-cf89-46a3-a034-594b0b330211 admin admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:39.131652 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 1018/2007] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jul 14 10:53:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:53:39.132816 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664744bc-a9fd-41b0-a75f-a6aa1dcda8f1 None None] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:39.135598 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1ab81b-7fce-49ab-a126-1495cdc4820f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:39.136387 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1ab81b-7fce-49ab-a126-1495cdc4820f admin admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:39.136722 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1ab81b-7fce-49ab-a126-1495cdc4820f admin admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:39.137074 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1ab81b-7fce-49ab-a126-1495cdc4820f admin admin] PATH_INFO: `/v3/domains` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:39.138288 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1ab81b-7fce-49ab-a126-1495cdc4820f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:53:39.138432 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1ab81b-7fce-49ab-a126-1495cdc4820f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:39.146364 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664744bc-a9fd-41b0-a75f-a6aa1dcda8f1 None None] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:39.148730 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1ab81b-7fce-49ab-a126-1495cdc4820f admin admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:39.154901 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978ae5fb-2c41-48c9-ada0-e0fd93e03215 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:39.155929 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978ae5fb-2c41-48c9-ada0-e0fd93e03215 admin admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:39.156397 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978ae5fb-2c41-48c9-ada0-e0fd93e03215 admin admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:39.156973 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978ae5fb-2c41-48c9-ada0-e0fd93e03215 admin admin] PATH_INFO: `/v3/domains` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:39.158002 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978ae5fb-2c41-48c9-ada0-e0fd93e03215 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:53:39.158496 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978ae5fb-2c41-48c9-ada0-e0fd93e03215 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:39.160351 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978ae5fb-2c41-48c9-ada0-e0fd93e03215 admin admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:39.176408 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 1019/2008] 10.222.0.16 () {58 vars in 1152 bytes} [Thu Jul 14 10:53:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:53:39.178089 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3ccfef-1eec-4c27-91d8-ae610bc0d5ef None None] REQUEST_METHOD: `POST` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:39.178587 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3ccfef-1eec-4c27-91d8-ae610bc0d5ef None None] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:39.179046 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3ccfef-1eec-4c27-91d8-ae610bc0d5ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:39.179673 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 990/2009] 10.222.0.16 () {58 vars in 1152 bytes} [Thu Jul 14 10:53:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:53:39.182927 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1ab81b-7fce-49ab-a126-1495cdc4820f admin admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:39.205249 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1ab81b-7fce-49ab-a126-1495cdc4820f admin admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:39.209086 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.auth.core [None req-9b3ccfef-1eec-4c27-91d8-ae610bc0d5ef None None] MFA Rules not processed for user `ae4bcdd8106d4bebbdcae96be33505bc`. Rule list: `[]` (Enabled: `True`). {{(pid=86655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:53:39.210715 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-9b3ccfef-1eec-4c27-91d8-ae610bc0d5ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:39.220394 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54cebca8-b769-4567-b337-18e4fe90b31c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:39.221106 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cebca8-b769-4567-b337-18e4fe90b31c admin admin] REQUEST_METHOD: `POST` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:39.221393 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cebca8-b769-4567-b337-18e4fe90b31c admin admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:39.221671 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cebca8-b769-4567-b337-18e4fe90b31c admin admin] PATH_INFO: `/v3/projects` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:39.222786 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 1020/2010] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jul 14 10:53:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:53:39.223614 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3ccfef-1eec-4c27-91d8-ae610bc0d5ef None None] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:39.225111 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54cebca8-b769-4567-b337-18e4fe90b31c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:39.228151 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54cebca8-b769-4567-b337-18e4fe90b31c admin admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:39.236666 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3ccfef-1eec-4c27-91d8-ae610bc0d5ef None None] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:39.242931 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff914799-b6eb-4e11-9779-22c34dba97ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:39.243662 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff914799-b6eb-4e11-9779-22c34dba97ba admin admin] REQUEST_METHOD: `POST` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:39.244010 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff914799-b6eb-4e11-9779-22c34dba97ba admin admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:39.244299 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff914799-b6eb-4e11-9779-22c34dba97ba admin admin] PATH_INFO: `/v3/projects` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:39.245154 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff914799-b6eb-4e11-9779-22c34dba97ba admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:39.248939 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff914799-b6eb-4e11-9779-22c34dba97ba admin admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:39.300009 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 1021/2011] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Jul 14 10:53:39 2022] POST /identity/v3/projects => generated 379 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:53:39.301018 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff914799-b6eb-4e11-9779-22c34dba97ba admin admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:39.301424 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 991/2012] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Jul 14 10:53:39 2022] POST /identity/v3/projects => generated 379 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:53:39.303153 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54cebca8-b769-4567-b337-18e4fe90b31c admin admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:39.305506 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-54cebca8-b769-4567-b337-18e4fe90b31c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:39.418609 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:53:39.474114 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54cebca8-b769-4567-b337-18e4fe90b31c admin admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:39.475389 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff914799-b6eb-4e11-9779-22c34dba97ba admin admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:39.491674 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aaf9463-4bbc-469c-9d4c-622e40517a28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:39.492577 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aaf9463-4bbc-469c-9d4c-622e40517a28 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:39.492894 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aaf9463-4bbc-469c-9d4c-622e40517a28 admin admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:39.493160 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aaf9463-4bbc-469c-9d4c-622e40517a28 admin admin] PATH_INFO: `/v3/users/11d6a1804f804f9db11c42c314da04f9` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:39.493914 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8dd8a4-d556-4962-9cca-12df1a390ba0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:39.494781 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8dd8a4-d556-4962-9cca-12df1a390ba0 admin admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:39.495052 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8dd8a4-d556-4962-9cca-12df1a390ba0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:39.495334 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8dd8a4-d556-4962-9cca-12df1a390ba0 admin admin] PATH_INFO: `/v3/domains` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:39.496843 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aaf9463-4bbc-469c-9d4c-622e40517a28 admin admin] RBAC: Authorizing `identity:delete_user(user_id=11d6a1804f804f9db11c42c314da04f9)` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:39.497897 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8dd8a4-d556-4962-9cca-12df1a390ba0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:53:39.498543 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8dd8a4-d556-4962-9cca-12df1a390ba0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:39.499068 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aaf9463-4bbc-469c-9d4c-622e40517a28 admin admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:39.501986 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8dd8a4-d556-4962-9cca-12df1a390ba0 admin admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:39.528585 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 1022/2013] 10.222.0.16 () {58 vars in 1152 bytes} [Thu Jul 14 10:53:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:53:39.533846 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8dd8a4-d556-4962-9cca-12df1a390ba0 admin admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:39.559358 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8dd8a4-d556-4962-9cca-12df1a390ba0 admin admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:39.566947 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b4aa0c-5c49-4514-8eac-e7b76e60b1ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:39.567713 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b4aa0c-5c49-4514-8eac-e7b76e60b1ec admin admin] REQUEST_METHOD: `POST` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:39.568189 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b4aa0c-5c49-4514-8eac-e7b76e60b1ec admin admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:39.568608 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b4aa0c-5c49-4514-8eac-e7b76e60b1ec admin admin] PATH_INFO: `/v3/users` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:39.569528 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b4aa0c-5c49-4514-8eac-e7b76e60b1ec admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:39.571642 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b4aa0c-5c49-4514-8eac-e7b76e60b1ec admin admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:39.587069 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-6aaf9463-4bbc-469c-9d4c-622e40517a28 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '11d6a1804f804f9db11c42c314da04f9'} {{(pid=86656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:39.596037 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-6aaf9463-4bbc-469c-9d4c-622e40517a28 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '11d6a1804f804f9db11c42c314da04f9'} {{(pid=86656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:39.597148 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 1023/2014] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Jul 14 10:53:39 2022] POST /identity/v3/users => generated 290 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:53:39.597631 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-6aaf9463-4bbc-469c-9d4c-622e40517a28 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '11d6a1804f804f9db11c42c314da04f9'} {{(pid=86656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:39.598133 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b4aa0c-5c49-4514-8eac-e7b76e60b1ec admin admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:39.600347 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-58b4aa0c-5c49-4514-8eac-e7b76e60b1ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:39.609666 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-6aaf9463-4bbc-469c-9d4c-622e40517a28 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '11d6a1804f804f9db11c42c314da04f9'} {{(pid=86656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:39.610711 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-6aaf9463-4bbc-469c-9d4c-622e40517a28 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '11d6a1804f804f9db11c42c314da04f9'} {{(pid=86656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:39.617134 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b4aa0c-5c49-4514-8eac-e7b76e60b1ec admin admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:39.623268 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b064f2f-b069-42aa-a258-f3e69038c19d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:39.636742 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b064f2f-b069-42aa-a258-f3e69038c19d admin admin] REQUEST_METHOD: `POST` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:39.637163 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b064f2f-b069-42aa-a258-f3e69038c19d admin admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:39.637469 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b064f2f-b069-42aa-a258-f3e69038c19d admin admin] PATH_INFO: `/v3/users` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:39.648879 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 992/2015] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Jul 14 10:53:39 2022] DELETE /identity/v3/users/11d6a1804f804f9db11c42c314da04f9 => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:53:39.649160 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b064f2f-b069-42aa-a258-f3e69038c19d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:39.649239 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aaf9463-4bbc-469c-9d4c-622e40517a28 admin admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:39.649310 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b064f2f-b069-42aa-a258-f3e69038c19d admin admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:39.649388 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-6aaf9463-4bbc-469c-9d4c-622e40517a28 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:39.666870 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:53:39.667401 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 1024/2016] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Jul 14 10:53:39 2022] POST /identity/v3/users => generated 290 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:53:39.672525 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b064f2f-b069-42aa-a258-f3e69038c19d admin admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:39.675118 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-8b064f2f-b069-42aa-a258-f3e69038c19d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:39.705302 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b064f2f-b069-42aa-a258-f3e69038c19d admin admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:39.737117 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aaf9463-4bbc-469c-9d4c-622e40517a28 admin admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:39.747868 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdf7e43-9125-4f27-b4ed-0947f3a966b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:39.748555 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdf7e43-9125-4f27-b4ed-0947f3a966b7 admin admin] REQUEST_METHOD: `POST` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:39.749106 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdf7e43-9125-4f27-b4ed-0947f3a966b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:39.749390 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdf7e43-9125-4f27-b4ed-0947f3a966b7 admin admin] PATH_INFO: `/v3/projects` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:39.753613 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfdf7e43-9125-4f27-b4ed-0947f3a966b7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:39.755808 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfdf7e43-9125-4f27-b4ed-0947f3a966b7 admin admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:39.791541 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09563e6f-112f-4bfd-8ef5-67bc6916cc9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:39.792319 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09563e6f-112f-4bfd-8ef5-67bc6916cc9b admin admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:39.793269 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09563e6f-112f-4bfd-8ef5-67bc6916cc9b admin admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:39.793606 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09563e6f-112f-4bfd-8ef5-67bc6916cc9b admin admin] PATH_INFO: `/v3/roles` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:39.796018 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09563e6f-112f-4bfd-8ef5-67bc6916cc9b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:39.797949 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09563e6f-112f-4bfd-8ef5-67bc6916cc9b admin admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:39.804816 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 993/2017] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Jul 14 10:53:39 2022] POST /identity/v3/projects => generated 373 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:53:39.804816 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9633ee53-f0b1-40a2-929b-3dea736710bd None None] REQUEST_METHOD: `POST` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:39.804816 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9633ee53-f0b1-40a2-929b-3dea736710bd None None] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:39.804816 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9633ee53-f0b1-40a2-929b-3dea736710bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:39.817869 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 1025/2018] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jul 14 10:53:39 2022] GET /identity/v3/roles => generated 1420 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:53:39.819309 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09563e6f-112f-4bfd-8ef5-67bc6916cc9b admin admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:39.830530 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.auth.core [None req-9633ee53-f0b1-40a2-929b-3dea736710bd None None] MFA Rules not processed for user `ae4bcdd8106d4bebbdcae96be33505bc`. Rule list: `[]` (Enabled: `True`). {{(pid=86656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:53:39.833322 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-9633ee53-f0b1-40a2-929b-3dea736710bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:39.835012 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09563e6f-112f-4bfd-8ef5-67bc6916cc9b admin admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:39.908835 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf98b6d9-98c3-4e5a-b195-7538b37b37fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:39.909717 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf98b6d9-98c3-4e5a-b195-7538b37b37fe admin admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:39.910012 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf98b6d9-98c3-4e5a-b195-7538b37b37fe admin admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:39.910310 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf98b6d9-98c3-4e5a-b195-7538b37b37fe admin admin] PATH_INFO: `/v3/roles` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:39.911043 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf98b6d9-98c3-4e5a-b195-7538b37b37fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:39.912653 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf98b6d9-98c3-4e5a-b195-7538b37b37fe admin admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:39.917587 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 994/2019] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jul 14 10:53:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:53:39.917587 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9633ee53-f0b1-40a2-929b-3dea736710bd None None] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:39.924314 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 1026/2020] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jul 14 10:53:39 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:53:39.925192 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf98b6d9-98c3-4e5a-b195-7538b37b37fe admin admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:39.930111 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9633ee53-f0b1-40a2-929b-3dea736710bd None None] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:39.935550 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4011fa-a29f-4c0c-953b-890b1f285842 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:39.936289 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4011fa-a29f-4c0c-953b-890b1f285842 admin admin] REQUEST_METHOD: `POST` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:39.936583 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4011fa-a29f-4c0c-953b-890b1f285842 admin admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:39.937296 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4011fa-a29f-4c0c-953b-890b1f285842 admin admin] PATH_INFO: `/v3/users` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:39.937616 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4011fa-a29f-4c0c-953b-890b1f285842 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:39.937726 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf98b6d9-98c3-4e5a-b195-7538b37b37fe admin admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:39.939620 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4011fa-a29f-4c0c-953b-890b1f285842 admin admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:39.942828 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4495c349-8959-4145-a983-c3fea8a5f759 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:39.943860 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4495c349-8959-4145-a983-c3fea8a5f759 admin admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:39.944267 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4495c349-8959-4145-a983-c3fea8a5f759 admin admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:39.944660 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4495c349-8959-4145-a983-c3fea8a5f759 admin admin] PATH_INFO: `/v3/roles` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:39.945528 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4495c349-8959-4145-a983-c3fea8a5f759 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:39.947237 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4495c349-8959-4145-a983-c3fea8a5f759 admin admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:39.963105 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 1027/2021] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jul 14 10:53:39 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:53:39.963105 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4495c349-8959-4145-a983-c3fea8a5f759 admin admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:39.964477 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 995/2022] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Jul 14 10:53:39 2022] POST /identity/v3/users => generated 287 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:53:39.965480 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4011fa-a29f-4c0c-953b-890b1f285842 admin admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:39.966658 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-4495c349-8959-4145-a983-c3fea8a5f759 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:39.977230 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4011fa-a29f-4c0c-953b-890b1f285842 admin admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:39.984109 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fa224a-7fe3-469b-b8c5-f7eb2d871cc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:39.984612 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fa224a-7fe3-469b-b8c5-f7eb2d871cc0 admin admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:39.985001 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fa224a-7fe3-469b-b8c5-f7eb2d871cc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:39.985348 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fa224a-7fe3-469b-b8c5-f7eb2d871cc0 admin admin] PATH_INFO: `/v3/roles` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:39.986454 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91fa224a-7fe3-469b-b8c5-f7eb2d871cc0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:39.987986 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91fa224a-7fe3-469b-b8c5-f7eb2d871cc0 admin admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:39.991012 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:53:40.001371 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 996/2023] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jul 14 10:53:39 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:53:40.002265 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fa224a-7fe3-469b-b8c5-f7eb2d871cc0 admin admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:40.013982 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fa224a-7fe3-469b-b8c5-f7eb2d871cc0 admin admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:40.019253 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d0ab5d-0e26-43a8-bc01-8b02acecb3b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:40.020535 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d0ab5d-0e26-43a8-bc01-8b02acecb3b0 admin admin] REQUEST_METHOD: `PUT` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:40.020913 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d0ab5d-0e26-43a8-bc01-8b02acecb3b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:40.021580 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d0ab5d-0e26-43a8-bc01-8b02acecb3b0 admin admin] PATH_INFO: `/v3/projects/822f994b956d4b2a80bfd768ee628e2f/users/44f20deea5e047ca91d3592ace5e1640/roles/0da46c267d354cce81495dfdd56c1ec2` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:40.031628 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4495c349-8959-4145-a983-c3fea8a5f759 admin admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:40.035694 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64e079d-19d7-4f24-9e5f-a7786f38b994 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dddf93691844886982c91fea974385d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59391272ecbe48b0aa736cb43807be1d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:40.036269 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64e079d-19d7-4f24-9e5f-a7786f38b994 service neutron] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:40.036495 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64e079d-19d7-4f24-9e5f-a7786f38b994 service neutron] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:40.036799 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64e079d-19d7-4f24-9e5f-a7786f38b994 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:40.045863 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d0ab5d-0e26-43a8-bc01-8b02acecb3b0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=822f994b956d4b2a80bfd768ee628e2f, user_id=44f20deea5e047ca91d3592ace5e1640, role_id=0da46c267d354cce81495dfdd56c1ec2)` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:40.047672 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64e079d-19d7-4f24-9e5f-a7786f38b994 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:40.049168 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64e079d-19d7-4f24-9e5f-a7786f38b994 service neutron] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:40.049389 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d0ab5d-0e26-43a8-bc01-8b02acecb3b0 admin admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:40.061215 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 1028/2024] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jul 14 10:53:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:53:40.062209 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64e079d-19d7-4f24-9e5f-a7786f38b994 service neutron] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:40.074250 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 997/2025] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Jul 14 10:53:40 2022] PUT /identity/v3/projects/822f994b956d4b2a80bfd768ee628e2f/users/44f20deea5e047ca91d3592ace5e1640/roles/0da46c267d354cce81495dfdd56c1ec2 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:53:40.074250 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d0ab5d-0e26-43a8-bc01-8b02acecb3b0 admin admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:40.079676 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64e079d-19d7-4f24-9e5f-a7786f38b994 service neutron] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:40.132424 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:53:40.160704 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d0ab5d-0e26-43a8-bc01-8b02acecb3b0 admin admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:40.167670 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7d7c15-8b19-41b6-9558-b27e7e59992d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:40.170188 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7d7c15-8b19-41b6-9558-b27e7e59992d admin admin] REQUEST_METHOD: `PUT` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:40.170497 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7d7c15-8b19-41b6-9558-b27e7e59992d admin admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:40.170644 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18441343-db86-4814-a28a-21d65a6eca0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:40.170835 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7d7c15-8b19-41b6-9558-b27e7e59992d admin admin] PATH_INFO: `/v3/projects/9e9338c20d0c4bee8d3603f32deb8832/users/851a0ee6e2cb43e8a2817d692b121214/roles/0da46c267d354cce81495dfdd56c1ec2` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:40.171398 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18441343-db86-4814-a28a-21d65a6eca0b admin admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:40.171791 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18441343-db86-4814-a28a-21d65a6eca0b admin admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:40.172004 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18441343-db86-4814-a28a-21d65a6eca0b admin admin] PATH_INFO: `/v3/roles` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:40.172714 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18441343-db86-4814-a28a-21d65a6eca0b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:40.174376 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18441343-db86-4814-a28a-21d65a6eca0b admin admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:40.188882 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 1029/2026] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jul 14 10:53:40 2022] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:53:40.188882 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c188db44-4b17-4e2e-9b28-295b660574ca None None] REQUEST_METHOD: `POST` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:40.188882 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c188db44-4b17-4e2e-9b28-295b660574ca None None] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:40.188882 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c188db44-4b17-4e2e-9b28-295b660574ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:40.194644 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7d7c15-8b19-41b6-9558-b27e7e59992d admin admin] RBAC: Authorizing `identity:create_grant(project_id=9e9338c20d0c4bee8d3603f32deb8832, user_id=851a0ee6e2cb43e8a2817d692b121214, role_id=0da46c267d354cce81495dfdd56c1ec2)` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:40.198707 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7d7c15-8b19-41b6-9558-b27e7e59992d admin admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:40.215306 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 998/2027] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Jul 14 10:53:40 2022] PUT /identity/v3/projects/9e9338c20d0c4bee8d3603f32deb8832/users/851a0ee6e2cb43e8a2817d692b121214/roles/0da46c267d354cce81495dfdd56c1ec2 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:53:40.225239 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7d7c15-8b19-41b6-9558-b27e7e59992d admin admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:40.226703 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.auth.core [None req-c188db44-4b17-4e2e-9b28-295b660574ca None None] MFA Rules not processed for user `44f20deea5e047ca91d3592ace5e1640`. Rule list: `[]` (Enabled: `True`). {{(pid=86655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:53:40.228933 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-c188db44-4b17-4e2e-9b28-295b660574ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:40.323474 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7d7c15-8b19-41b6-9558-b27e7e59992d admin admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:40.333189 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dddc7b87-10cc-4da6-a2d1-34230fd24b5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:40.334301 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddc7b87-10cc-4da6-a2d1-34230fd24b5b admin admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:40.334770 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddc7b87-10cc-4da6-a2d1-34230fd24b5b admin admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:40.335233 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddc7b87-10cc-4da6-a2d1-34230fd24b5b admin admin] PATH_INFO: `/v3/roles` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:40.336349 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dddc7b87-10cc-4da6-a2d1-34230fd24b5b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:40.339101 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dddc7b87-10cc-4da6-a2d1-34230fd24b5b admin admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:40.356344 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 1030/2028] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jul 14 10:53:40 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:53:40.358019 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61020d3e-bf80-496d-a75c-be2943b5df29 None None] REQUEST_METHOD: `POST` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:40.358368 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61020d3e-bf80-496d-a75c-be2943b5df29 None None] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:40.358663 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61020d3e-bf80-496d-a75c-be2943b5df29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:40.365429 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 999/2029] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jul 14 10:53:40 2022] GET /identity/v3/roles => generated 1420 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:53:40.366846 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dddc7b87-10cc-4da6-a2d1-34230fd24b5b admin admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:40.393091 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dddc7b87-10cc-4da6-a2d1-34230fd24b5b admin admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:40.396879 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.auth.core [None req-61020d3e-bf80-496d-a75c-be2943b5df29 None None] MFA Rules not processed for user `851a0ee6e2cb43e8a2817d692b121214`. Rule list: `[]` (Enabled: `True`). {{(pid=86655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:53:40.398262 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-61020d3e-bf80-496d-a75c-be2943b5df29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:40.401662 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecf3e19-e7f2-48f3-bf51-98abde4e35ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:40.402472 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecf3e19-e7f2-48f3-bf51-98abde4e35ea admin admin] REQUEST_METHOD: `POST` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:40.402865 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecf3e19-e7f2-48f3-bf51-98abde4e35ea admin admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:40.403254 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecf3e19-e7f2-48f3-bf51-98abde4e35ea admin admin] PATH_INFO: `/v3/projects` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:40.404907 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ecf3e19-e7f2-48f3-bf51-98abde4e35ea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:40.407503 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ecf3e19-e7f2-48f3-bf51-98abde4e35ea admin admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:40.442673 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=100 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:53:40.453820 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 1000/2030] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Jul 14 10:53:40 2022] POST /identity/v3/projects => generated 379 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:53:40.454677 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecf3e19-e7f2-48f3-bf51-98abde4e35ea admin admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:40.487078 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 1031/2031] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jul 14 10:53:40 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:53:40.487929 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61020d3e-bf80-496d-a75c-be2943b5df29 None None] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:40.527565 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61020d3e-bf80-496d-a75c-be2943b5df29 None None] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:40.537122 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33a94be-c0e9-4911-a904-18d776894765 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:40.537869 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33a94be-c0e9-4911-a904-18d776894765 admin admin] REQUEST_METHOD: `POST` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:40.538160 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33a94be-c0e9-4911-a904-18d776894765 admin admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:40.538444 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33a94be-c0e9-4911-a904-18d776894765 admin admin] PATH_INFO: `/v3/users` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:40.538949 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecf3e19-e7f2-48f3-bf51-98abde4e35ea admin admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:40.539158 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33a94be-c0e9-4911-a904-18d776894765 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:40.541258 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33a94be-c0e9-4911-a904-18d776894765 admin admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:40.544741 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7f8d15-9b23-4662-bbb9-3d5a04f93c63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:40.546749 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7f8d15-9b23-4662-bbb9-3d5a04f93c63 admin admin] REQUEST_METHOD: `PUT` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:40.547040 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7f8d15-9b23-4662-bbb9-3d5a04f93c63 admin admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:40.547328 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7f8d15-9b23-4662-bbb9-3d5a04f93c63 admin admin] PATH_INFO: `/v3/projects/39a9ec52c5dd4e7487d9b1f778e5c901/users/e67b2b8b1f154708ac2d3d70fa24d6d0/roles/0da46c267d354cce81495dfdd56c1ec2` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:40.568694 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 1032/2032] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Jul 14 10:53:40 2022] POST /identity/v3/users => generated 290 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:53:40.569424 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33a94be-c0e9-4911-a904-18d776894765 admin admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:40.570450 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7f8d15-9b23-4662-bbb9-3d5a04f93c63 admin admin] RBAC: Authorizing `identity:create_grant(project_id=39a9ec52c5dd4e7487d9b1f778e5c901, user_id=e67b2b8b1f154708ac2d3d70fa24d6d0, role_id=0da46c267d354cce81495dfdd56c1ec2)` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:40.571162 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-f33a94be-c0e9-4911-a904-18d776894765 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:40.573283 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7f8d15-9b23-4662-bbb9-3d5a04f93c63 admin admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:40.585334 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33a94be-c0e9-4911-a904-18d776894765 admin admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:40.595849 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 1001/2033] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Jul 14 10:53:40 2022] PUT /identity/v3/projects/39a9ec52c5dd4e7487d9b1f778e5c901/users/e67b2b8b1f154708ac2d3d70fa24d6d0/roles/0da46c267d354cce81495dfdd56c1ec2 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:53:40.596911 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7f8d15-9b23-4662-bbb9-3d5a04f93c63 admin admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:40.630307 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:53:40.663396 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e42e89-b696-4a7a-958d-ff2e97e3e9e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:40.664412 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e42e89-b696-4a7a-958d-ff2e97e3e9e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:40.664753 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e42e89-b696-4a7a-958d-ff2e97e3e9e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:40.665103 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e42e89-b696-4a7a-958d-ff2e97e3e9e4 admin admin] PATH_INFO: `/v3/projects/462cd1b38d634237b6b7747e1399a014` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:40.666501 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e42e89-b696-4a7a-958d-ff2e97e3e9e4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=462cd1b38d634237b6b7747e1399a014)` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:40.670854 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e42e89-b696-4a7a-958d-ff2e97e3e9e4 admin admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:40.709412 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7f8d15-9b23-4662-bbb9-3d5a04f93c63 admin admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:40.719824 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8013dc8-8848-4d31-b1a5-66d65ed343cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:40.721377 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8013dc8-8848-4d31-b1a5-66d65ed343cb admin admin] REQUEST_METHOD: `POST` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:40.721680 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8013dc8-8848-4d31-b1a5-66d65ed343cb admin admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:40.721967 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8013dc8-8848-4d31-b1a5-66d65ed343cb admin admin] PATH_INFO: `/v3/projects` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:40.723506 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8013dc8-8848-4d31-b1a5-66d65ed343cb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:40.726584 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8013dc8-8848-4d31-b1a5-66d65ed343cb admin admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:40.760908 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 1002/2034] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Jul 14 10:53:40 2022] POST /identity/v3/projects => generated 381 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:53:40.760908 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8013dc8-8848-4d31-b1a5-66d65ed343cb admin admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:40.771376 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-e7e42e89-b696-4a7a-958d-ff2e97e3e9e4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '462cd1b38d634237b6b7747e1399a014', 'request_id': 'req-e7e42e89-b696-4a7a-958d-ff2e97e3e9e4'} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:40.779892 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-e7e42e89-b696-4a7a-958d-ff2e97e3e9e4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '462cd1b38d634237b6b7747e1399a014', 'request_id': 'req-e7e42e89-b696-4a7a-958d-ff2e97e3e9e4'} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:40.789221 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-e7e42e89-b696-4a7a-958d-ff2e97e3e9e4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '462cd1b38d634237b6b7747e1399a014', 'request_id': 'req-e7e42e89-b696-4a7a-958d-ff2e97e3e9e4'} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:40.805914 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-e7e42e89-b696-4a7a-958d-ff2e97e3e9e4 admin admin] The token cache is being invalidate because project 462cd1b38d634237b6b7747e1399a014 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86655) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 10:53:40.806300 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-e7e42e89-b696-4a7a-958d-ff2e97e3e9e4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:40.807055 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-e7e42e89-b696-4a7a-958d-ff2e97e3e9e4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:40.812593 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 1033/2035] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Jul 14 10:53:40 2022] DELETE /identity/v3/projects/462cd1b38d634237b6b7747e1399a014 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:53:40.812593 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16d39eb-0208-4e29-986c-6aa5efd4fc6f None None] REQUEST_METHOD: `POST` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:40.812593 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16d39eb-0208-4e29-986c-6aa5efd4fc6f None None] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:40.812593 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16d39eb-0208-4e29-986c-6aa5efd4fc6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:40.832287 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.auth.core [None req-b16d39eb-0208-4e29-986c-6aa5efd4fc6f None None] MFA Rules not processed for user `ae4bcdd8106d4bebbdcae96be33505bc`. Rule list: `[]` (Enabled: `True`). {{(pid=86655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:53:40.833865 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-b16d39eb-0208-4e29-986c-6aa5efd4fc6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:40.858164 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8013dc8-8848-4d31-b1a5-66d65ed343cb admin admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:40.865386 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4368a08c-d212-4b97-bed8-d59d533a78ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:40.866324 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4368a08c-d212-4b97-bed8-d59d533a78ef admin admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:40.866687 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4368a08c-d212-4b97-bed8-d59d533a78ef admin admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:40.867046 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4368a08c-d212-4b97-bed8-d59d533a78ef admin admin] PATH_INFO: `/v3/roles` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:40.868574 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4368a08c-d212-4b97-bed8-d59d533a78ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:40.870433 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4368a08c-d212-4b97-bed8-d59d533a78ef admin admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:40.886700 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:53:40.887880 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 1003/2036] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jul 14 10:53:40 2022] GET /identity/v3/roles => generated 1420 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:53:40.888880 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4368a08c-d212-4b97-bed8-d59d533a78ef admin admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:40.892187 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-4368a08c-d212-4b97-bed8-d59d533a78ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:40.905696 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4368a08c-d212-4b97-bed8-d59d533a78ef admin admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:40.910140 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 1034/2037] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jul 14 10:53:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:53:40.911458 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2f904f-14d1-4654-943d-c7ab0a4e6b07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:40.912148 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2f904f-14d1-4654-943d-c7ab0a4e6b07 admin admin] REQUEST_METHOD: `POST` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:40.913087 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2f904f-14d1-4654-943d-c7ab0a4e6b07 admin admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:40.914895 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16d39eb-0208-4e29-986c-6aa5efd4fc6f None None] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:40.916269 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-b16d39eb-0208-4e29-986c-6aa5efd4fc6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:40.919719 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2f904f-14d1-4654-943d-c7ab0a4e6b07 admin admin] PATH_INFO: `/v3/users` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:40.920493 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2f904f-14d1-4654-943d-c7ab0a4e6b07 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:40.922904 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2f904f-14d1-4654-943d-c7ab0a4e6b07 admin admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:40.931114 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16d39eb-0208-4e29-986c-6aa5efd4fc6f None None] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:40.939232 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab633e8f-b332-4885-9a73-d85ca75e750e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:40.940137 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab633e8f-b332-4885-9a73-d85ca75e750e admin admin] REQUEST_METHOD: `DELETE` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:40.940429 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab633e8f-b332-4885-9a73-d85ca75e750e admin admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:40.941172 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab633e8f-b332-4885-9a73-d85ca75e750e admin admin] PATH_INFO: `/v3/users/b541528c5f8c4ce4bc6d92bce3e8c46b` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:40.942107 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab633e8f-b332-4885-9a73-d85ca75e750e admin admin] RBAC: Authorizing `identity:delete_user(user_id=b541528c5f8c4ce4bc6d92bce3e8c46b)` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:40.944332 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab633e8f-b332-4885-9a73-d85ca75e750e admin admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:40.952716 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 1004/2038] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Jul 14 10:53:40 2022] POST /identity/v3/users => generated 297 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:53:40.952716 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2f904f-14d1-4654-943d-c7ab0a4e6b07 admin admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:40.952716 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-8e2f904f-14d1-4654-943d-c7ab0a4e6b07 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:40.966354 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2f904f-14d1-4654-943d-c7ab0a4e6b07 admin admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:40.973959 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd682cb0-b78e-457f-910a-cf0e600d4225 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:40.974944 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd682cb0-b78e-457f-910a-cf0e600d4225 admin admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:40.975239 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd682cb0-b78e-457f-910a-cf0e600d4225 admin admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:40.975576 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd682cb0-b78e-457f-910a-cf0e600d4225 admin admin] PATH_INFO: `/v3/roles` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:40.976336 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd682cb0-b78e-457f-910a-cf0e600d4225 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:40.979799 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd682cb0-b78e-457f-910a-cf0e600d4225 admin admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:40.996437 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 1005/2039] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jul 14 10:53:40 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:53:40.997435 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd682cb0-b78e-457f-910a-cf0e600d4225 admin admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:41.002574 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-cd682cb0-b78e-457f-910a-cf0e600d4225 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:41.026125 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-ab633e8f-b332-4885-9a73-d85ca75e750e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b541528c5f8c4ce4bc6d92bce3e8c46b'} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:41.043733 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-ab633e8f-b332-4885-9a73-d85ca75e750e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b541528c5f8c4ce4bc6d92bce3e8c46b'} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:41.045337 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-ab633e8f-b332-4885-9a73-d85ca75e750e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b541528c5f8c4ce4bc6d92bce3e8c46b'} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:41.064944 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-ab633e8f-b332-4885-9a73-d85ca75e750e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b541528c5f8c4ce4bc6d92bce3e8c46b'} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:41.065716 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-ab633e8f-b332-4885-9a73-d85ca75e750e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b541528c5f8c4ce4bc6d92bce3e8c46b'} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:41.107319 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd682cb0-b78e-457f-910a-cf0e600d4225 admin admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:41.115761 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126bd8a9-b9e2-4d99-8401-cfefa32eb083 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dddf93691844886982c91fea974385d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59391272ecbe48b0aa736cb43807be1d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:41.116438 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126bd8a9-b9e2-4d99-8401-cfefa32eb083 service neutron] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:41.116724 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126bd8a9-b9e2-4d99-8401-cfefa32eb083 service neutron] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:41.117032 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126bd8a9-b9e2-4d99-8401-cfefa32eb083 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:41.124445 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 1035/2040] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Jul 14 10:53:40 2022] DELETE /identity/v3/users/b541528c5f8c4ce4bc6d92bce3e8c46b => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:53:41.125380 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab633e8f-b332-4885-9a73-d85ca75e750e admin admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:41.128451 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-126bd8a9-b9e2-4d99-8401-cfefa32eb083 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:41.129115 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-ab633e8f-b332-4885-9a73-d85ca75e750e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:41.148870 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126bd8a9-b9e2-4d99-8401-cfefa32eb083 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:41.151882 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126bd8a9-b9e2-4d99-8401-cfefa32eb083 service neutron] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:41.178732 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 1006/2041] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jul 14 10:53:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:53:41.180508 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126bd8a9-b9e2-4d99-8401-cfefa32eb083 service neutron] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:41.184365 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-126bd8a9-b9e2-4d99-8401-cfefa32eb083 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:41.211127 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126bd8a9-b9e2-4d99-8401-cfefa32eb083 service neutron] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:41.249674 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab633e8f-b332-4885-9a73-d85ca75e750e admin admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:41.256133 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f123f5eb-48d2-4805-a958-f87e17d82d45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:41.257343 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f123f5eb-48d2-4805-a958-f87e17d82d45 admin admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:41.257630 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f123f5eb-48d2-4805-a958-f87e17d82d45 admin admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:41.257964 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f123f5eb-48d2-4805-a958-f87e17d82d45 admin admin] PATH_INFO: `/v3/roles` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:41.258658 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:53:41.258775 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f123f5eb-48d2-4805-a958-f87e17d82d45 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:41.262059 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f123f5eb-48d2-4805-a958-f87e17d82d45 admin admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:41.277971 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 1036/2042] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jul 14 10:53:41 2022] GET /identity/v3/roles => generated 1420 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:53:41.282324 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f123f5eb-48d2-4805-a958-f87e17d82d45 admin admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:41.296327 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f123f5eb-48d2-4805-a958-f87e17d82d45 admin admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:41.303359 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41e1ca2-0041-4d36-b655-8ee7a89b6ec7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:41.304403 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41e1ca2-0041-4d36-b655-8ee7a89b6ec7 admin admin] REQUEST_METHOD: `PUT` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:41.304930 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41e1ca2-0041-4d36-b655-8ee7a89b6ec7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:41.305269 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41e1ca2-0041-4d36-b655-8ee7a89b6ec7 admin admin] PATH_INFO: `/v3/projects/80749a2d012044668530313a1ebe2cbf/users/90779d5839d04de19b9075e04bb3bacb/roles/153539819e5542df99269d2913bbecfb` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:41.329644 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41e1ca2-0041-4d36-b655-8ee7a89b6ec7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=80749a2d012044668530313a1ebe2cbf, user_id=90779d5839d04de19b9075e04bb3bacb, role_id=153539819e5542df99269d2913bbecfb)` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:41.331889 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51901e3-d5be-4385-bbad-b43a66a3162f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:41.333475 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51901e3-d5be-4385-bbad-b43a66a3162f admin admin] REQUEST_METHOD: `PUT` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:41.333769 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51901e3-d5be-4385-bbad-b43a66a3162f admin admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:41.334055 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51901e3-d5be-4385-bbad-b43a66a3162f admin admin] PATH_INFO: `/v3/projects/2a0bb542e3834ca99709e5d159167608/users/3e8cfc0dffb24321a8dc591c1fdb502d/roles/0da46c267d354cce81495dfdd56c1ec2` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:41.334581 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41e1ca2-0041-4d36-b655-8ee7a89b6ec7 admin admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:41.357722 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 1037/2043] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Jul 14 10:53:41 2022] PUT /identity/v3/projects/80749a2d012044668530313a1ebe2cbf/users/90779d5839d04de19b9075e04bb3bacb/roles/153539819e5542df99269d2913bbecfb => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:53:41.361988 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41e1ca2-0041-4d36-b655-8ee7a89b6ec7 admin admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:41.378214 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51901e3-d5be-4385-bbad-b43a66a3162f admin admin] RBAC: Authorizing `identity:create_grant(project_id=2a0bb542e3834ca99709e5d159167608, user_id=3e8cfc0dffb24321a8dc591c1fdb502d, role_id=0da46c267d354cce81495dfdd56c1ec2)` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:41.386251 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51901e3-d5be-4385-bbad-b43a66a3162f admin admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:41.403117 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 1007/2044] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Jul 14 10:53:41 2022] PUT /identity/v3/projects/2a0bb542e3834ca99709e5d159167608/users/3e8cfc0dffb24321a8dc591c1fdb502d/roles/0da46c267d354cce81495dfdd56c1ec2 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:53:41.415411 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580ca33a-3455-45cf-861c-c6e1fba29994 None None] REQUEST_METHOD: `POST` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:41.415749 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580ca33a-3455-45cf-861c-c6e1fba29994 None None] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:41.415969 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580ca33a-3455-45cf-861c-c6e1fba29994 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:41.417191 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:53:41.472709 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.auth.core [None req-580ca33a-3455-45cf-861c-c6e1fba29994 None None] MFA Rules not processed for user `3e8cfc0dffb24321a8dc591c1fdb502d`. Rule list: `[]` (Enabled: `True`). {{(pid=86656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:53:41.474174 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-580ca33a-3455-45cf-861c-c6e1fba29994 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:41.483276 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41e1ca2-0041-4d36-b655-8ee7a89b6ec7 admin admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:41.608733 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 1008/2045] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jul 14 10:53:41 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:53:41.611850 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580ca33a-3455-45cf-861c-c6e1fba29994 None None] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:41.628810 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c456818e-482e-4389-83bd-4dca77dbb3a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:41.631259 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c456818e-482e-4389-83bd-4dca77dbb3a5 admin admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:41.631709 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c456818e-482e-4389-83bd-4dca77dbb3a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:41.632299 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c456818e-482e-4389-83bd-4dca77dbb3a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:41.634369 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c456818e-482e-4389-83bd-4dca77dbb3a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:41.660636 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c456818e-482e-4389-83bd-4dca77dbb3a5 admin admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:41.687474 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 1038/2046] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jul 14 10:53:41 2022] GET /identity/v3/roles => generated 1420 bytes in 326 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:53:41.691803 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c456818e-482e-4389-83bd-4dca77dbb3a5 admin admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:41.716364 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c456818e-482e-4389-83bd-4dca77dbb3a5 admin admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:41.726736 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d030b3e9-4e2f-4720-87e8-aeb5b1ee61f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:41.732140 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d030b3e9-4e2f-4720-87e8-aeb5b1ee61f9 admin admin] REQUEST_METHOD: `PUT` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:41.735293 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d030b3e9-4e2f-4720-87e8-aeb5b1ee61f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:41.735649 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d030b3e9-4e2f-4720-87e8-aeb5b1ee61f9 admin admin] PATH_INFO: `/v3/projects/80749a2d012044668530313a1ebe2cbf/users/90779d5839d04de19b9075e04bb3bacb/roles/153539819e5542df99269d2913bbecfb` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:41.742844 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d030b3e9-4e2f-4720-87e8-aeb5b1ee61f9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=80749a2d012044668530313a1ebe2cbf, user_id=90779d5839d04de19b9075e04bb3bacb, role_id=153539819e5542df99269d2913bbecfb)` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:41.750176 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d030b3e9-4e2f-4720-87e8-aeb5b1ee61f9 admin admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:41.753994 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580ca33a-3455-45cf-861c-c6e1fba29994 None None] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:41.772845 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 1039/2047] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Jul 14 10:53:41 2022] PUT /identity/v3/projects/80749a2d012044668530313a1ebe2cbf/users/90779d5839d04de19b9075e04bb3bacb/roles/153539819e5542df99269d2913bbecfb => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:53:41.773223 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdfd76f-9e76-4007-b423-ad4ee9208894 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:41.773223 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdfd76f-9e76-4007-b423-ad4ee9208894 admin admin] REQUEST_METHOD: `POST` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:41.773512 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d030b3e9-4e2f-4720-87e8-aeb5b1ee61f9 admin admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:41.773599 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdfd76f-9e76-4007-b423-ad4ee9208894 admin admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:41.773599 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdfd76f-9e76-4007-b423-ad4ee9208894 admin admin] PATH_INFO: `/v3/projects` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:41.773599 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbdfd76f-9e76-4007-b423-ad4ee9208894 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:41.773807 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-d030b3e9-4e2f-4720-87e8-aeb5b1ee61f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:41.773897 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbdfd76f-9e76-4007-b423-ad4ee9208894 admin admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:41.849261 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 1009/2048] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Jul 14 10:53:41 2022] POST /identity/v3/projects => generated 377 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:53:41.849261 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700a2040-961d-43b1-8e3a-6374b2ec139c None None] REQUEST_METHOD: `POST` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:41.849261 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700a2040-961d-43b1-8e3a-6374b2ec139c None None] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:41.849647 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700a2040-961d-43b1-8e3a-6374b2ec139c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:41.899682 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.auth.core [None req-700a2040-961d-43b1-8e3a-6374b2ec139c None None] MFA Rules not processed for user `90779d5839d04de19b9075e04bb3bacb`. Rule list: `[]` (Enabled: `True`). {{(pid=86656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:53:41.905276 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-700a2040-961d-43b1-8e3a-6374b2ec139c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:41.923313 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:53:41.928656 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d030b3e9-4e2f-4720-87e8-aeb5b1ee61f9 admin admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:42.027124 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4e1997-c3c7-420d-bac8-b7f9da6ae67a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:42.028576 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4e1997-c3c7-420d-bac8-b7f9da6ae67a admin admin] REQUEST_METHOD: `DELETE` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:42.029033 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4e1997-c3c7-420d-bac8-b7f9da6ae67a admin admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:42.029544 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4e1997-c3c7-420d-bac8-b7f9da6ae67a admin admin] PATH_INFO: `/v3/projects/8e3f0f6e8b8a4b3cb3e889b5dc618356` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:42.031460 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4e1997-c3c7-420d-bac8-b7f9da6ae67a admin admin] RBAC: Authorizing `identity:delete_project(project_id=8e3f0f6e8b8a4b3cb3e889b5dc618356)` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:42.033463 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4e1997-c3c7-420d-bac8-b7f9da6ae67a admin admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:42.033950 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 1010/2049] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jul 14 10:53:41 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:53:42.035143 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700a2040-961d-43b1-8e3a-6374b2ec139c None None] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:42.052873 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:53:42.058408 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700a2040-961d-43b1-8e3a-6374b2ec139c None None] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:42.064989 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a645a8a4-73a2-41ea-b49b-7e614d96d962 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:42.066071 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a645a8a4-73a2-41ea-b49b-7e614d96d962 admin admin] REQUEST_METHOD: `POST` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:42.066359 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a645a8a4-73a2-41ea-b49b-7e614d96d962 admin admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:42.066678 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a645a8a4-73a2-41ea-b49b-7e614d96d962 admin admin] PATH_INFO: `/v3/users` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:42.068705 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a645a8a4-73a2-41ea-b49b-7e614d96d962 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:42.077599 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a645a8a4-73a2-41ea-b49b-7e614d96d962 admin admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:42.107096 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 1011/2050] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Jul 14 10:53:42 2022] POST /identity/v3/users => generated 295 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:53:42.108303 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a645a8a4-73a2-41ea-b49b-7e614d96d962 admin admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:42.110144 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-a645a8a4-73a2-41ea-b49b-7e614d96d962 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:42.121054 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-2a4e1997-c3c7-420d-bac8-b7f9da6ae67a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8e3f0f6e8b8a4b3cb3e889b5dc618356', 'request_id': 'req-2a4e1997-c3c7-420d-bac8-b7f9da6ae67a'} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:42.130063 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-2a4e1997-c3c7-420d-bac8-b7f9da6ae67a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8e3f0f6e8b8a4b3cb3e889b5dc618356', 'request_id': 'req-2a4e1997-c3c7-420d-bac8-b7f9da6ae67a'} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:42.142466 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-2a4e1997-c3c7-420d-bac8-b7f9da6ae67a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8e3f0f6e8b8a4b3cb3e889b5dc618356', 'request_id': 'req-2a4e1997-c3c7-420d-bac8-b7f9da6ae67a'} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:42.164992 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-2a4e1997-c3c7-420d-bac8-b7f9da6ae67a admin admin] The token cache is being invalidate because project 8e3f0f6e8b8a4b3cb3e889b5dc618356 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86655) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 10:53:42.165427 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-2a4e1997-c3c7-420d-bac8-b7f9da6ae67a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:42.166161 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-2a4e1997-c3c7-420d-bac8-b7f9da6ae67a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:42.168643 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 1040/2051] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Jul 14 10:53:41 2022] DELETE /identity/v3/projects/8e3f0f6e8b8a4b3cb3e889b5dc618356 => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:53:42.169324 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4e1997-c3c7-420d-bac8-b7f9da6ae67a admin admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:42.170691 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-2a4e1997-c3c7-420d-bac8-b7f9da6ae67a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:42.187578 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a645a8a4-73a2-41ea-b49b-7e614d96d962 admin admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:42.246778 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149fa9a3-eaf4-40f7-8c3c-fc37da0221ff service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68382432147a48c3b62271fd2a2eab04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59391272ecbe48b0aa736cb43807be1d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:42.248549 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149fa9a3-eaf4-40f7-8c3c-fc37da0221ff service cinder] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:42.248971 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149fa9a3-eaf4-40f7-8c3c-fc37da0221ff service cinder] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:42.249305 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149fa9a3-eaf4-40f7-8c3c-fc37da0221ff service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:42.252280 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-149fa9a3-eaf4-40f7-8c3c-fc37da0221ff service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:42.261081 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4e1997-c3c7-420d-bac8-b7f9da6ae67a admin admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:42.274776 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d78548-63fa-42d3-a8e3-d7eb9cef0839 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:42.275561 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d78548-63fa-42d3-a8e3-d7eb9cef0839 admin admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:42.276519 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d78548-63fa-42d3-a8e3-d7eb9cef0839 admin admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:42.276519 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d78548-63fa-42d3-a8e3-d7eb9cef0839 admin admin] PATH_INFO: `/v3/roles` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:42.277382 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d78548-63fa-42d3-a8e3-d7eb9cef0839 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:42.281076 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d78548-63fa-42d3-a8e3-d7eb9cef0839 admin admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:42.298525 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 1041/2052] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jul 14 10:53:42 2022] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:53:42.303319 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507aeb2b-4daa-405f-89c7-c75e0f526d54 None None] REQUEST_METHOD: `POST` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:42.303619 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507aeb2b-4daa-405f-89c7-c75e0f526d54 None None] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:42.303890 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507aeb2b-4daa-405f-89c7-c75e0f526d54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:42.332736 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.auth.core [None req-507aeb2b-4daa-405f-89c7-c75e0f526d54 None None] MFA Rules not processed for user `ae4bcdd8106d4bebbdcae96be33505bc`. Rule list: `[]` (Enabled: `True`). {{(pid=86655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:53:42.334043 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-507aeb2b-4daa-405f-89c7-c75e0f526d54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:42.347863 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 1042/2053] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jul 14 10:53:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:53:42.348802 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507aeb2b-4daa-405f-89c7-c75e0f526d54 None None] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:42.353603 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:53:42.360115 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149fa9a3-eaf4-40f7-8c3c-fc37da0221ff service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:42.362028 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149fa9a3-eaf4-40f7-8c3c-fc37da0221ff service cinder] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:42.369323 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507aeb2b-4daa-405f-89c7-c75e0f526d54 None None] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:42.375372 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e029e7-a6f2-452e-9461-8cfe48560913 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:42.376500 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e029e7-a6f2-452e-9461-8cfe48560913 admin admin] REQUEST_METHOD: `PUT` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:42.376708 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e029e7-a6f2-452e-9461-8cfe48560913 admin admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:42.377027 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e029e7-a6f2-452e-9461-8cfe48560913 admin admin] PATH_INFO: `/v3/projects/4269af6c85f54c8e9219bf99d8db06c9/users/bf2ff7ed345d4424af8d85ad3a4afd78/roles/153539819e5542df99269d2913bbecfb` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:42.382096 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 1012/2054] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jul 14 10:53:42 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 274 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:53:42.385068 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134b5433-d734-456f-8f21-6f07f1e6fa5a None None] REQUEST_METHOD: `POST` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:42.385594 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134b5433-d734-456f-8f21-6f07f1e6fa5a None None] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:42.386299 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134b5433-d734-456f-8f21-6f07f1e6fa5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:42.414726 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.auth.core [None req-134b5433-d734-456f-8f21-6f07f1e6fa5a None None] MFA Rules not processed for user `ae4bcdd8106d4bebbdcae96be33505bc`. Rule list: `[]` (Enabled: `True`). {{(pid=86656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:53:42.416096 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-134b5433-d734-456f-8f21-6f07f1e6fa5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:42.417085 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e029e7-a6f2-452e-9461-8cfe48560913 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4269af6c85f54c8e9219bf99d8db06c9, user_id=bf2ff7ed345d4424af8d85ad3a4afd78, role_id=153539819e5542df99269d2913bbecfb)` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:42.424273 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e029e7-a6f2-452e-9461-8cfe48560913 admin admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:42.441419 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 1013/2055] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jul 14 10:53:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:53:42.446002 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134b5433-d734-456f-8f21-6f07f1e6fa5a None None] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:42.459848 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134b5433-d734-456f-8f21-6f07f1e6fa5a None None] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:42.469935 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 1043/2056] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Jul 14 10:53:42 2022] PUT /identity/v3/projects/4269af6c85f54c8e9219bf99d8db06c9/users/bf2ff7ed345d4424af8d85ad3a4afd78/roles/153539819e5542df99269d2913bbecfb => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:53:42.472602 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e029e7-a6f2-452e-9461-8cfe48560913 admin admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:42.578848 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb758722-8bfc-4788-9988-75cc9ae872c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:42.580644 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb758722-8bfc-4788-9988-75cc9ae872c5 admin admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:42.581133 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb758722-8bfc-4788-9988-75cc9ae872c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:42.581680 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb758722-8bfc-4788-9988-75cc9ae872c5 admin admin] PATH_INFO: `/v3/domains` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:42.582622 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb758722-8bfc-4788-9988-75cc9ae872c5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:53:42.583283 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb758722-8bfc-4788-9988-75cc9ae872c5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:42.585495 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb758722-8bfc-4788-9988-75cc9ae872c5 admin admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:42.605249 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 1014/2057] 10.222.0.16 () {58 vars in 1152 bytes} [Thu Jul 14 10:53:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:53:42.605249 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb758722-8bfc-4788-9988-75cc9ae872c5 admin admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:42.605683 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-cb758722-8bfc-4788-9988-75cc9ae872c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:42.642280 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e029e7-a6f2-452e-9461-8cfe48560913 admin admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:42.649766 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953100fe-b0d1-44a6-b1d7-4d356531edd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:42.650828 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953100fe-b0d1-44a6-b1d7-4d356531edd0 admin admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:42.651890 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953100fe-b0d1-44a6-b1d7-4d356531edd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:42.652762 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953100fe-b0d1-44a6-b1d7-4d356531edd0 admin admin] PATH_INFO: `/v3/roles` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:42.653840 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953100fe-b0d1-44a6-b1d7-4d356531edd0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:42.656439 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953100fe-b0d1-44a6-b1d7-4d356531edd0 admin admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:42.683507 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 1044/2058] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jul 14 10:53:42 2022] GET /identity/v3/roles => generated 1420 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:53:42.689756 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b7f641-c676-4adb-b8a7-6b0a5c04a70f None None] REQUEST_METHOD: `POST` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:42.690330 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b7f641-c676-4adb-b8a7-6b0a5c04a70f None None] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:42.691424 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b7f641-c676-4adb-b8a7-6b0a5c04a70f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:42.698838 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:53:42.730762 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.auth.core [None req-38b7f641-c676-4adb-b8a7-6b0a5c04a70f None None] MFA Rules not processed for user `e67b2b8b1f154708ac2d3d70fa24d6d0`. Rule list: `[]` (Enabled: `True`). {{(pid=86655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:53:42.732809 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-38b7f641-c676-4adb-b8a7-6b0a5c04a70f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:42.785404 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb758722-8bfc-4788-9988-75cc9ae872c5 admin admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:42.801359 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d758c54-591f-43dc-b6b9-f1a71910ebc0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68382432147a48c3b62271fd2a2eab04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59391272ecbe48b0aa736cb43807be1d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:42.802064 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d758c54-591f-43dc-b6b9-f1a71910ebc0 service cinder] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:42.802559 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d758c54-591f-43dc-b6b9-f1a71910ebc0 service cinder] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:42.802816 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d758c54-591f-43dc-b6b9-f1a71910ebc0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:42.813176 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-7d758c54-591f-43dc-b6b9-f1a71910ebc0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:42.852595 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 1045/2059] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jul 14 10:53:42 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:53:42.853823 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b7f641-c676-4adb-b8a7-6b0a5c04a70f None None] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:42.891275 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b7f641-c676-4adb-b8a7-6b0a5c04a70f None None] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:42.911754 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c13a3f8-7644-4968-b757-3542040f5524 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:42.912509 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c13a3f8-7644-4968-b757-3542040f5524 admin admin] REQUEST_METHOD: `POST` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:42.912826 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c13a3f8-7644-4968-b757-3542040f5524 admin admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:42.913132 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c13a3f8-7644-4968-b757-3542040f5524 admin admin] PATH_INFO: `/v3/projects` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:42.913828 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c13a3f8-7644-4968-b757-3542040f5524 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:42.915744 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c13a3f8-7644-4968-b757-3542040f5524 admin admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:42.947296 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 1046/2060] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Jul 14 10:53:42 2022] POST /identity/v3/projects => generated 375 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:53:42.948799 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c13a3f8-7644-4968-b757-3542040f5524 admin admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:42.978210 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d758c54-591f-43dc-b6b9-f1a71910ebc0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:42.979715 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d758c54-591f-43dc-b6b9-f1a71910ebc0 service cinder] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:42.989974 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 1015/2061] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jul 14 10:53:42 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:53:42.990858 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d758c54-591f-43dc-b6b9-f1a71910ebc0 service cinder] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:43.001516 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d758c54-591f-43dc-b6b9-f1a71910ebc0 service cinder] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:43.024907 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c13a3f8-7644-4968-b757-3542040f5524 admin admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:43.032766 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c95a487-24d4-4a24-af26-84e89e1c6b0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:43.034747 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c95a487-24d4-4a24-af26-84e89e1c6b0e admin admin] REQUEST_METHOD: `PUT` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:43.035118 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c95a487-24d4-4a24-af26-84e89e1c6b0e admin admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:43.035697 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c95a487-24d4-4a24-af26-84e89e1c6b0e admin admin] PATH_INFO: `/v3/projects/4269af6c85f54c8e9219bf99d8db06c9/users/bf2ff7ed345d4424af8d85ad3a4afd78/roles/153539819e5542df99269d2913bbecfb` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:43.037168 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=100 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:53:43.039235 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c95a487-24d4-4a24-af26-84e89e1c6b0e admin admin] RBAC: Authorizing `identity:create_grant(project_id=4269af6c85f54c8e9219bf99d8db06c9, user_id=bf2ff7ed345d4424af8d85ad3a4afd78, role_id=153539819e5542df99269d2913bbecfb)` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:43.042716 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c95a487-24d4-4a24-af26-84e89e1c6b0e admin admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:43.057743 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 1047/2062] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Jul 14 10:53:42 2022] PUT /identity/v3/projects/4269af6c85f54c8e9219bf99d8db06c9/users/bf2ff7ed345d4424af8d85ad3a4afd78/roles/153539819e5542df99269d2913bbecfb => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:53:43.058749 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c95a487-24d4-4a24-af26-84e89e1c6b0e admin admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:43.067592 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea85b7c-15f1-4a5d-bc9b-f409d46eba03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:43.068758 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea85b7c-15f1-4a5d-bc9b-f409d46eba03 admin admin] REQUEST_METHOD: `POST` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:43.069141 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea85b7c-15f1-4a5d-bc9b-f409d46eba03 admin admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:43.069287 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-3c95a487-24d4-4a24-af26-84e89e1c6b0e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:43.069455 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea85b7c-15f1-4a5d-bc9b-f409d46eba03 admin admin] PATH_INFO: `/v3/users` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:43.070285 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea85b7c-15f1-4a5d-bc9b-f409d46eba03 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:43.072400 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea85b7c-15f1-4a5d-bc9b-f409d46eba03 admin admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:43.094711 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 1016/2063] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Jul 14 10:53:42 2022] POST /identity/v3/users => generated 288 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:53:43.096290 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ebc25a-a952-4e04-b5a6-8f192aded30c None None] REQUEST_METHOD: `POST` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:43.096581 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ebc25a-a952-4e04-b5a6-8f192aded30c None None] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:43.096887 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ebc25a-a952-4e04-b5a6-8f192aded30c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:43.127022 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.auth.core [None req-96ebc25a-a952-4e04-b5a6-8f192aded30c None None] MFA Rules not processed for user `bf2ff7ed345d4424af8d85ad3a4afd78`. Rule list: `[]` (Enabled: `True`). {{(pid=86656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:53:43.128609 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-96ebc25a-a952-4e04-b5a6-8f192aded30c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:43.152443 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c95a487-24d4-4a24-af26-84e89e1c6b0e admin admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:43.160007 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6025d8c9-da89-4787-ad2d-3182c6e36dc4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68382432147a48c3b62271fd2a2eab04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59391272ecbe48b0aa736cb43807be1d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:43.160912 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6025d8c9-da89-4787-ad2d-3182c6e36dc4 service cinder] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:43.161269 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6025d8c9-da89-4787-ad2d-3182c6e36dc4 service cinder] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:43.161551 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6025d8c9-da89-4787-ad2d-3182c6e36dc4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:43.187749 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:53:43.248713 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6025d8c9-da89-4787-ad2d-3182c6e36dc4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:43.250586 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6025d8c9-da89-4787-ad2d-3182c6e36dc4 service cinder] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:43.251803 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 1017/2064] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jul 14 10:53:43 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:53:43.252752 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ebc25a-a952-4e04-b5a6-8f192aded30c None None] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:43.269106 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 1048/2065] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jul 14 10:53:43 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:53:43.281997 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6025d8c9-da89-4787-ad2d-3182c6e36dc4 service cinder] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:43.293966 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6025d8c9-da89-4787-ad2d-3182c6e36dc4 service cinder] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:43.299467 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e984ff-6124-48b1-93e9-bace3b6228b8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68382432147a48c3b62271fd2a2eab04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59391272ecbe48b0aa736cb43807be1d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:43.300627 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e984ff-6124-48b1-93e9-bace3b6228b8 service cinder] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:43.301027 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e984ff-6124-48b1-93e9-bace3b6228b8 service cinder] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:43.301320 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e984ff-6124-48b1-93e9-bace3b6228b8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:43.325275 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e984ff-6124-48b1-93e9-bace3b6228b8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:43.326374 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e984ff-6124-48b1-93e9-bace3b6228b8 service cinder] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:43.330809 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ebc25a-a952-4e04-b5a6-8f192aded30c None None] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:43.336870 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace36407-e47f-4d58-abc2-3ddb23eed816 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:43.337739 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace36407-e47f-4d58-abc2-3ddb23eed816 admin admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:43.338182 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace36407-e47f-4d58-abc2-3ddb23eed816 admin admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:43.338676 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace36407-e47f-4d58-abc2-3ddb23eed816 admin admin] PATH_INFO: `/v3/roles` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:43.339725 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace36407-e47f-4d58-abc2-3ddb23eed816 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:43.342554 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace36407-e47f-4d58-abc2-3ddb23eed816 admin admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:43.357163 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 1018/2066] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jul 14 10:53:43 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:53:43.360981 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace36407-e47f-4d58-abc2-3ddb23eed816 admin admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:43.376125 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 1049/2067] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jul 14 10:53:43 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:53:43.381435 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace36407-e47f-4d58-abc2-3ddb23eed816 admin admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:43.389582 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53486a38-1508-45bf-bafe-b2d1f571a3ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:43.391013 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53486a38-1508-45bf-bafe-b2d1f571a3ee admin admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:43.391595 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53486a38-1508-45bf-bafe-b2d1f571a3ee admin admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:43.392155 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53486a38-1508-45bf-bafe-b2d1f571a3ee admin admin] PATH_INFO: `/v3/roles` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:43.393183 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53486a38-1508-45bf-bafe-b2d1f571a3ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:43.395314 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53486a38-1508-45bf-bafe-b2d1f571a3ee admin admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:43.413852 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 1019/2068] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jul 14 10:53:43 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:53:43.415897 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e984ff-6124-48b1-93e9-bace3b6228b8 service cinder] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:43.438845 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53486a38-1508-45bf-bafe-b2d1f571a3ee admin admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:43.440472 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e984ff-6124-48b1-93e9-bace3b6228b8 service cinder] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:43.443924 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-53486a38-1508-45bf-bafe-b2d1f571a3ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:43.456014 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7884a429-df22-4c36-a835-5c4f63c79ea9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:43.456992 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7884a429-df22-4c36-a835-5c4f63c79ea9 admin admin] REQUEST_METHOD: `PUT` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:43.457283 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7884a429-df22-4c36-a835-5c4f63c79ea9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:43.458162 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7884a429-df22-4c36-a835-5c4f63c79ea9 admin admin] PATH_INFO: `/v3/projects/c98a115f08eb465c8428852c1cfc22cc/users/46ec71c79c13494abb3bd197af8b2683/roles/0da46c267d354cce81495dfdd56c1ec2` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:43.464350 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53486a38-1508-45bf-bafe-b2d1f571a3ee admin admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:43.470931 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b2a5a8-6c45-4449-b6aa-4629ef7fb85e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:43.472040 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b2a5a8-6c45-4449-b6aa-4629ef7fb85e admin admin] REQUEST_METHOD: `DELETE` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:43.472424 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b2a5a8-6c45-4449-b6aa-4629ef7fb85e admin admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:43.473000 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b2a5a8-6c45-4449-b6aa-4629ef7fb85e admin admin] PATH_INFO: `/v3/users/ccccf90e7c334aad9deca934f10c1a03` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:43.474581 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b2a5a8-6c45-4449-b6aa-4629ef7fb85e admin admin] RBAC: Authorizing `identity:delete_user(user_id=ccccf90e7c334aad9deca934f10c1a03)` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:43.477132 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b2a5a8-6c45-4449-b6aa-4629ef7fb85e admin admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:43.489813 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7884a429-df22-4c36-a835-5c4f63c79ea9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c98a115f08eb465c8428852c1cfc22cc, user_id=46ec71c79c13494abb3bd197af8b2683, role_id=0da46c267d354cce81495dfdd56c1ec2)` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:43.493127 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7884a429-df22-4c36-a835-5c4f63c79ea9 admin admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:43.519973 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 1050/2069] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Jul 14 10:53:43 2022] PUT /identity/v3/projects/c98a115f08eb465c8428852c1cfc22cc/users/46ec71c79c13494abb3bd197af8b2683/roles/0da46c267d354cce81495dfdd56c1ec2 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:53:43.529608 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7884a429-df22-4c36-a835-5c4f63c79ea9 admin admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:43.547311 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:53:43.578576 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-09b2a5a8-6c45-4449-b6aa-4629ef7fb85e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ccccf90e7c334aad9deca934f10c1a03'} {{(pid=86656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:43.594171 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-09b2a5a8-6c45-4449-b6aa-4629ef7fb85e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ccccf90e7c334aad9deca934f10c1a03'} {{(pid=86656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:43.595842 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-09b2a5a8-6c45-4449-b6aa-4629ef7fb85e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ccccf90e7c334aad9deca934f10c1a03'} {{(pid=86656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:43.629856 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-09b2a5a8-6c45-4449-b6aa-4629ef7fb85e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ccccf90e7c334aad9deca934f10c1a03'} {{(pid=86656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:43.632653 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-09b2a5a8-6c45-4449-b6aa-4629ef7fb85e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ccccf90e7c334aad9deca934f10c1a03'} {{(pid=86656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:43.658069 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7884a429-df22-4c36-a835-5c4f63c79ea9 admin admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:43.662556 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd84718-b1f1-4f97-b0e8-18c3d9266777 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68382432147a48c3b62271fd2a2eab04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59391272ecbe48b0aa736cb43807be1d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:43.663462 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 1020/2070] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Jul 14 10:53:43 2022] DELETE /identity/v3/users/ccccf90e7c334aad9deca934f10c1a03 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:53:43.665138 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576685b4-01c3-4787-badb-ac609055f332 None None] REQUEST_METHOD: `POST` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:43.665441 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576685b4-01c3-4787-badb-ac609055f332 None None] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:43.665721 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576685b4-01c3-4787-badb-ac609055f332 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:43.666725 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd84718-b1f1-4f97-b0e8-18c3d9266777 service cinder] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:43.667103 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd84718-b1f1-4f97-b0e8-18c3d9266777 service cinder] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:43.667466 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd84718-b1f1-4f97-b0e8-18c3d9266777 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:43.669731 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-abd84718-b1f1-4f97-b0e8-18c3d9266777 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:43.705057 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.auth.core [None req-576685b4-01c3-4787-badb-ac609055f332 None None] MFA Rules not processed for user `46ec71c79c13494abb3bd197af8b2683`. Rule list: `[]` (Enabled: `True`). {{(pid=86656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:53:43.706291 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-576685b4-01c3-4787-badb-ac609055f332 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:43.758519 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd84718-b1f1-4f97-b0e8-18c3d9266777 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:43.760030 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd84718-b1f1-4f97-b0e8-18c3d9266777 service cinder] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:43.771017 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 1051/2071] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jul 14 10:53:43 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 250 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:53:43.773090 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cf3573-5729-4e34-959d-411c7b14de2e None None] REQUEST_METHOD: `POST` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:43.773489 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cf3573-5729-4e34-959d-411c7b14de2e None None] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:43.774018 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cf3573-5729-4e34-959d-411c7b14de2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:43.798244 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.auth.core [None req-55cf3573-5729-4e34-959d-411c7b14de2e None None] MFA Rules not processed for user `ae4bcdd8106d4bebbdcae96be33505bc`. Rule list: `[]` (Enabled: `True`). {{(pid=86655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:53:43.798450 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 1021/2072] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jul 14 10:53:43 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:53:43.799737 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-55cf3573-5729-4e34-959d-411c7b14de2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:43.806274 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576685b4-01c3-4787-badb-ac609055f332 None None] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:43.807739 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-576685b4-01c3-4787-badb-ac609055f332 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:43.870008 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:53:43.943895 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 1052/2073] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jul 14 10:53:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:53:43.954947 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cf3573-5729-4e34-959d-411c7b14de2e None None] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:43.956971 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-55cf3573-5729-4e34-959d-411c7b14de2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:43.968694 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576685b4-01c3-4787-badb-ac609055f332 None None] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:43.978040 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac5a09b-bb17-441e-bcb8-42ae5706c459 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68382432147a48c3b62271fd2a2eab04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59391272ecbe48b0aa736cb43807be1d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:43.983142 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac5a09b-bb17-441e-bcb8-42ae5706c459 service cinder] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:43.983979 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac5a09b-bb17-441e-bcb8-42ae5706c459 service cinder] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:43.984423 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac5a09b-bb17-441e-bcb8-42ae5706c459 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:43.999490 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac5a09b-bb17-441e-bcb8-42ae5706c459 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:44.002396 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac5a09b-bb17-441e-bcb8-42ae5706c459 service cinder] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:44.020855 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 1022/2074] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jul 14 10:53:43 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 10:53:44.098632 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cf3573-5729-4e34-959d-411c7b14de2e None None] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:44.107460 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a52c62-c1b8-479b-9b10-8b369c7aeeb6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dddf93691844886982c91fea974385d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59391272ecbe48b0aa736cb43807be1d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:44.108737 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a52c62-c1b8-479b-9b10-8b369c7aeeb6 service neutron] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:44.109287 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a52c62-c1b8-479b-9b10-8b369c7aeeb6 service neutron] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:44.109792 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a52c62-c1b8-479b-9b10-8b369c7aeeb6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:44.127261 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a52c62-c1b8-479b-9b10-8b369c7aeeb6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:44.130148 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a52c62-c1b8-479b-9b10-8b369c7aeeb6 service neutron] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:44.147815 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 1053/2075] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jul 14 10:53:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 10:53:44.719774 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac5a09b-bb17-441e-bcb8-42ae5706c459 service cinder] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:44.721407 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-dac5a09b-bb17-441e-bcb8-42ae5706c459 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:44.743811 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac5a09b-bb17-441e-bcb8-42ae5706c459 service cinder] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:44.771878 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b6d2e8-b3e5-4f6b-8125-a02ea99df01f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:44.773058 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b6d2e8-b3e5-4f6b-8125-a02ea99df01f admin admin] REQUEST_METHOD: `DELETE` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:44.773335 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b6d2e8-b3e5-4f6b-8125-a02ea99df01f admin admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:44.773622 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b6d2e8-b3e5-4f6b-8125-a02ea99df01f admin admin] PATH_INFO: `/v3/projects/136516421a45480ebf5e92b09ebecfdd` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:44.775099 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b6d2e8-b3e5-4f6b-8125-a02ea99df01f admin admin] RBAC: Authorizing `identity:delete_project(project_id=136516421a45480ebf5e92b09ebecfdd)` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:44.814190 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4370e5-3eb2-4d6b-b4a1-cd79b809e802 None None] REQUEST_METHOD: `POST` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:44.814660 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4370e5-3eb2-4d6b-b4a1-cd79b809e802 None None] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:44.814744 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4370e5-3eb2-4d6b-b4a1-cd79b809e802 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:44.824611 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b6d2e8-b3e5-4f6b-8125-a02ea99df01f admin admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:44.845870 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.auth.core [None req-8c4370e5-3eb2-4d6b-b4a1-cd79b809e802 None None] MFA Rules not processed for user `e67b2b8b1f154708ac2d3d70fa24d6d0`. Rule list: `[]` (Enabled: `True`). {{(pid=86655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:53:44.847998 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-8c4370e5-3eb2-4d6b-b4a1-cd79b809e802 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:44.931108 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-b5b6d2e8-b3e5-4f6b-8125-a02ea99df01f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '136516421a45480ebf5e92b09ebecfdd', 'request_id': 'req-b5b6d2e8-b3e5-4f6b-8125-a02ea99df01f'} {{(pid=86656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:44.933096 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:53:44.944748 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-b5b6d2e8-b3e5-4f6b-8125-a02ea99df01f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '136516421a45480ebf5e92b09ebecfdd', 'request_id': 'req-b5b6d2e8-b3e5-4f6b-8125-a02ea99df01f'} {{(pid=86656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:44.964722 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-b5b6d2e8-b3e5-4f6b-8125-a02ea99df01f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '136516421a45480ebf5e92b09ebecfdd', 'request_id': 'req-b5b6d2e8-b3e5-4f6b-8125-a02ea99df01f'} {{(pid=86656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:45.000799 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-b5b6d2e8-b3e5-4f6b-8125-a02ea99df01f admin admin] The token cache is being invalidate because project 136516421a45480ebf5e92b09ebecfdd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86656) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 10:53:45.001102 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-b5b6d2e8-b3e5-4f6b-8125-a02ea99df01f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:45.001994 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-b5b6d2e8-b3e5-4f6b-8125-a02ea99df01f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:45.005644 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 1023/2076] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Jul 14 10:53:44 2022] DELETE /identity/v3/projects/136516421a45480ebf5e92b09ebecfdd => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:53:45.017395 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b6d2e8-b3e5-4f6b-8125-a02ea99df01f admin admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:45.020626 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-b5b6d2e8-b3e5-4f6b-8125-a02ea99df01f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:45.022308 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 1054/2077] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jul 14 10:53:44 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:53:45.112600 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b6d2e8-b3e5-4f6b-8125-a02ea99df01f admin admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:45.118011 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5898e365-1294-4983-9775-de7485becbe6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:45.118972 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5898e365-1294-4983-9775-de7485becbe6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:45.119323 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5898e365-1294-4983-9775-de7485becbe6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:45.119663 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5898e365-1294-4983-9775-de7485becbe6 admin admin] PATH_INFO: `/v3/users/8559443189ee4f55b80900b99dddd9d4` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:45.120989 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5898e365-1294-4983-9775-de7485becbe6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8559443189ee4f55b80900b99dddd9d4)` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:45.123947 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5898e365-1294-4983-9775-de7485becbe6 admin admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:45.185351 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-5898e365-1294-4983-9775-de7485becbe6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8559443189ee4f55b80900b99dddd9d4'} {{(pid=86656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:45.193681 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-5898e365-1294-4983-9775-de7485becbe6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8559443189ee4f55b80900b99dddd9d4'} {{(pid=86656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:45.194333 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-5898e365-1294-4983-9775-de7485becbe6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8559443189ee4f55b80900b99dddd9d4'} {{(pid=86656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:45.202285 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-5898e365-1294-4983-9775-de7485becbe6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8559443189ee4f55b80900b99dddd9d4'} {{(pid=86656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:45.203046 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-5898e365-1294-4983-9775-de7485becbe6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8559443189ee4f55b80900b99dddd9d4'} {{(pid=86656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:45.220047 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 1024/2078] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Jul 14 10:53:45 2022] DELETE /identity/v3/users/8559443189ee4f55b80900b99dddd9d4 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:53:45.642816 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4370e5-3eb2-4d6b-b4a1-cd79b809e802 None None] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:45.659705 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4370e5-3eb2-4d6b-b4a1-cd79b809e802 None None] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:45.788196 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d23c390-cf46-486e-b4f5-b1ed2ebcf532 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:45.789734 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d23c390-cf46-486e-b4f5-b1ed2ebcf532 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:45.790431 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d23c390-cf46-486e-b4f5-b1ed2ebcf532 admin admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:45.790846 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d23c390-cf46-486e-b4f5-b1ed2ebcf532 admin admin] PATH_INFO: `/v3/projects/c1413590403a4e9892ad3b5101e3279d` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:45.792186 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d23c390-cf46-486e-b4f5-b1ed2ebcf532 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c1413590403a4e9892ad3b5101e3279d)` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:45.794661 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d23c390-cf46-486e-b4f5-b1ed2ebcf532 admin admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:45.843831 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:53:45.873724 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-6d23c390-cf46-486e-b4f5-b1ed2ebcf532 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c1413590403a4e9892ad3b5101e3279d', 'request_id': 'req-6d23c390-cf46-486e-b4f5-b1ed2ebcf532'} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:45.894329 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-6d23c390-cf46-486e-b4f5-b1ed2ebcf532 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c1413590403a4e9892ad3b5101e3279d', 'request_id': 'req-6d23c390-cf46-486e-b4f5-b1ed2ebcf532'} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:45.919339 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-6d23c390-cf46-486e-b4f5-b1ed2ebcf532 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c1413590403a4e9892ad3b5101e3279d', 'request_id': 'req-6d23c390-cf46-486e-b4f5-b1ed2ebcf532'} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:45.941706 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-6d23c390-cf46-486e-b4f5-b1ed2ebcf532 admin admin] The token cache is being invalidate because project c1413590403a4e9892ad3b5101e3279d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86655) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 10:53:45.942769 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-6d23c390-cf46-486e-b4f5-b1ed2ebcf532 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:45.944375 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-6d23c390-cf46-486e-b4f5-b1ed2ebcf532 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:45.948402 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 1055/2079] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Jul 14 10:53:45 2022] DELETE /identity/v3/projects/c1413590403a4e9892ad3b5101e3279d => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:53:45.954729 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d0be5d-17c1-4f95-93c7-dbeb6d5eeb08 None None] REQUEST_METHOD: `POST` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:45.955413 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d0be5d-17c1-4f95-93c7-dbeb6d5eeb08 None None] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:45.955652 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d0be5d-17c1-4f95-93c7-dbeb6d5eeb08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:45.983307 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.auth.core [None req-e9d0be5d-17c1-4f95-93c7-dbeb6d5eeb08 None None] MFA Rules not processed for user `ae4bcdd8106d4bebbdcae96be33505bc`. Rule list: `[]` (Enabled: `True`). {{(pid=86656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:53:45.984713 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-e9d0be5d-17c1-4f95-93c7-dbeb6d5eeb08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:46.048835 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:DELETE=15,keystone:SELECT=83,keystone:INSERT=2 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:53:46.081546 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 1025/2080] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jul 14 10:53:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:53:46.091633 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a7387f-1a48-4c90-ae6c-2085035b11bf None None] REQUEST_METHOD: `POST` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:46.092257 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a7387f-1a48-4c90-ae6c-2085035b11bf None None] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:46.092877 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a7387f-1a48-4c90-ae6c-2085035b11bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:46.148302 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.auth.core [None req-29a7387f-1a48-4c90-ae6c-2085035b11bf None None] MFA Rules not processed for user `ae4bcdd8106d4bebbdcae96be33505bc`. Rule list: `[]` (Enabled: `True`). {{(pid=86655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:53:46.149757 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-29a7387f-1a48-4c90-ae6c-2085035b11bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:46.177406 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 1056/2081] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jul 14 10:53:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:53:46.181456 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d0be5d-17c1-4f95-93c7-dbeb6d5eeb08 None None] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:46.198351 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d0be5d-17c1-4f95-93c7-dbeb6d5eeb08 None None] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:46.211617 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ab656a-84ec-417c-b680-b49b2221817a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:46.212837 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ab656a-84ec-417c-b680-b49b2221817a admin admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:46.212837 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ab656a-84ec-417c-b680-b49b2221817a admin admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:46.213615 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ab656a-84ec-417c-b680-b49b2221817a admin admin] PATH_INFO: `/v3/domains` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:46.215568 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ab656a-84ec-417c-b680-b49b2221817a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:53:46.216987 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ab656a-84ec-417c-b680-b49b2221817a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:46.221765 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ab656a-84ec-417c-b680-b49b2221817a admin admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:46.250013 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 1026/2082] 10.222.0.16 () {58 vars in 1152 bytes} [Thu Jul 14 10:53:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:53:46.254971 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a7387f-1a48-4c90-ae6c-2085035b11bf None None] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:46.270152 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a7387f-1a48-4c90-ae6c-2085035b11bf None None] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:46.277156 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6c76a6-94ff-415f-afce-d60fccd79160 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:46.289592 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6c76a6-94ff-415f-afce-d60fccd79160 admin admin] REQUEST_METHOD: `POST` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:46.290169 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6c76a6-94ff-415f-afce-d60fccd79160 admin admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:46.290635 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6c76a6-94ff-415f-afce-d60fccd79160 admin admin] PATH_INFO: `/v3/projects` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:46.291851 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6c76a6-94ff-415f-afce-d60fccd79160 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:46.297255 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6c76a6-94ff-415f-afce-d60fccd79160 admin admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:46.370192 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 1057/2083] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Jul 14 10:53:46 2022] POST /identity/v3/projects => generated 379 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:53:46.373625 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ab656a-84ec-417c-b680-b49b2221817a admin admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:46.384177 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ab656a-84ec-417c-b680-b49b2221817a admin admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:46.495507 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0915c14-d336-4491-80e1-a367542ba14a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:46.496434 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0915c14-d336-4491-80e1-a367542ba14a admin admin] REQUEST_METHOD: `POST` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:46.496812 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0915c14-d336-4491-80e1-a367542ba14a admin admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:46.499329 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0915c14-d336-4491-80e1-a367542ba14a admin admin] PATH_INFO: `/v3/users` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:46.499329 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0915c14-d336-4491-80e1-a367542ba14a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:46.501471 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0915c14-d336-4491-80e1-a367542ba14a admin admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:46.531791 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 1027/2084] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Jul 14 10:53:46 2022] POST /identity/v3/users => generated 290 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:53:46.535644 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6c76a6-94ff-415f-afce-d60fccd79160 admin admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:46.548163 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6c76a6-94ff-415f-afce-d60fccd79160 admin admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:46.566460 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3681b5f9-2e3d-4240-ba2c-c8f5a5e83feb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:46.567449 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3681b5f9-2e3d-4240-ba2c-c8f5a5e83feb admin admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:46.567883 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3681b5f9-2e3d-4240-ba2c-c8f5a5e83feb admin admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:46.568570 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3681b5f9-2e3d-4240-ba2c-c8f5a5e83feb admin admin] PATH_INFO: `/v3/roles` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:46.569551 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3681b5f9-2e3d-4240-ba2c-c8f5a5e83feb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:46.575109 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3681b5f9-2e3d-4240-ba2c-c8f5a5e83feb admin admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:46.602092 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0915c14-d336-4491-80e1-a367542ba14a admin admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:46.603681 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 1058/2085] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jul 14 10:53:46 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:53:46.614821 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0915c14-d336-4491-80e1-a367542ba14a admin admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:46.634522 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06168bd-b2fc-4b04-89c7-0a242fb32cf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:46.635198 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06168bd-b2fc-4b04-89c7-0a242fb32cf4 admin admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:46.635485 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06168bd-b2fc-4b04-89c7-0a242fb32cf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:46.635821 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06168bd-b2fc-4b04-89c7-0a242fb32cf4 admin admin] PATH_INFO: `/v3/roles` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:46.636566 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06168bd-b2fc-4b04-89c7-0a242fb32cf4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:46.638429 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06168bd-b2fc-4b04-89c7-0a242fb32cf4 admin admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:46.662213 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 1028/2086] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jul 14 10:53:46 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:53:46.667257 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3681b5f9-2e3d-4240-ba2c-c8f5a5e83feb admin admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:46.679932 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3681b5f9-2e3d-4240-ba2c-c8f5a5e83feb admin admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:46.688265 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc817b6-8e7a-4e8f-907f-56a66bd7a3cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:46.689231 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc817b6-8e7a-4e8f-907f-56a66bd7a3cd admin admin] REQUEST_METHOD: `PUT` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:46.689594 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc817b6-8e7a-4e8f-907f-56a66bd7a3cd admin admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:46.705981 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc817b6-8e7a-4e8f-907f-56a66bd7a3cd admin admin] PATH_INFO: `/v3/projects/4718bcc272be43e0b036a3badd326884/users/9019049371764062907cbe39268c5f00/roles/0da46c267d354cce81495dfdd56c1ec2` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:46.743865 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc817b6-8e7a-4e8f-907f-56a66bd7a3cd admin admin] RBAC: Authorizing `identity:create_grant(project_id=4718bcc272be43e0b036a3badd326884, user_id=9019049371764062907cbe39268c5f00, role_id=0da46c267d354cce81495dfdd56c1ec2)` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:46.747812 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc817b6-8e7a-4e8f-907f-56a66bd7a3cd admin admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:46.769489 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 1059/2087] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Jul 14 10:53:46 2022] PUT /identity/v3/projects/4718bcc272be43e0b036a3badd326884/users/9019049371764062907cbe39268c5f00/roles/0da46c267d354cce81495dfdd56c1ec2 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 10:53:46.787901 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc45ae24-2246-402a-92cb-a184d8ec7106 None None] REQUEST_METHOD: `POST` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:46.788191 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc45ae24-2246-402a-92cb-a184d8ec7106 None None] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:46.788468 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc45ae24-2246-402a-92cb-a184d8ec7106 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:46.836153 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.auth.core [None req-cc45ae24-2246-402a-92cb-a184d8ec7106 None None] MFA Rules not processed for user `9019049371764062907cbe39268c5f00`. Rule list: `[]` (Enabled: `True`). {{(pid=86656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:53:46.836153 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-cc45ae24-2246-402a-92cb-a184d8ec7106 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:46.913427 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 1029/2088] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jul 14 10:53:46 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:53:46.920687 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc817b6-8e7a-4e8f-907f-56a66bd7a3cd admin admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:46.998282 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc817b6-8e7a-4e8f-907f-56a66bd7a3cd admin admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:47.003847 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05974c4-2cbd-4257-ab11-7cdc150af5c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:47.004536 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05974c4-2cbd-4257-ab11-7cdc150af5c5 admin admin] REQUEST_METHOD: `POST` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:47.004849 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05974c4-2cbd-4257-ab11-7cdc150af5c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:47.005130 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05974c4-2cbd-4257-ab11-7cdc150af5c5 admin admin] PATH_INFO: `/v3/projects` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:47.006033 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05974c4-2cbd-4257-ab11-7cdc150af5c5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:47.008191 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05974c4-2cbd-4257-ab11-7cdc150af5c5 admin admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:47.041430 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 1060/2089] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Jul 14 10:53:46 2022] POST /identity/v3/projects => generated 379 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:53:47.042671 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc45ae24-2246-402a-92cb-a184d8ec7106 None None] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:47.057599 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc45ae24-2246-402a-92cb-a184d8ec7106 None None] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:47.105491 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:53:47.133058 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ccf599-7046-4159-9ef0-541445e53274 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:47.133782 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ccf599-7046-4159-9ef0-541445e53274 admin admin] REQUEST_METHOD: `POST` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:47.133927 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ccf599-7046-4159-9ef0-541445e53274 admin admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:47.134194 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ccf599-7046-4159-9ef0-541445e53274 admin admin] PATH_INFO: `/v3/users` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:47.134912 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ccf599-7046-4159-9ef0-541445e53274 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:47.136951 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ccf599-7046-4159-9ef0-541445e53274 admin admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:47.164370 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 1030/2090] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Jul 14 10:53:47 2022] POST /identity/v3/users => generated 296 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 10:53:47.164711 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05974c4-2cbd-4257-ab11-7cdc150af5c5 admin admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:47.165971 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ccf599-7046-4159-9ef0-541445e53274 admin admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:47.166655 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-a05974c4-2cbd-4257-ab11-7cdc150af5c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:47.175746 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ccf599-7046-4159-9ef0-541445e53274 admin admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:47.179634 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05974c4-2cbd-4257-ab11-7cdc150af5c5 admin admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:47.180361 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862e6154-b1e6-4bd7-8049-ce7014fbd8b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:47.181051 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862e6154-b1e6-4bd7-8049-ce7014fbd8b2 admin admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:47.181323 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862e6154-b1e6-4bd7-8049-ce7014fbd8b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:47.181599 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862e6154-b1e6-4bd7-8049-ce7014fbd8b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:47.182319 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862e6154-b1e6-4bd7-8049-ce7014fbd8b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:47.183924 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862e6154-b1e6-4bd7-8049-ce7014fbd8b2 admin admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:47.184665 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5557c0-41d9-4a78-ae49-6a9b5d998df0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:47.185663 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5557c0-41d9-4a78-ae49-6a9b5d998df0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:47.185951 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5557c0-41d9-4a78-ae49-6a9b5d998df0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:47.186234 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5557c0-41d9-4a78-ae49-6a9b5d998df0 admin admin] PATH_INFO: `/v3/users/44f20deea5e047ca91d3592ace5e1640` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:47.187460 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5557c0-41d9-4a78-ae49-6a9b5d998df0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=44f20deea5e047ca91d3592ace5e1640)` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:47.189435 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5557c0-41d9-4a78-ae49-6a9b5d998df0 admin admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:47.194327 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 1031/2091] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jul 14 10:53:47 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:53:47.198448 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862e6154-b1e6-4bd7-8049-ce7014fbd8b2 admin admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:47.210173 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862e6154-b1e6-4bd7-8049-ce7014fbd8b2 admin admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:47.215670 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fcc27b-2f0b-4bba-9e04-1fe447d5d0b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:47.217980 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fcc27b-2f0b-4bba-9e04-1fe447d5d0b4 admin admin] REQUEST_METHOD: `PUT` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:47.218264 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fcc27b-2f0b-4bba-9e04-1fe447d5d0b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:47.218596 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fcc27b-2f0b-4bba-9e04-1fe447d5d0b4 admin admin] PATH_INFO: `/v3/projects/e85aed0d1b3a416babb9dd49c87921a6/users/f38b6f63fdcf46d89d427cb878c5969e/roles/153539819e5542df99269d2913bbecfb` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:47.228700 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:DELETE=11,keystone:SELECT=85,keystone:INSERT=4 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:53:47.237346 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9fcc27b-2f0b-4bba-9e04-1fe447d5d0b4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e85aed0d1b3a416babb9dd49c87921a6, user_id=f38b6f63fdcf46d89d427cb878c5969e, role_id=153539819e5542df99269d2913bbecfb)` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:47.240457 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9fcc27b-2f0b-4bba-9e04-1fe447d5d0b4 admin admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:47.246678 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-1c5557c0-41d9-4a78-ae49-6a9b5d998df0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '44f20deea5e047ca91d3592ace5e1640'} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:47.253638 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-1c5557c0-41d9-4a78-ae49-6a9b5d998df0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '44f20deea5e047ca91d3592ace5e1640'} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:47.254322 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-1c5557c0-41d9-4a78-ae49-6a9b5d998df0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '44f20deea5e047ca91d3592ace5e1640'} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:47.254629 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 1032/2092] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Jul 14 10:53:47 2022] PUT /identity/v3/projects/e85aed0d1b3a416babb9dd49c87921a6/users/f38b6f63fdcf46d89d427cb878c5969e/roles/153539819e5542df99269d2913bbecfb => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 10:53:47.258771 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fcc27b-2f0b-4bba-9e04-1fe447d5d0b4 admin admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:47.260477 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-c9fcc27b-2f0b-4bba-9e04-1fe447d5d0b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:47.264733 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-1c5557c0-41d9-4a78-ae49-6a9b5d998df0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '44f20deea5e047ca91d3592ace5e1640'} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:47.265564 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-1c5557c0-41d9-4a78-ae49-6a9b5d998df0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '44f20deea5e047ca91d3592ace5e1640'} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:47.283625 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 1061/2093] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Jul 14 10:53:47 2022] DELETE /identity/v3/users/44f20deea5e047ca91d3592ace5e1640 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 10:53:47.288386 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5204556f-0838-4011-887f-86e3056a1aa4 None None] REQUEST_METHOD: `POST` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:47.288636 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5204556f-0838-4011-887f-86e3056a1aa4 None None] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:47.288957 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5204556f-0838-4011-887f-86e3056a1aa4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:47.306762 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.auth.core [None req-5204556f-0838-4011-887f-86e3056a1aa4 None None] MFA Rules not processed for user `ae4bcdd8106d4bebbdcae96be33505bc`. Rule list: `[]` (Enabled: `True`). {{(pid=86655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:53:47.308042 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-5204556f-0838-4011-887f-86e3056a1aa4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:47.329688 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fcc27b-2f0b-4bba-9e04-1fe447d5d0b4 admin admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:47.405673 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 1062/2094] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jul 14 10:53:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 10:53:47.417243 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5204556f-0838-4011-887f-86e3056a1aa4 None None] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:47.422226 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-5204556f-0838-4011-887f-86e3056a1aa4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:47.430349 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f6df54-26c6-48a8-b08f-f3eff0325bd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:47.431285 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f6df54-26c6-48a8-b08f-f3eff0325bd0 admin admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:47.431718 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f6df54-26c6-48a8-b08f-f3eff0325bd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:47.433923 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f6df54-26c6-48a8-b08f-f3eff0325bd0 admin admin] PATH_INFO: `/v3/roles` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:47.435550 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f6df54-26c6-48a8-b08f-f3eff0325bd0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:47.441150 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f6df54-26c6-48a8-b08f-f3eff0325bd0 admin admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:47.472113 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 1033/2095] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jul 14 10:53:47 2022] GET /identity/v3/roles => generated 1420 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 10:53:47.473226 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f6df54-26c6-48a8-b08f-f3eff0325bd0 admin admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:47.485852 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f6df54-26c6-48a8-b08f-f3eff0325bd0 admin admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:47.491502 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407e49c7-fb42-493d-97ea-52e0ddaa3bf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:47.492414 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407e49c7-fb42-493d-97ea-52e0ddaa3bf6 admin admin] REQUEST_METHOD: `PUT` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:47.492701 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407e49c7-fb42-493d-97ea-52e0ddaa3bf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:47.493032 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407e49c7-fb42-493d-97ea-52e0ddaa3bf6 admin admin] PATH_INFO: `/v3/projects/e85aed0d1b3a416babb9dd49c87921a6/users/f38b6f63fdcf46d89d427cb878c5969e/roles/153539819e5542df99269d2913bbecfb` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:47.495099 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407e49c7-fb42-493d-97ea-52e0ddaa3bf6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e85aed0d1b3a416babb9dd49c87921a6, user_id=f38b6f63fdcf46d89d427cb878c5969e, role_id=153539819e5542df99269d2913bbecfb)` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:47.498667 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407e49c7-fb42-493d-97ea-52e0ddaa3bf6 admin admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:47.516844 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 1034/2096] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Jul 14 10:53:47 2022] PUT /identity/v3/projects/e85aed0d1b3a416babb9dd49c87921a6/users/f38b6f63fdcf46d89d427cb878c5969e/roles/153539819e5542df99269d2913bbecfb => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 10:53:47.529194 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28599b9a-d76d-46e2-b776-06619807f5cd None None] REQUEST_METHOD: `POST` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:47.529194 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28599b9a-d76d-46e2-b776-06619807f5cd None None] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:47.529194 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28599b9a-d76d-46e2-b776-06619807f5cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:47.564854 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.auth.core [None req-28599b9a-d76d-46e2-b776-06619807f5cd None None] MFA Rules not processed for user `f38b6f63fdcf46d89d427cb878c5969e`. Rule list: `[]` (Enabled: `True`). {{(pid=86656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:53:47.566382 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-28599b9a-d76d-46e2-b776-06619807f5cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:47.592548 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:53:47.613365 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5204556f-0838-4011-887f-86e3056a1aa4 None None] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:47.723400 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214ba9fb-debe-46f1-881b-48e8c67a5a2e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dddf93691844886982c91fea974385d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59391272ecbe48b0aa736cb43807be1d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:47.724138 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214ba9fb-debe-46f1-881b-48e8c67a5a2e service neutron] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:47.724490 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214ba9fb-debe-46f1-881b-48e8c67a5a2e service neutron] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:47.724911 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214ba9fb-debe-46f1-881b-48e8c67a5a2e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:47.754921 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:53:47.767574 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 1035/2097] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jul 14 10:53:47 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:53:47.776860 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28599b9a-d76d-46e2-b776-06619807f5cd None None] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:47.783453 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-28599b9a-d76d-46e2-b776-06619807f5cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:47.848888 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214ba9fb-debe-46f1-881b-48e8c67a5a2e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:47.851052 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214ba9fb-debe-46f1-881b-48e8c67a5a2e service neutron] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:47.864544 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28599b9a-d76d-46e2-b776-06619807f5cd None None] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:47.868856 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e016b5-8296-4a58-9560-23ca45323740 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68382432147a48c3b62271fd2a2eab04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59391272ecbe48b0aa736cb43807be1d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:47.869739 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e016b5-8296-4a58-9560-23ca45323740 service cinder] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:47.870128 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e016b5-8296-4a58-9560-23ca45323740 service cinder] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:47.870542 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e016b5-8296-4a58-9560-23ca45323740 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:47.882358 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 1063/2098] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jul 14 10:53:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 466 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:53:47.885771 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e016b5-8296-4a58-9560-23ca45323740 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:47.887599 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e016b5-8296-4a58-9560-23ca45323740 service cinder] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:47.900036 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 1036/2099] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jul 14 10:53:47 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 10:53:47.918589 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214ba9fb-debe-46f1-881b-48e8c67a5a2e service neutron] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:47.919535 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-214ba9fb-debe-46f1-881b-48e8c67a5a2e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:47.960049 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214ba9fb-debe-46f1-881b-48e8c67a5a2e service neutron] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:47.978239 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a0bbe6-4647-41b0-ba88-e695ff4d4931 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:47.979150 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a0bbe6-4647-41b0-ba88-e695ff4d4931 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:47.979437 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a0bbe6-4647-41b0-ba88-e695ff4d4931 admin admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:47.979744 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a0bbe6-4647-41b0-ba88-e695ff4d4931 admin admin] PATH_INFO: `/v3/users/46ec71c79c13494abb3bd197af8b2683` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:47.983500 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a0bbe6-4647-41b0-ba88-e695ff4d4931 admin admin] RBAC: Authorizing `identity:delete_user(user_id=46ec71c79c13494abb3bd197af8b2683)` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:47.989308 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a0bbe6-4647-41b0-ba88-e695ff4d4931 admin admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:48.133128 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-e2a0bbe6-4647-41b0-ba88-e695ff4d4931 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '46ec71c79c13494abb3bd197af8b2683'} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:48.170762 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-e2a0bbe6-4647-41b0-ba88-e695ff4d4931 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '46ec71c79c13494abb3bd197af8b2683'} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:48.171395 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-e2a0bbe6-4647-41b0-ba88-e695ff4d4931 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '46ec71c79c13494abb3bd197af8b2683'} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:48.189579 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-e2a0bbe6-4647-41b0-ba88-e695ff4d4931 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '46ec71c79c13494abb3bd197af8b2683'} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:48.190757 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-e2a0bbe6-4647-41b0-ba88-e695ff4d4931 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '46ec71c79c13494abb3bd197af8b2683'} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:48.222603 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 1064/2100] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Jul 14 10:53:47 2022] DELETE /identity/v3/users/46ec71c79c13494abb3bd197af8b2683 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:53:48.228367 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a18ab8a-0c41-4f7f-b0ec-d2041068ad8f None None] REQUEST_METHOD: `POST` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:48.233992 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a18ab8a-0c41-4f7f-b0ec-d2041068ad8f None None] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:48.234452 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a18ab8a-0c41-4f7f-b0ec-d2041068ad8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:48.299872 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.auth.core [None req-6a18ab8a-0c41-4f7f-b0ec-d2041068ad8f None None] MFA Rules not processed for user `ae4bcdd8106d4bebbdcae96be33505bc`. Rule list: `[]` (Enabled: `True`). {{(pid=86656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:53:48.303549 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-6a18ab8a-0c41-4f7f-b0ec-d2041068ad8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:48.452984 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a0bbe6-4647-41b0-ba88-e695ff4d4931 admin admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:48.455549 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-e2a0bbe6-4647-41b0-ba88-e695ff4d4931 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:48.561812 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 1037/2101] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jul 14 10:53:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 336 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:53:48.576293 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a18ab8a-0c41-4f7f-b0ec-d2041068ad8f None None] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:48.579833 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-6a18ab8a-0c41-4f7f-b0ec-d2041068ad8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:48.628444 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a0bbe6-4647-41b0-ba88-e695ff4d4931 admin admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:48.650346 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73492a8f-89ad-4c00-9ffe-5efe63e83e9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:48.651378 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73492a8f-89ad-4c00-9ffe-5efe63e83e9f admin admin] REQUEST_METHOD: `DELETE` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:48.651677 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73492a8f-89ad-4c00-9ffe-5efe63e83e9f admin admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:48.652811 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73492a8f-89ad-4c00-9ffe-5efe63e83e9f admin admin] PATH_INFO: `/v3/projects/822f994b956d4b2a80bfd768ee628e2f` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:48.655797 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73492a8f-89ad-4c00-9ffe-5efe63e83e9f admin admin] RBAC: Authorizing `identity:delete_project(project_id=822f994b956d4b2a80bfd768ee628e2f)` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:48.662485 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73492a8f-89ad-4c00-9ffe-5efe63e83e9f admin admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:48.718190 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a18ab8a-0c41-4f7f-b0ec-d2041068ad8f None None] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:48.723630 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9fbc93-9a9e-4596-a3d3-78f733b5de62 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dddf93691844886982c91fea974385d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59391272ecbe48b0aa736cb43807be1d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:48.724536 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9fbc93-9a9e-4596-a3d3-78f733b5de62 service neutron] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:48.724970 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9fbc93-9a9e-4596-a3d3-78f733b5de62 service neutron] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:48.725364 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9fbc93-9a9e-4596-a3d3-78f733b5de62 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:48.735724 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:53:48.744419 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=100 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:53:48.753166 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9fbc93-9a9e-4596-a3d3-78f733b5de62 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:48.758017 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9fbc93-9a9e-4596-a3d3-78f733b5de62 service neutron] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:48.770040 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-73492a8f-89ad-4c00-9ffe-5efe63e83e9f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '822f994b956d4b2a80bfd768ee628e2f', 'request_id': 'req-73492a8f-89ad-4c00-9ffe-5efe63e83e9f'} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:48.784731 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 1038/2102] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jul 14 10:53:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:53:48.785640 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9fbc93-9a9e-4596-a3d3-78f733b5de62 service neutron] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:48.787422 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-3b9fbc93-9a9e-4596-a3d3-78f733b5de62 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:48.800483 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-73492a8f-89ad-4c00-9ffe-5efe63e83e9f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '822f994b956d4b2a80bfd768ee628e2f', 'request_id': 'req-73492a8f-89ad-4c00-9ffe-5efe63e83e9f'} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:48.824718 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-73492a8f-89ad-4c00-9ffe-5efe63e83e9f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '822f994b956d4b2a80bfd768ee628e2f', 'request_id': 'req-73492a8f-89ad-4c00-9ffe-5efe63e83e9f'} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:48.871585 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-73492a8f-89ad-4c00-9ffe-5efe63e83e9f admin admin] The token cache is being invalidate because project 822f994b956d4b2a80bfd768ee628e2f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86655) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 10:53:48.871859 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-73492a8f-89ad-4c00-9ffe-5efe63e83e9f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:48.873437 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-73492a8f-89ad-4c00-9ffe-5efe63e83e9f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:48.876850 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 1065/2103] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Jul 14 10:53:48 2022] DELETE /identity/v3/projects/822f994b956d4b2a80bfd768ee628e2f => generated 0 bytes in 424 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 10:53:48.882205 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73492a8f-89ad-4c00-9ffe-5efe63e83e9f admin admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:48.883968 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-73492a8f-89ad-4c00-9ffe-5efe63e83e9f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:48.990643 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9fbc93-9a9e-4596-a3d3-78f733b5de62 service neutron] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:49.081682 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73492a8f-89ad-4c00-9ffe-5efe63e83e9f admin admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:49.096628 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f49a64-b31c-483c-9d38-f7f44f4f5a30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:49.097629 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f49a64-b31c-483c-9d38-f7f44f4f5a30 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:49.099060 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f49a64-b31c-483c-9d38-f7f44f4f5a30 admin admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:49.099743 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f49a64-b31c-483c-9d38-f7f44f4f5a30 admin admin] PATH_INFO: `/v3/users/3e8cfc0dffb24321a8dc591c1fdb502d` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:49.102159 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f49a64-b31c-483c-9d38-f7f44f4f5a30 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3e8cfc0dffb24321a8dc591c1fdb502d)` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:49.105400 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f49a64-b31c-483c-9d38-f7f44f4f5a30 admin admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:49.145818 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5b036e-4b86-4fc6-8852-722219f93edd tempest-VolumeQuotaClassesTest-938203161 tempest-VolumeQuotaClassesTest-938203161-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f38b6f63fdcf46d89d427cb878c5969e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e85aed0d1b3a416babb9dd49c87921a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:49.147797 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5b036e-4b86-4fc6-8852-722219f93edd tempest-VolumeQuotaClassesTest-938203161 tempest-VolumeQuotaClassesTest-938203161-project-admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:49.150926 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5b036e-4b86-4fc6-8852-722219f93edd tempest-VolumeQuotaClassesTest-938203161 tempest-VolumeQuotaClassesTest-938203161-project-admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:49.151091 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5b036e-4b86-4fc6-8852-722219f93edd tempest-VolumeQuotaClassesTest-938203161 tempest-VolumeQuotaClassesTest-938203161-project-admin] PATH_INFO: `/v3/domains` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:49.151818 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5b036e-4b86-4fc6-8852-722219f93edd tempest-VolumeQuotaClassesTest-938203161 tempest-VolumeQuotaClassesTest-938203161-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=86656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:53:49.156866 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5b036e-4b86-4fc6-8852-722219f93edd tempest-VolumeQuotaClassesTest-938203161 tempest-VolumeQuotaClassesTest-938203161-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:49.161189 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5b036e-4b86-4fc6-8852-722219f93edd tempest-VolumeQuotaClassesTest-938203161 tempest-VolumeQuotaClassesTest-938203161-project-admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:49.186109 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 1039/2104] 10.222.0.16 () {58 vars in 1152 bytes} [Thu Jul 14 10:53:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 401 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:53:49.194674 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5b036e-4b86-4fc6-8852-722219f93edd tempest-VolumeQuotaClassesTest-938203161 tempest-VolumeQuotaClassesTest-938203161-project-admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:49.201418 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-8d5b036e-4b86-4fc6-8852-722219f93edd tempest-VolumeQuotaClassesTest-938203161 tempest-VolumeQuotaClassesTest-938203161-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:49.207384 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-55f49a64-b31c-483c-9d38-f7f44f4f5a30 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3e8cfc0dffb24321a8dc591c1fdb502d'} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:49.217671 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-55f49a64-b31c-483c-9d38-f7f44f4f5a30 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3e8cfc0dffb24321a8dc591c1fdb502d'} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:49.218415 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-55f49a64-b31c-483c-9d38-f7f44f4f5a30 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3e8cfc0dffb24321a8dc591c1fdb502d'} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:49.236384 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5b036e-4b86-4fc6-8852-722219f93edd tempest-VolumeQuotaClassesTest-938203161 tempest-VolumeQuotaClassesTest-938203161-project-admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:49.249891 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c114f0b1-3889-41cb-92e6-38d1cd29e766 tempest-VolumeQuotaClassesTest-938203161 tempest-VolumeQuotaClassesTest-938203161-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f38b6f63fdcf46d89d427cb878c5969e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e85aed0d1b3a416babb9dd49c87921a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:49.251286 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c114f0b1-3889-41cb-92e6-38d1cd29e766 tempest-VolumeQuotaClassesTest-938203161 tempest-VolumeQuotaClassesTest-938203161-project-admin] REQUEST_METHOD: `POST` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:49.252348 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c114f0b1-3889-41cb-92e6-38d1cd29e766 tempest-VolumeQuotaClassesTest-938203161 tempest-VolumeQuotaClassesTest-938203161-project-admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:49.253092 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c114f0b1-3889-41cb-92e6-38d1cd29e766 tempest-VolumeQuotaClassesTest-938203161 tempest-VolumeQuotaClassesTest-938203161-project-admin] PATH_INFO: `/v3/projects` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:49.254044 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c114f0b1-3889-41cb-92e6-38d1cd29e766 tempest-VolumeQuotaClassesTest-938203161 tempest-VolumeQuotaClassesTest-938203161-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:49.255181 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-55f49a64-b31c-483c-9d38-f7f44f4f5a30 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3e8cfc0dffb24321a8dc591c1fdb502d'} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:49.256346 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-55f49a64-b31c-483c-9d38-f7f44f4f5a30 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3e8cfc0dffb24321a8dc591c1fdb502d'} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:49.258945 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c114f0b1-3889-41cb-92e6-38d1cd29e766 tempest-VolumeQuotaClassesTest-938203161 tempest-VolumeQuotaClassesTest-938203161-project-admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:49.293477 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 1066/2105] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Jul 14 10:53:48 2022] DELETE /identity/v3/users/3e8cfc0dffb24321a8dc591c1fdb502d => generated 0 bytes in 412 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:53:49.332588 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 1040/2106] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Jul 14 10:53:49 2022] POST /identity/v3/projects => generated 352 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:53:49.336815 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f49a64-b31c-483c-9d38-f7f44f4f5a30 admin admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:49.338293 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-55f49a64-b31c-483c-9d38-f7f44f4f5a30 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:49.429983 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:53:49.475754 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c114f0b1-3889-41cb-92e6-38d1cd29e766 tempest-VolumeQuotaClassesTest-938203161 tempest-VolumeQuotaClassesTest-938203161-project-admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:49.477993 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-c114f0b1-3889-41cb-92e6-38d1cd29e766 tempest-VolumeQuotaClassesTest-938203161 tempest-VolumeQuotaClassesTest-938203161-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:49.494840 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f49a64-b31c-483c-9d38-f7f44f4f5a30 admin admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:49.573037 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c114f0b1-3889-41cb-92e6-38d1cd29e766 tempest-VolumeQuotaClassesTest-938203161 tempest-VolumeQuotaClassesTest-938203161-project-admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:49.578989 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02eca36a-d8f8-4567-984d-9427fc7a5fe6 tempest-VolumeQuotaClassesTest-938203161 tempest-VolumeQuotaClassesTest-938203161-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f38b6f63fdcf46d89d427cb878c5969e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e85aed0d1b3a416babb9dd49c87921a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:49.580213 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02eca36a-d8f8-4567-984d-9427fc7a5fe6 tempest-VolumeQuotaClassesTest-938203161 tempest-VolumeQuotaClassesTest-938203161-project-admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:49.580618 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02eca36a-d8f8-4567-984d-9427fc7a5fe6 tempest-VolumeQuotaClassesTest-938203161 tempest-VolumeQuotaClassesTest-938203161-project-admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:49.581714 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02eca36a-d8f8-4567-984d-9427fc7a5fe6 tempest-VolumeQuotaClassesTest-938203161 tempest-VolumeQuotaClassesTest-938203161-project-admin] PATH_INFO: `/v3/domains` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:49.581872 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31bcdfc-ded3-40fe-aab5-dfad78c3d865 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:49.581990 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02eca36a-d8f8-4567-984d-9427fc7a5fe6 tempest-VolumeQuotaClassesTest-938203161 tempest-VolumeQuotaClassesTest-938203161-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=86655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:53:49.582389 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02eca36a-d8f8-4567-984d-9427fc7a5fe6 tempest-VolumeQuotaClassesTest-938203161 tempest-VolumeQuotaClassesTest-938203161-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:49.582524 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31bcdfc-ded3-40fe-aab5-dfad78c3d865 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:49.582833 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31bcdfc-ded3-40fe-aab5-dfad78c3d865 admin admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:49.583220 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31bcdfc-ded3-40fe-aab5-dfad78c3d865 admin admin] PATH_INFO: `/v3/projects/c98a115f08eb465c8428852c1cfc22cc` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:49.584058 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02eca36a-d8f8-4567-984d-9427fc7a5fe6 tempest-VolumeQuotaClassesTest-938203161 tempest-VolumeQuotaClassesTest-938203161-project-admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:49.585647 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31bcdfc-ded3-40fe-aab5-dfad78c3d865 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c98a115f08eb465c8428852c1cfc22cc)` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:49.588510 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31bcdfc-ded3-40fe-aab5-dfad78c3d865 admin admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:49.604666 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 1067/2107] 10.222.0.16 () {58 vars in 1152 bytes} [Thu Jul 14 10:53:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:53:49.612852 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:53:49.648093 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02eca36a-d8f8-4567-984d-9427fc7a5fe6 tempest-VolumeQuotaClassesTest-938203161 tempest-VolumeQuotaClassesTest-938203161-project-admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:49.661835 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02eca36a-d8f8-4567-984d-9427fc7a5fe6 tempest-VolumeQuotaClassesTest-938203161 tempest-VolumeQuotaClassesTest-938203161-project-admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:49.674656 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-c31bcdfc-ded3-40fe-aab5-dfad78c3d865 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c98a115f08eb465c8428852c1cfc22cc', 'request_id': 'req-c31bcdfc-ded3-40fe-aab5-dfad78c3d865'} {{(pid=86656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:49.686074 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-c31bcdfc-ded3-40fe-aab5-dfad78c3d865 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c98a115f08eb465c8428852c1cfc22cc', 'request_id': 'req-c31bcdfc-ded3-40fe-aab5-dfad78c3d865'} {{(pid=86656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:49.693841 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-c31bcdfc-ded3-40fe-aab5-dfad78c3d865 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c98a115f08eb465c8428852c1cfc22cc', 'request_id': 'req-c31bcdfc-ded3-40fe-aab5-dfad78c3d865'} {{(pid=86656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:49.706184 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-c31bcdfc-ded3-40fe-aab5-dfad78c3d865 admin admin] The token cache is being invalidate because project c98a115f08eb465c8428852c1cfc22cc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86656) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 10:53:49.706527 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-c31bcdfc-ded3-40fe-aab5-dfad78c3d865 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:49.707316 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-c31bcdfc-ded3-40fe-aab5-dfad78c3d865 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:49.709340 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 1041/2108] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Jul 14 10:53:49 2022] DELETE /identity/v3/projects/c98a115f08eb465c8428852c1cfc22cc => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:53:49.714938 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c81943-774f-42be-9955-d688aac38058 None None] REQUEST_METHOD: `POST` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:49.715231 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c81943-774f-42be-9955-d688aac38058 None None] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:49.716853 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c81943-774f-42be-9955-d688aac38058 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:49.739492 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.auth.core [None req-61c81943-774f-42be-9955-d688aac38058 None None] MFA Rules not processed for user `ae4bcdd8106d4bebbdcae96be33505bc`. Rule list: `[]` (Enabled: `True`). {{(pid=86656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:53:49.740888 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-61c81943-774f-42be-9955-d688aac38058 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:49.745210 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7940e8a0-1d54-4723-9b33-59acecd3d26f tempest-VolumeQuotaClassesTest-938203161 tempest-VolumeQuotaClassesTest-938203161-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f38b6f63fdcf46d89d427cb878c5969e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e85aed0d1b3a416babb9dd49c87921a6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:49.746253 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7940e8a0-1d54-4723-9b33-59acecd3d26f tempest-VolumeQuotaClassesTest-938203161 tempest-VolumeQuotaClassesTest-938203161-project-admin] REQUEST_METHOD: `DELETE` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:49.746555 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7940e8a0-1d54-4723-9b33-59acecd3d26f tempest-VolumeQuotaClassesTest-938203161 tempest-VolumeQuotaClassesTest-938203161-project-admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:49.747766 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7940e8a0-1d54-4723-9b33-59acecd3d26f tempest-VolumeQuotaClassesTest-938203161 tempest-VolumeQuotaClassesTest-938203161-project-admin] PATH_INFO: `/v3/projects/0c192497525f4f65a7409fbc7226e89a` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:49.749513 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7940e8a0-1d54-4723-9b33-59acecd3d26f tempest-VolumeQuotaClassesTest-938203161 tempest-VolumeQuotaClassesTest-938203161-project-admin] RBAC: Authorizing `identity:delete_project(project_id=0c192497525f4f65a7409fbc7226e89a)` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:49.751884 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7940e8a0-1d54-4723-9b33-59acecd3d26f tempest-VolumeQuotaClassesTest-938203161 tempest-VolumeQuotaClassesTest-938203161-project-admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:49.828837 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 1042/2109] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jul 14 10:53:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 10:53:49.834366 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71691526-f831-4f78-ab28-9d8ef14ba9be None None] REQUEST_METHOD: `POST` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:49.834969 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71691526-f831-4f78-ab28-9d8ef14ba9be None None] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:49.835368 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-7940e8a0-1d54-4723-9b33-59acecd3d26f tempest-VolumeQuotaClassesTest-938203161 tempest-VolumeQuotaClassesTest-938203161-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0c192497525f4f65a7409fbc7226e89a', 'request_id': 'req-7940e8a0-1d54-4723-9b33-59acecd3d26f'} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:49.835981 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71691526-f831-4f78-ab28-9d8ef14ba9be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:49.842663 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-7940e8a0-1d54-4723-9b33-59acecd3d26f tempest-VolumeQuotaClassesTest-938203161 tempest-VolumeQuotaClassesTest-938203161-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0c192497525f4f65a7409fbc7226e89a', 'request_id': 'req-7940e8a0-1d54-4723-9b33-59acecd3d26f'} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:49.853029 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-7940e8a0-1d54-4723-9b33-59acecd3d26f tempest-VolumeQuotaClassesTest-938203161 tempest-VolumeQuotaClassesTest-938203161-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0c192497525f4f65a7409fbc7226e89a', 'request_id': 'req-7940e8a0-1d54-4723-9b33-59acecd3d26f'} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:49.858205 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.auth.core [None req-71691526-f831-4f78-ab28-9d8ef14ba9be None None] MFA Rules not processed for user `ae4bcdd8106d4bebbdcae96be33505bc`. Rule list: `[]` (Enabled: `True`). {{(pid=86656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:53:49.859426 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-71691526-f831-4f78-ab28-9d8ef14ba9be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:49.869363 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-7940e8a0-1d54-4723-9b33-59acecd3d26f tempest-VolumeQuotaClassesTest-938203161 tempest-VolumeQuotaClassesTest-938203161-project-admin] The token cache is being invalidate because project 0c192497525f4f65a7409fbc7226e89a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86655) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 10:53:49.869777 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-7940e8a0-1d54-4723-9b33-59acecd3d26f tempest-VolumeQuotaClassesTest-938203161 tempest-VolumeQuotaClassesTest-938203161-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:49.870597 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-7940e8a0-1d54-4723-9b33-59acecd3d26f tempest-VolumeQuotaClassesTest-938203161 tempest-VolumeQuotaClassesTest-938203161-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:49.872817 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 1068/2110] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Jul 14 10:53:49 2022] DELETE /identity/v3/projects/0c192497525f4f65a7409fbc7226e89a => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 10:53:49.931252 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 1043/2111] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jul 14 10:53:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 10:53:49.936932 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7940e8a0-1d54-4723-9b33-59acecd3d26f tempest-VolumeQuotaClassesTest-938203161 tempest-VolumeQuotaClassesTest-938203161-project-admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:49.949097 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7940e8a0-1d54-4723-9b33-59acecd3d26f tempest-VolumeQuotaClassesTest-938203161 tempest-VolumeQuotaClassesTest-938203161-project-admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:49.955748 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c39ea42-4484-4966-8d50-5c68ddacf622 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:49.956518 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c39ea42-4484-4966-8d50-5c68ddacf622 admin admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:49.956753 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c39ea42-4484-4966-8d50-5c68ddacf622 admin admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:49.957187 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c39ea42-4484-4966-8d50-5c68ddacf622 admin admin] PATH_INFO: `/v3/domains` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:49.957884 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c39ea42-4484-4966-8d50-5c68ddacf622 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:53:49.958446 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c39ea42-4484-4966-8d50-5c68ddacf622 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:49.961020 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c39ea42-4484-4966-8d50-5c68ddacf622 admin admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:49.962452 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:53:49.998855 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 1069/2112] 10.222.0.16 () {58 vars in 1152 bytes} [Thu Jul 14 10:53:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:53:50.003164 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71691526-f831-4f78-ab28-9d8ef14ba9be None None] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:50.016280 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71691526-f831-4f78-ab28-9d8ef14ba9be None None] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:50.021847 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5c0b02-197e-46c6-b52b-62e3935d5be7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:50.022940 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5c0b02-197e-46c6-b52b-62e3935d5be7 admin admin] REQUEST_METHOD: `POST` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:50.023241 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5c0b02-197e-46c6-b52b-62e3935d5be7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:50.023524 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5c0b02-197e-46c6-b52b-62e3935d5be7 admin admin] PATH_INFO: `/v3/projects` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:50.024233 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5c0b02-197e-46c6-b52b-62e3935d5be7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:50.029441 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5c0b02-197e-46c6-b52b-62e3935d5be7 admin admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:50.084765 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c39ea42-4484-4966-8d50-5c68ddacf622 admin admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:50.087046 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-9c39ea42-4484-4966-8d50-5c68ddacf622 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:50.096238 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 1044/2113] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Jul 14 10:53:50 2022] POST /identity/v3/projects => generated 373 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:53:50.098935 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5c0b02-197e-46c6-b52b-62e3935d5be7 admin admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:50.107587 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c39ea42-4484-4966-8d50-5c68ddacf622 admin admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:50.196340 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:53:50.283382 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5c0b02-197e-46c6-b52b-62e3935d5be7 admin admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:50.289336 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389fbade-a345-48ff-bc95-630973ffb3f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:50.289817 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61a8bb5-386a-446d-9fa1-6b29cb5ff381 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:50.292625 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389fbade-a345-48ff-bc95-630973ffb3f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:50.292625 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389fbade-a345-48ff-bc95-630973ffb3f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:50.292625 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389fbade-a345-48ff-bc95-630973ffb3f9 admin admin] PATH_INFO: `/v3/projects/2a0bb542e3834ca99709e5d159167608` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:50.296534 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61a8bb5-386a-446d-9fa1-6b29cb5ff381 admin admin] REQUEST_METHOD: `POST` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:50.297557 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389fbade-a345-48ff-bc95-630973ffb3f9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2a0bb542e3834ca99709e5d159167608)` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:50.299797 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389fbade-a345-48ff-bc95-630973ffb3f9 admin admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:50.305360 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61a8bb5-386a-446d-9fa1-6b29cb5ff381 admin admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:50.305736 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61a8bb5-386a-446d-9fa1-6b29cb5ff381 admin admin] PATH_INFO: `/v3/users` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:50.310096 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61a8bb5-386a-446d-9fa1-6b29cb5ff381 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:50.314496 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61a8bb5-386a-446d-9fa1-6b29cb5ff381 admin admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:50.398714 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 1045/2114] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Jul 14 10:53:50 2022] POST /identity/v3/users => generated 287 bytes in 300 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 10:53:50.400293 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61a8bb5-386a-446d-9fa1-6b29cb5ff381 admin admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:50.402880 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-c61a8bb5-386a-446d-9fa1-6b29cb5ff381 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:50.415524 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-389fbade-a345-48ff-bc95-630973ffb3f9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2a0bb542e3834ca99709e5d159167608', 'request_id': 'req-389fbade-a345-48ff-bc95-630973ffb3f9'} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:50.426852 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-389fbade-a345-48ff-bc95-630973ffb3f9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2a0bb542e3834ca99709e5d159167608', 'request_id': 'req-389fbade-a345-48ff-bc95-630973ffb3f9'} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:50.445286 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61a8bb5-386a-446d-9fa1-6b29cb5ff381 admin admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:50.451764 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-389fbade-a345-48ff-bc95-630973ffb3f9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2a0bb542e3834ca99709e5d159167608', 'request_id': 'req-389fbade-a345-48ff-bc95-630973ffb3f9'} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:50.503428 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-389fbade-a345-48ff-bc95-630973ffb3f9 admin admin] The token cache is being invalidate because project 2a0bb542e3834ca99709e5d159167608 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86655) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 10:53:50.503731 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-389fbade-a345-48ff-bc95-630973ffb3f9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:50.508470 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-389fbade-a345-48ff-bc95-630973ffb3f9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:50.510331 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 1070/2115] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Jul 14 10:53:50 2022] DELETE /identity/v3/projects/2a0bb542e3834ca99709e5d159167608 => generated 0 bytes in 426 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:53:50.519331 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389fbade-a345-48ff-bc95-630973ffb3f9 admin admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:50.525723 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-389fbade-a345-48ff-bc95-630973ffb3f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:50.596557 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf169b9-d836-41bb-bb83-fa333df74e6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:50.597736 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf169b9-d836-41bb-bb83-fa333df74e6d admin admin] REQUEST_METHOD: `DELETE` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:50.598139 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf169b9-d836-41bb-bb83-fa333df74e6d admin admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:50.598494 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf169b9-d836-41bb-bb83-fa333df74e6d admin admin] PATH_INFO: `/v3/users/9019049371764062907cbe39268c5f00` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:50.600389 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf169b9-d836-41bb-bb83-fa333df74e6d admin admin] RBAC: Authorizing `identity:delete_user(user_id=9019049371764062907cbe39268c5f00)` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:50.603848 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf169b9-d836-41bb-bb83-fa333df74e6d admin admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:50.708139 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389fbade-a345-48ff-bc95-630973ffb3f9 admin admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:50.719648 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be9fe05-ac30-4ad2-9b8f-fe513f149e7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:50.720355 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be9fe05-ac30-4ad2-9b8f-fe513f149e7f admin admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:50.720642 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be9fe05-ac30-4ad2-9b8f-fe513f149e7f admin admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:50.720951 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be9fe05-ac30-4ad2-9b8f-fe513f149e7f admin admin] PATH_INFO: `/v3/roles` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:50.721858 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be9fe05-ac30-4ad2-9b8f-fe513f149e7f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:50.725735 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be9fe05-ac30-4ad2-9b8f-fe513f149e7f admin admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:50.736646 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-5cf169b9-d836-41bb-bb83-fa333df74e6d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9019049371764062907cbe39268c5f00'} {{(pid=86656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:50.756692 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 1071/2116] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jul 14 10:53:50 2022] GET /identity/v3/roles => generated 1420 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:53:50.757935 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be9fe05-ac30-4ad2-9b8f-fe513f149e7f admin admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:50.761772 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-8be9fe05-ac30-4ad2-9b8f-fe513f149e7f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:50.777371 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-5cf169b9-d836-41bb-bb83-fa333df74e6d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9019049371764062907cbe39268c5f00'} {{(pid=86656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:50.783914 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-5cf169b9-d836-41bb-bb83-fa333df74e6d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9019049371764062907cbe39268c5f00'} {{(pid=86656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:50.787576 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be9fe05-ac30-4ad2-9b8f-fe513f149e7f admin admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:50.793833 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2546fb7b-8103-4283-85d6-ea6af9ebc52d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:50.796519 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2546fb7b-8103-4283-85d6-ea6af9ebc52d admin admin] REQUEST_METHOD: `DELETE` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:50.797117 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2546fb7b-8103-4283-85d6-ea6af9ebc52d admin admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:50.797677 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2546fb7b-8103-4283-85d6-ea6af9ebc52d admin admin] PATH_INFO: `/v3/users/bf2ff7ed345d4424af8d85ad3a4afd78` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:50.799586 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2546fb7b-8103-4283-85d6-ea6af9ebc52d admin admin] RBAC: Authorizing `identity:delete_user(user_id=bf2ff7ed345d4424af8d85ad3a4afd78)` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:50.804681 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2546fb7b-8103-4283-85d6-ea6af9ebc52d admin admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:50.809493 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-5cf169b9-d836-41bb-bb83-fa333df74e6d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9019049371764062907cbe39268c5f00'} {{(pid=86656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:50.814956 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-5cf169b9-d836-41bb-bb83-fa333df74e6d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9019049371764062907cbe39268c5f00'} {{(pid=86656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:50.834899 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:53:50.865770 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 1046/2117] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Jul 14 10:53:50 2022] DELETE /identity/v3/users/9019049371764062907cbe39268c5f00 => generated 0 bytes in 466 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:53:50.869428 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf169b9-d836-41bb-bb83-fa333df74e6d admin admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:50.872525 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-5cf169b9-d836-41bb-bb83-fa333df74e6d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:50.895053 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-2546fb7b-8103-4283-85d6-ea6af9ebc52d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bf2ff7ed345d4424af8d85ad3a4afd78'} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:50.906627 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-2546fb7b-8103-4283-85d6-ea6af9ebc52d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bf2ff7ed345d4424af8d85ad3a4afd78'} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:50.907377 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-2546fb7b-8103-4283-85d6-ea6af9ebc52d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bf2ff7ed345d4424af8d85ad3a4afd78'} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:50.918192 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-2546fb7b-8103-4283-85d6-ea6af9ebc52d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bf2ff7ed345d4424af8d85ad3a4afd78'} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:50.919755 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-2546fb7b-8103-4283-85d6-ea6af9ebc52d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bf2ff7ed345d4424af8d85ad3a4afd78'} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:50.943949 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 1072/2118] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Jul 14 10:53:50 2022] DELETE /identity/v3/users/bf2ff7ed345d4424af8d85ad3a4afd78 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:53:50.947070 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffeaa67-153b-48c4-b89a-b15dcc0fcc04 None None] REQUEST_METHOD: `POST` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:50.947434 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffeaa67-153b-48c4-b89a-b15dcc0fcc04 None None] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:50.947752 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffeaa67-153b-48c4-b89a-b15dcc0fcc04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:50.958297 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:53:50.998127 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.auth.core [None req-6ffeaa67-153b-48c4-b89a-b15dcc0fcc04 None None] MFA Rules not processed for user `ae4bcdd8106d4bebbdcae96be33505bc`. Rule list: `[]` (Enabled: `True`). {{(pid=86655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:53:50.999287 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-6ffeaa67-153b-48c4-b89a-b15dcc0fcc04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:51.005623 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf169b9-d836-41bb-bb83-fa333df74e6d admin admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:51.072636 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cebac0-df39-44f2-9193-d793a611064b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:51.073361 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cebac0-df39-44f2-9193-d793a611064b admin admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:51.073651 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cebac0-df39-44f2-9193-d793a611064b admin admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:51.073934 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cebac0-df39-44f2-9193-d793a611064b admin admin] PATH_INFO: `/v3/roles` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:51.074236 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 1073/2119] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jul 14 10:53:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:53:51.077657 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52cebac0-df39-44f2-9193-d793a611064b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:51.079432 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52cebac0-df39-44f2-9193-d793a611064b admin admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:51.091061 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 1047/2120] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jul 14 10:53:50 2022] GET /identity/v3/roles => generated 1420 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:53:51.095377 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffeaa67-153b-48c4-b89a-b15dcc0fcc04 None None] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:51.096888 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-6ffeaa67-153b-48c4-b89a-b15dcc0fcc04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:51.109992 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffeaa67-153b-48c4-b89a-b15dcc0fcc04 None None] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:51.115310 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c19b6c0-e6f0-4780-8699-59a998ae3c50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:51.116115 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c19b6c0-e6f0-4780-8699-59a998ae3c50 admin admin] REQUEST_METHOD: `PUT` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:51.116402 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c19b6c0-e6f0-4780-8699-59a998ae3c50 admin admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:51.116682 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c19b6c0-e6f0-4780-8699-59a998ae3c50 admin admin] PATH_INFO: `/v3/projects/1e5fd8cc10804a9db35f51509ad58383/users/fb55f58108314c2aa2f8438afb410468/roles/0da46c267d354cce81495dfdd56c1ec2` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:51.116957 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cebac0-df39-44f2-9193-d793a611064b admin admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:51.119831 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-52cebac0-df39-44f2-9193-d793a611064b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:51.137814 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c19b6c0-e6f0-4780-8699-59a998ae3c50 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1e5fd8cc10804a9db35f51509ad58383, user_id=fb55f58108314c2aa2f8438afb410468, role_id=0da46c267d354cce81495dfdd56c1ec2)` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:51.140940 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c19b6c0-e6f0-4780-8699-59a998ae3c50 admin admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:51.160830 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 1074/2121] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Jul 14 10:53:51 2022] PUT /identity/v3/projects/1e5fd8cc10804a9db35f51509ad58383/users/fb55f58108314c2aa2f8438afb410468/roles/0da46c267d354cce81495dfdd56c1ec2 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:53:51.172886 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f7f165-5769-402b-92e0-0dab6aeddb38 None None] REQUEST_METHOD: `POST` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:51.173260 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f7f165-5769-402b-92e0-0dab6aeddb38 None None] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:51.173508 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f7f165-5769-402b-92e0-0dab6aeddb38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:51.207892 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.auth.core [None req-b3f7f165-5769-402b-92e0-0dab6aeddb38 None None] MFA Rules not processed for user `fb55f58108314c2aa2f8438afb410468`. Rule list: `[]` (Enabled: `True`). {{(pid=86655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:53:51.209460 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-b3f7f165-5769-402b-92e0-0dab6aeddb38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:51.221753 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cebac0-df39-44f2-9193-d793a611064b admin admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:51.293935 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390c5e15-0e29-4892-950b-24dc908ee4f2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dddf93691844886982c91fea974385d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59391272ecbe48b0aa736cb43807be1d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:51.294958 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390c5e15-0e29-4892-950b-24dc908ee4f2 service neutron] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:51.294958 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390c5e15-0e29-4892-950b-24dc908ee4f2 service neutron] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:51.295202 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390c5e15-0e29-4892-950b-24dc908ee4f2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:51.296246 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:53:51.321117 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 1075/2122] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jul 14 10:53:51 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:53:51.322664 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f7f165-5769-402b-92e0-0dab6aeddb38 None None] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:51.324266 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-b3f7f165-5769-402b-92e0-0dab6aeddb38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:51.355128 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=100 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:53:51.376065 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390c5e15-0e29-4892-950b-24dc908ee4f2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:51.377613 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390c5e15-0e29-4892-950b-24dc908ee4f2 service neutron] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:51.388810 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 1048/2123] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jul 14 10:53:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 273 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 10:53:51.393220 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f7f165-5769-402b-92e0-0dab6aeddb38 None None] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:51.397200 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975e312e-87f9-44b6-bbb7-3d8b3a55bac1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68382432147a48c3b62271fd2a2eab04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59391272ecbe48b0aa736cb43807be1d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:51.397860 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975e312e-87f9-44b6-bbb7-3d8b3a55bac1 service cinder] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:51.398145 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975e312e-87f9-44b6-bbb7-3d8b3a55bac1 service cinder] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:51.398424 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975e312e-87f9-44b6-bbb7-3d8b3a55bac1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:51.408513 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975e312e-87f9-44b6-bbb7-3d8b3a55bac1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:51.409999 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975e312e-87f9-44b6-bbb7-3d8b3a55bac1 service cinder] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:51.429222 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 1076/2124] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jul 14 10:53:51 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 10:53:51.446538 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390c5e15-0e29-4892-950b-24dc908ee4f2 service neutron] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:51.457902 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390c5e15-0e29-4892-950b-24dc908ee4f2 service neutron] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:51.463920 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7559f3-2d0a-45a0-9704-789577030871 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:51.464892 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7559f3-2d0a-45a0-9704-789577030871 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:51.465180 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7559f3-2d0a-45a0-9704-789577030871 admin admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:51.465999 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7559f3-2d0a-45a0-9704-789577030871 admin admin] PATH_INFO: `/v3/users/fb55f58108314c2aa2f8438afb410468` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:51.467133 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7559f3-2d0a-45a0-9704-789577030871 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fb55f58108314c2aa2f8438afb410468)` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:51.469471 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7559f3-2d0a-45a0-9704-789577030871 admin admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:51.533781 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-7e7559f3-2d0a-45a0-9704-789577030871 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fb55f58108314c2aa2f8438afb410468'} {{(pid=86656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:51.544052 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-7e7559f3-2d0a-45a0-9704-789577030871 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fb55f58108314c2aa2f8438afb410468'} {{(pid=86656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:51.545204 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-7e7559f3-2d0a-45a0-9704-789577030871 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fb55f58108314c2aa2f8438afb410468'} {{(pid=86656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:51.574251 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-7e7559f3-2d0a-45a0-9704-789577030871 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fb55f58108314c2aa2f8438afb410468'} {{(pid=86656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:51.576250 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-7e7559f3-2d0a-45a0-9704-789577030871 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fb55f58108314c2aa2f8438afb410468'} {{(pid=86656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:51.617992 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 1049/2125] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Jul 14 10:53:51 2022] DELETE /identity/v3/users/fb55f58108314c2aa2f8438afb410468 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 10:53:51.623061 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a728b3c-af03-4f83-a170-fcc0a75e1a59 None None] REQUEST_METHOD: `POST` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:51.623361 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a728b3c-af03-4f83-a170-fcc0a75e1a59 None None] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:51.623643 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a728b3c-af03-4f83-a170-fcc0a75e1a59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:51.673622 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.auth.core [None req-5a728b3c-af03-4f83-a170-fcc0a75e1a59 None None] MFA Rules not processed for user `ae4bcdd8106d4bebbdcae96be33505bc`. Rule list: `[]` (Enabled: `True`). {{(pid=86655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:53:51.675132 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-5a728b3c-af03-4f83-a170-fcc0a75e1a59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:51.793313 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 1077/2126] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jul 14 10:53:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:53:51.825003 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7559f3-2d0a-45a0-9704-789577030871 admin admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:51.827754 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-7e7559f3-2d0a-45a0-9704-789577030871 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:51.843454 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a728b3c-af03-4f83-a170-fcc0a75e1a59 None None] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:51.844238 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-5a728b3c-af03-4f83-a170-fcc0a75e1a59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:51.860733 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a728b3c-af03-4f83-a170-fcc0a75e1a59 None None] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:51.867543 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3136aa-dee1-4134-a78d-3a3b6bf754e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:51.869351 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3136aa-dee1-4134-a78d-3a3b6bf754e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:51.869549 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3136aa-dee1-4134-a78d-3a3b6bf754e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:51.869825 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3136aa-dee1-4134-a78d-3a3b6bf754e1 admin admin] PATH_INFO: `/v3/users/851a0ee6e2cb43e8a2817d692b121214` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:51.871616 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3136aa-dee1-4134-a78d-3a3b6bf754e1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=851a0ee6e2cb43e8a2817d692b121214)` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:51.874406 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3136aa-dee1-4134-a78d-3a3b6bf754e1 admin admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:51.912538 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7559f3-2d0a-45a0-9704-789577030871 admin admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:51.916807 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770fb43b-5287-4ff8-bbee-56f5f43c608b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dddf93691844886982c91fea974385d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59391272ecbe48b0aa736cb43807be1d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:51.917540 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770fb43b-5287-4ff8-bbee-56f5f43c608b service neutron] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:51.917877 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770fb43b-5287-4ff8-bbee-56f5f43c608b service neutron] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:51.918161 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770fb43b-5287-4ff8-bbee-56f5f43c608b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:51.930753 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770fb43b-5287-4ff8-bbee-56f5f43c608b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:51.943545 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-af3136aa-dee1-4134-a78d-3a3b6bf754e1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '851a0ee6e2cb43e8a2817d692b121214'} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:51.951934 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770fb43b-5287-4ff8-bbee-56f5f43c608b service neutron] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:51.955958 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-af3136aa-dee1-4134-a78d-3a3b6bf754e1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '851a0ee6e2cb43e8a2817d692b121214'} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:51.957770 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-af3136aa-dee1-4134-a78d-3a3b6bf754e1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '851a0ee6e2cb43e8a2817d692b121214'} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:51.980759 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-af3136aa-dee1-4134-a78d-3a3b6bf754e1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '851a0ee6e2cb43e8a2817d692b121214'} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:51.982571 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-af3136aa-dee1-4134-a78d-3a3b6bf754e1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '851a0ee6e2cb43e8a2817d692b121214'} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:51.983059 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 1050/2127] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jul 14 10:53:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:53:52.012504 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 1078/2128] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Jul 14 10:53:51 2022] DELETE /identity/v3/users/851a0ee6e2cb43e8a2817d692b121214 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:53:52.016829 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7df51a5-8cfe-4d67-9509-c3ade816fe21 None None] REQUEST_METHOD: `POST` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:52.017131 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7df51a5-8cfe-4d67-9509-c3ade816fe21 None None] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:52.017414 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7df51a5-8cfe-4d67-9509-c3ade816fe21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:52.038144 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.auth.core [None req-c7df51a5-8cfe-4d67-9509-c3ade816fe21 None None] MFA Rules not processed for user `ae4bcdd8106d4bebbdcae96be33505bc`. Rule list: `[]` (Enabled: `True`). {{(pid=86656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:53:52.039370 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-c7df51a5-8cfe-4d67-9509-c3ade816fe21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:52.062782 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3136aa-dee1-4134-a78d-3a3b6bf754e1 admin admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:52.066165 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-af3136aa-dee1-4134-a78d-3a3b6bf754e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:52.126018 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:53:52.142468 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:53:52.163085 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 1051/2129] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jul 14 10:53:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:53:52.163998 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7df51a5-8cfe-4d67-9509-c3ade816fe21 None None] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:52.165465 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-c7df51a5-8cfe-4d67-9509-c3ade816fe21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:52.181862 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7df51a5-8cfe-4d67-9509-c3ade816fe21 None None] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:52.189501 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a80ca0-7770-4d70-9653-c27cbf575258 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:52.190462 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a80ca0-7770-4d70-9653-c27cbf575258 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:52.190955 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a80ca0-7770-4d70-9653-c27cbf575258 admin admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:52.191372 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a80ca0-7770-4d70-9653-c27cbf575258 admin admin] PATH_INFO: `/v3/projects/4718bcc272be43e0b036a3badd326884` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:52.193849 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a80ca0-7770-4d70-9653-c27cbf575258 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4718bcc272be43e0b036a3badd326884)` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:52.196019 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a80ca0-7770-4d70-9653-c27cbf575258 admin admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:52.227504 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3136aa-dee1-4134-a78d-3a3b6bf754e1 admin admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:52.234256 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0261cb53-df32-4879-8360-9a1afa515839 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:52.235146 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0261cb53-df32-4879-8360-9a1afa515839 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:52.235574 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0261cb53-df32-4879-8360-9a1afa515839 admin admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:52.235869 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0261cb53-df32-4879-8360-9a1afa515839 admin admin] PATH_INFO: `/v3/projects/4269af6c85f54c8e9219bf99d8db06c9` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:52.237260 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0261cb53-df32-4879-8360-9a1afa515839 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4269af6c85f54c8e9219bf99d8db06c9)` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:52.239270 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0261cb53-df32-4879-8360-9a1afa515839 admin admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:52.252922 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-43a80ca0-7770-4d70-9653-c27cbf575258 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4718bcc272be43e0b036a3badd326884', 'request_id': 'req-43a80ca0-7770-4d70-9653-c27cbf575258'} {{(pid=86656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:52.261610 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-43a80ca0-7770-4d70-9653-c27cbf575258 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4718bcc272be43e0b036a3badd326884', 'request_id': 'req-43a80ca0-7770-4d70-9653-c27cbf575258'} {{(pid=86656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:52.270746 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-43a80ca0-7770-4d70-9653-c27cbf575258 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4718bcc272be43e0b036a3badd326884', 'request_id': 'req-43a80ca0-7770-4d70-9653-c27cbf575258'} {{(pid=86656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:52.284574 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-43a80ca0-7770-4d70-9653-c27cbf575258 admin admin] The token cache is being invalidate because project 4718bcc272be43e0b036a3badd326884 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86656) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 10:53:52.284961 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-43a80ca0-7770-4d70-9653-c27cbf575258 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:52.285564 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-43a80ca0-7770-4d70-9653-c27cbf575258 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:52.290120 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 1052/2130] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Jul 14 10:53:52 2022] DELETE /identity/v3/projects/4718bcc272be43e0b036a3badd326884 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:53:52.290120 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a80ca0-7770-4d70-9653-c27cbf575258 admin admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:52.290120 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-43a80ca0-7770-4d70-9653-c27cbf575258 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:52.303059 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-0261cb53-df32-4879-8360-9a1afa515839 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4269af6c85f54c8e9219bf99d8db06c9', 'request_id': 'req-0261cb53-df32-4879-8360-9a1afa515839'} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:52.321465 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-0261cb53-df32-4879-8360-9a1afa515839 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4269af6c85f54c8e9219bf99d8db06c9', 'request_id': 'req-0261cb53-df32-4879-8360-9a1afa515839'} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:52.337349 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-0261cb53-df32-4879-8360-9a1afa515839 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4269af6c85f54c8e9219bf99d8db06c9', 'request_id': 'req-0261cb53-df32-4879-8360-9a1afa515839'} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:52.357683 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-0261cb53-df32-4879-8360-9a1afa515839 admin admin] The token cache is being invalidate because project 4269af6c85f54c8e9219bf99d8db06c9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86655) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 10:53:52.358532 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-0261cb53-df32-4879-8360-9a1afa515839 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:52.359336 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-0261cb53-df32-4879-8360-9a1afa515839 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:52.361628 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 1079/2131] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Jul 14 10:53:52 2022] DELETE /identity/v3/projects/4269af6c85f54c8e9219bf99d8db06c9 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:53:52.362530 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0261cb53-df32-4879-8360-9a1afa515839 admin admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:52.364321 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-0261cb53-df32-4879-8360-9a1afa515839 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:52.371051 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a80ca0-7770-4d70-9653-c27cbf575258 admin admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:52.465312 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3b2049-3b30-49f9-9ae4-00825c40b7ba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dddf93691844886982c91fea974385d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59391272ecbe48b0aa736cb43807be1d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:52.466071 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3b2049-3b30-49f9-9ae4-00825c40b7ba service neutron] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:52.466502 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3b2049-3b30-49f9-9ae4-00825c40b7ba service neutron] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:52.467021 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3b2049-3b30-49f9-9ae4-00825c40b7ba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:52.470410 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-0a3b2049-3b30-49f9-9ae4-00825c40b7ba service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:52.503589 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0261cb53-df32-4879-8360-9a1afa515839 admin admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:52.509861 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666a2d97-b89c-4fb8-b08d-d17f3e300e59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:52.511596 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666a2d97-b89c-4fb8-b08d-d17f3e300e59 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:52.512034 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666a2d97-b89c-4fb8-b08d-d17f3e300e59 admin admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:52.513141 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666a2d97-b89c-4fb8-b08d-d17f3e300e59 admin admin] PATH_INFO: `/v3/users/f38b6f63fdcf46d89d427cb878c5969e` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:52.515307 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666a2d97-b89c-4fb8-b08d-d17f3e300e59 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f38b6f63fdcf46d89d427cb878c5969e)` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:52.519162 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666a2d97-b89c-4fb8-b08d-d17f3e300e59 admin admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:52.542947 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:53:52.577171 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3b2049-3b30-49f9-9ae4-00825c40b7ba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:52.579706 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3b2049-3b30-49f9-9ae4-00825c40b7ba service neutron] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:52.597542 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 1053/2132] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jul 14 10:53:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:53:52.599372 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ee6827-0fc9-4e8b-bd77-0fbd8e43fd24 None None] REQUEST_METHOD: `POST` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:52.599760 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ee6827-0fc9-4e8b-bd77-0fbd8e43fd24 None None] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:52.600132 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ee6827-0fc9-4e8b-bd77-0fbd8e43fd24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:52.610836 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:53:52.615554 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-666a2d97-b89c-4fb8-b08d-d17f3e300e59 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f38b6f63fdcf46d89d427cb878c5969e'} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:52.628328 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-666a2d97-b89c-4fb8-b08d-d17f3e300e59 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f38b6f63fdcf46d89d427cb878c5969e'} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:52.629249 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-666a2d97-b89c-4fb8-b08d-d17f3e300e59 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f38b6f63fdcf46d89d427cb878c5969e'} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:52.630171 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.auth.core [None req-94ee6827-0fc9-4e8b-bd77-0fbd8e43fd24 None None] MFA Rules not processed for user `ae4bcdd8106d4bebbdcae96be33505bc`. Rule list: `[]` (Enabled: `True`). {{(pid=86656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:53:52.631394 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-94ee6827-0fc9-4e8b-bd77-0fbd8e43fd24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:52.643339 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-666a2d97-b89c-4fb8-b08d-d17f3e300e59 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f38b6f63fdcf46d89d427cb878c5969e'} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:52.644251 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-666a2d97-b89c-4fb8-b08d-d17f3e300e59 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f38b6f63fdcf46d89d427cb878c5969e'} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:52.668500 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 1054/2133] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jul 14 10:53:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:53:52.670314 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f20e87a-7e25-47f3-bfdf-b30900dea721 None None] REQUEST_METHOD: `POST` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:52.670702 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f20e87a-7e25-47f3-bfdf-b30900dea721 None None] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:52.671074 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f20e87a-7e25-47f3-bfdf-b30900dea721 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:52.674639 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 1080/2134] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Jul 14 10:53:52 2022] DELETE /identity/v3/users/f38b6f63fdcf46d89d427cb878c5969e => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:53:52.694388 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.auth.core [None req-9f20e87a-7e25-47f3-bfdf-b30900dea721 None None] MFA Rules not processed for user `ae4bcdd8106d4bebbdcae96be33505bc`. Rule list: `[]` (Enabled: `True`). {{(pid=86656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:53:52.695675 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-9f20e87a-7e25-47f3-bfdf-b30900dea721 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:52.767875 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 1055/2135] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jul 14 10:53:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:53:52.774348 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666a2d97-b89c-4fb8-b08d-d17f3e300e59 admin admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:52.789609 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666a2d97-b89c-4fb8-b08d-d17f3e300e59 admin admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:52.797145 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff6189e-505e-4b7d-b5e7-a160713c623b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:52.798029 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff6189e-505e-4b7d-b5e7-a160713c623b admin admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:52.798314 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff6189e-505e-4b7d-b5e7-a160713c623b admin admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:52.798746 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff6189e-505e-4b7d-b5e7-a160713c623b admin admin] PATH_INFO: `/v3/domains` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:52.800222 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff6189e-505e-4b7d-b5e7-a160713c623b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:53:52.800612 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff6189e-505e-4b7d-b5e7-a160713c623b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:52.805545 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff6189e-505e-4b7d-b5e7-a160713c623b admin admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:52.823364 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 1081/2136] 10.222.0.16 () {58 vars in 1152 bytes} [Thu Jul 14 10:53:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:53:52.828494 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f20e87a-7e25-47f3-bfdf-b30900dea721 None None] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:52.839897 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f20e87a-7e25-47f3-bfdf-b30900dea721 None None] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:52.845215 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67556de-5e97-4dd1-b616-45f920ed3f5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:52.845918 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67556de-5e97-4dd1-b616-45f920ed3f5b admin admin] REQUEST_METHOD: `POST` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:52.846204 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67556de-5e97-4dd1-b616-45f920ed3f5b admin admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:52.846479 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67556de-5e97-4dd1-b616-45f920ed3f5b admin admin] PATH_INFO: `/v3/projects` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:52.847194 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67556de-5e97-4dd1-b616-45f920ed3f5b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:52.849397 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67556de-5e97-4dd1-b616-45f920ed3f5b admin admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:52.886681 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 1056/2137] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Jul 14 10:53:52 2022] POST /identity/v3/projects => generated 379 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:53:52.888646 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff6189e-505e-4b7d-b5e7-a160713c623b admin admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:52.904101 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff6189e-505e-4b7d-b5e7-a160713c623b admin admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:52.975215 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770cf3dc-839c-4254-aca0-ba777cc126e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:52.975828 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770cf3dc-839c-4254-aca0-ba777cc126e0 admin admin] REQUEST_METHOD: `POST` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:52.976118 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770cf3dc-839c-4254-aca0-ba777cc126e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:52.976400 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770cf3dc-839c-4254-aca0-ba777cc126e0 admin admin] PATH_INFO: `/v3/users` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:52.977178 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770cf3dc-839c-4254-aca0-ba777cc126e0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:52.980356 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770cf3dc-839c-4254-aca0-ba777cc126e0 admin admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:53.009765 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 1082/2138] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Jul 14 10:53:52 2022] POST /identity/v3/users => generated 290 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:53:53.011539 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67556de-5e97-4dd1-b616-45f920ed3f5b admin admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:53.023731 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67556de-5e97-4dd1-b616-45f920ed3f5b admin admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:53.029056 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770cf3dc-839c-4254-aca0-ba777cc126e0 admin admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:53.031272 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-770cf3dc-839c-4254-aca0-ba777cc126e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:53.041662 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458551cb-d4ab-4c43-8497-82ef17f3b1a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:53.044860 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458551cb-d4ab-4c43-8497-82ef17f3b1a9 admin admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:53.045912 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458551cb-d4ab-4c43-8497-82ef17f3b1a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:53.046277 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770cf3dc-839c-4254-aca0-ba777cc126e0 admin admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:53.046855 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458551cb-d4ab-4c43-8497-82ef17f3b1a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:53.047817 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458551cb-d4ab-4c43-8497-82ef17f3b1a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:53.052983 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458551cb-d4ab-4c43-8497-82ef17f3b1a9 admin admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:53.056248 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7c19af-e645-4804-9973-717ba262490d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:53.057211 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7c19af-e645-4804-9973-717ba262490d admin admin] REQUEST_METHOD: `DELETE` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:53.057468 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7c19af-e645-4804-9973-717ba262490d admin admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:53.057748 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7c19af-e645-4804-9973-717ba262490d admin admin] PATH_INFO: `/v3/projects/1e5fd8cc10804a9db35f51509ad58383` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:53.060743 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7c19af-e645-4804-9973-717ba262490d admin admin] RBAC: Authorizing `identity:delete_project(project_id=1e5fd8cc10804a9db35f51509ad58383)` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:53.062789 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7c19af-e645-4804-9973-717ba262490d admin admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:53.087979 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 1057/2139] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jul 14 10:53:53 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:53:53.089049 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458551cb-d4ab-4c43-8497-82ef17f3b1a9 admin admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:53.102106 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458551cb-d4ab-4c43-8497-82ef17f3b1a9 admin admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:53.109833 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd02709b-ab83-48ed-ab8f-c9ac38b93e8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:53.110658 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd02709b-ab83-48ed-ab8f-c9ac38b93e8b admin admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:53.111637 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd02709b-ab83-48ed-ab8f-c9ac38b93e8b admin admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:53.112024 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd02709b-ab83-48ed-ab8f-c9ac38b93e8b admin admin] PATH_INFO: `/v3/roles` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:53.113444 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd02709b-ab83-48ed-ab8f-c9ac38b93e8b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:53.115646 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd02709b-ab83-48ed-ab8f-c9ac38b93e8b admin admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:53.135522 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 1058/2140] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jul 14 10:53:53 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:53:53.139080 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd02709b-ab83-48ed-ab8f-c9ac38b93e8b admin admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:53.152485 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd02709b-ab83-48ed-ab8f-c9ac38b93e8b admin admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:53.160668 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496e86cc-42f1-46a5-b0e8-d6c9390ad968 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:53.163580 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496e86cc-42f1-46a5-b0e8-d6c9390ad968 admin admin] REQUEST_METHOD: `PUT` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:53.163580 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496e86cc-42f1-46a5-b0e8-d6c9390ad968 admin admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:53.163580 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496e86cc-42f1-46a5-b0e8-d6c9390ad968 admin admin] PATH_INFO: `/v3/projects/e8e4b832024b4d57abd61499c89747c2/users/2ece1b2f202044a2a8bd954ae5b556e2/roles/0da46c267d354cce81495dfdd56c1ec2` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:53.187071 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496e86cc-42f1-46a5-b0e8-d6c9390ad968 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e8e4b832024b4d57abd61499c89747c2, user_id=2ece1b2f202044a2a8bd954ae5b556e2, role_id=0da46c267d354cce81495dfdd56c1ec2)` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:53.191117 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496e86cc-42f1-46a5-b0e8-d6c9390ad968 admin admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:53.211490 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-8c7c19af-e645-4804-9973-717ba262490d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1e5fd8cc10804a9db35f51509ad58383', 'request_id': 'req-8c7c19af-e645-4804-9973-717ba262490d'} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:53.231981 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 1059/2141] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Jul 14 10:53:53 2022] PUT /identity/v3/projects/e8e4b832024b4d57abd61499c89747c2/users/2ece1b2f202044a2a8bd954ae5b556e2/roles/0da46c267d354cce81495dfdd56c1ec2 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:53:53.233294 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496e86cc-42f1-46a5-b0e8-d6c9390ad968 admin admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:53.236847 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-496e86cc-42f1-46a5-b0e8-d6c9390ad968 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:53.238176 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-8c7c19af-e645-4804-9973-717ba262490d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1e5fd8cc10804a9db35f51509ad58383', 'request_id': 'req-8c7c19af-e645-4804-9973-717ba262490d'} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:53.265104 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-8c7c19af-e645-4804-9973-717ba262490d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1e5fd8cc10804a9db35f51509ad58383', 'request_id': 'req-8c7c19af-e645-4804-9973-717ba262490d'} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:53.288276 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-8c7c19af-e645-4804-9973-717ba262490d admin admin] The token cache is being invalidate because project 1e5fd8cc10804a9db35f51509ad58383 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86655) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 10:53:53.291724 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-8c7c19af-e645-4804-9973-717ba262490d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:53.293075 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-8c7c19af-e645-4804-9973-717ba262490d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:53.298460 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 1083/2142] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Jul 14 10:53:53 2022] DELETE /identity/v3/projects/1e5fd8cc10804a9db35f51509ad58383 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:53:53.300175 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3beb4c11-6f87-4817-9823-87b1a79eb119 None None] REQUEST_METHOD: `POST` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:53.302657 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3beb4c11-6f87-4817-9823-87b1a79eb119 None None] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:53.303207 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3beb4c11-6f87-4817-9823-87b1a79eb119 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:53.334952 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496e86cc-42f1-46a5-b0e8-d6c9390ad968 admin admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:53.340142 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb607871-9674-4ee6-9d77-21d55b74f514 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:53.342027 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb607871-9674-4ee6-9d77-21d55b74f514 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:53.342320 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb607871-9674-4ee6-9d77-21d55b74f514 admin admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:53.342608 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb607871-9674-4ee6-9d77-21d55b74f514 admin admin] PATH_INFO: `/v3/projects/9e9338c20d0c4bee8d3603f32deb8832` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:53.352925 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb607871-9674-4ee6-9d77-21d55b74f514 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9e9338c20d0c4bee8d3603f32deb8832)` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:53.355221 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb607871-9674-4ee6-9d77-21d55b74f514 admin admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:53.382796 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:53:53.404857 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.auth.core [None req-3beb4c11-6f87-4817-9823-87b1a79eb119 None None] MFA Rules not processed for user `2ece1b2f202044a2a8bd954ae5b556e2`. Rule list: `[]` (Enabled: `True`). {{(pid=86655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:53:53.406327 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-3beb4c11-6f87-4817-9823-87b1a79eb119 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:53.440212 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=85,keystone:INSERT=5,keystone:DELETE=10 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:53:53.465184 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-bb607871-9674-4ee6-9d77-21d55b74f514 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9e9338c20d0c4bee8d3603f32deb8832', 'request_id': 'req-bb607871-9674-4ee6-9d77-21d55b74f514'} {{(pid=86656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:53.490494 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-bb607871-9674-4ee6-9d77-21d55b74f514 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9e9338c20d0c4bee8d3603f32deb8832', 'request_id': 'req-bb607871-9674-4ee6-9d77-21d55b74f514'} {{(pid=86656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:53.504376 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-bb607871-9674-4ee6-9d77-21d55b74f514 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9e9338c20d0c4bee8d3603f32deb8832', 'request_id': 'req-bb607871-9674-4ee6-9d77-21d55b74f514'} {{(pid=86656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:53.533846 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-bb607871-9674-4ee6-9d77-21d55b74f514 admin admin] The token cache is being invalidate because project 9e9338c20d0c4bee8d3603f32deb8832 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86656) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 10:53:53.534405 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-bb607871-9674-4ee6-9d77-21d55b74f514 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:53.535113 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-bb607871-9674-4ee6-9d77-21d55b74f514 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:53.538129 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 1060/2143] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Jul 14 10:53:53 2022] DELETE /identity/v3/projects/9e9338c20d0c4bee8d3603f32deb8832 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:53:53.542064 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb607871-9674-4ee6-9d77-21d55b74f514 admin admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:53.543914 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-bb607871-9674-4ee6-9d77-21d55b74f514 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:53.591888 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 1084/2144] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jul 14 10:53:53 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 292 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:53:53.593111 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3beb4c11-6f87-4817-9823-87b1a79eb119 None None] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:53.596638 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-3beb4c11-6f87-4817-9823-87b1a79eb119 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:53.618267 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3beb4c11-6f87-4817-9823-87b1a79eb119 None None] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:53.645559 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb607871-9674-4ee6-9d77-21d55b74f514 admin admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:53.650839 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9832ac00-3f62-496b-a553-db9b718822d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:53.651886 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9832ac00-3f62-496b-a553-db9b718822d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:53.652177 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9832ac00-3f62-496b-a553-db9b718822d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:53.652722 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9832ac00-3f62-496b-a553-db9b718822d0 admin admin] PATH_INFO: `/v3/projects/e85aed0d1b3a416babb9dd49c87921a6` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:53.655274 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9832ac00-3f62-496b-a553-db9b718822d0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e85aed0d1b3a416babb9dd49c87921a6)` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:53.657553 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9832ac00-3f62-496b-a553-db9b718822d0 admin admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:53.701172 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63404687-70ee-4ada-ab3d-30c38d1dd166 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:53.702334 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63404687-70ee-4ada-ab3d-30c38d1dd166 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:53.702780 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63404687-70ee-4ada-ab3d-30c38d1dd166 admin admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:53.703067 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63404687-70ee-4ada-ab3d-30c38d1dd166 admin admin] PATH_INFO: `/v3/users/90779d5839d04de19b9075e04bb3bacb` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:53.704643 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63404687-70ee-4ada-ab3d-30c38d1dd166 admin admin] RBAC: Authorizing `identity:delete_user(user_id=90779d5839d04de19b9075e04bb3bacb)` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:53.706792 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63404687-70ee-4ada-ab3d-30c38d1dd166 admin admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:53.721608 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-9832ac00-3f62-496b-a553-db9b718822d0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e85aed0d1b3a416babb9dd49c87921a6', 'request_id': 'req-9832ac00-3f62-496b-a553-db9b718822d0'} {{(pid=86656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:53.730787 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-9832ac00-3f62-496b-a553-db9b718822d0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e85aed0d1b3a416babb9dd49c87921a6', 'request_id': 'req-9832ac00-3f62-496b-a553-db9b718822d0'} {{(pid=86656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:53.741359 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-9832ac00-3f62-496b-a553-db9b718822d0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e85aed0d1b3a416babb9dd49c87921a6', 'request_id': 'req-9832ac00-3f62-496b-a553-db9b718822d0'} {{(pid=86656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:53.764865 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-9832ac00-3f62-496b-a553-db9b718822d0 admin admin] The token cache is being invalidate because project e85aed0d1b3a416babb9dd49c87921a6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86656) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 10:53:53.764865 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-9832ac00-3f62-496b-a553-db9b718822d0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:53.764865 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-9832ac00-3f62-496b-a553-db9b718822d0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:53.764865 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 1061/2145] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Jul 14 10:53:53 2022] DELETE /identity/v3/projects/e85aed0d1b3a416babb9dd49c87921a6 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:53:53.764865 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9832ac00-3f62-496b-a553-db9b718822d0 admin admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:53.765345 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-9832ac00-3f62-496b-a553-db9b718822d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:53.779818 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-63404687-70ee-4ada-ab3d-30c38d1dd166 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '90779d5839d04de19b9075e04bb3bacb'} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:53.792024 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-63404687-70ee-4ada-ab3d-30c38d1dd166 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '90779d5839d04de19b9075e04bb3bacb'} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:53.792857 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-63404687-70ee-4ada-ab3d-30c38d1dd166 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '90779d5839d04de19b9075e04bb3bacb'} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:53.802053 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-63404687-70ee-4ada-ab3d-30c38d1dd166 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '90779d5839d04de19b9075e04bb3bacb'} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:53.802934 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-63404687-70ee-4ada-ab3d-30c38d1dd166 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '90779d5839d04de19b9075e04bb3bacb'} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:53.822470 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:53:53.829849 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 1085/2146] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Jul 14 10:53:53 2022] DELETE /identity/v3/users/90779d5839d04de19b9075e04bb3bacb => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:53:53.831436 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c89443-06af-4387-b35c-0e5720979470 None None] REQUEST_METHOD: `POST` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:53.832272 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c89443-06af-4387-b35c-0e5720979470 None None] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:53.832272 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c89443-06af-4387-b35c-0e5720979470 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:53.856912 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.auth.core [None req-a8c89443-06af-4387-b35c-0e5720979470 None None] MFA Rules not processed for user `ae4bcdd8106d4bebbdcae96be33505bc`. Rule list: `[]` (Enabled: `True`). {{(pid=86655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:53:53.859206 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-a8c89443-06af-4387-b35c-0e5720979470 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:53.879093 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9832ac00-3f62-496b-a553-db9b718822d0 admin admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:53.897839 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:53:53.977014 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98ba23a-f126-4f7f-ac21-eb71ff0dd550 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:53.978569 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98ba23a-f126-4f7f-ac21-eb71ff0dd550 admin admin] REQUEST_METHOD: `POST` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:53.978914 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98ba23a-f126-4f7f-ac21-eb71ff0dd550 admin admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:53.979738 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98ba23a-f126-4f7f-ac21-eb71ff0dd550 admin admin] PATH_INFO: `/v3/projects` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:53.980474 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98ba23a-f126-4f7f-ac21-eb71ff0dd550 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:53.983367 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 1086/2147] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jul 14 10:53:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:53:53.986639 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98ba23a-f126-4f7f-ac21-eb71ff0dd550 admin admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:53.990720 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da90613-138d-4621-b1c9-8001c980a42e None None] REQUEST_METHOD: `POST` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:53.991295 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da90613-138d-4621-b1c9-8001c980a42e None None] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:53.991793 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da90613-138d-4621-b1c9-8001c980a42e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:54.050012 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.auth.core [None req-3da90613-138d-4621-b1c9-8001c980a42e None None] MFA Rules not processed for user `ae4bcdd8106d4bebbdcae96be33505bc`. Rule list: `[]` (Enabled: `True`). {{(pid=86655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:53:54.053545 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 1062/2148] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Jul 14 10:53:53 2022] POST /identity/v3/projects => generated 381 bytes in 291 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:53:54.053878 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-3da90613-138d-4621-b1c9-8001c980a42e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:54.058398 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98ba23a-f126-4f7f-ac21-eb71ff0dd550 admin admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:54.066003 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-c98ba23a-f126-4f7f-ac21-eb71ff0dd550 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:54.206236 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 1087/2149] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jul 14 10:53:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:53:54.211225 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da90613-138d-4621-b1c9-8001c980a42e None None] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:54.217544 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98ba23a-f126-4f7f-ac21-eb71ff0dd550 admin admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:54.224875 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b0ef42-c1dd-4234-897d-66abdf6b7b02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:54.226453 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b0ef42-c1dd-4234-897d-66abdf6b7b02 admin admin] REQUEST_METHOD: `POST` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:54.226837 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b0ef42-c1dd-4234-897d-66abdf6b7b02 admin admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:54.227228 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b0ef42-c1dd-4234-897d-66abdf6b7b02 admin admin] PATH_INFO: `/v3/users` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:54.228386 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b0ef42-c1dd-4234-897d-66abdf6b7b02 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:54.229259 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da90613-138d-4621-b1c9-8001c980a42e None None] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:54.233784 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b0ef42-c1dd-4234-897d-66abdf6b7b02 admin admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:54.235395 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bdfa9ef-37c4-45b7-af4a-067f94021bdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:54.236361 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdfa9ef-37c4-45b7-af4a-067f94021bdf admin admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:54.236660 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdfa9ef-37c4-45b7-af4a-067f94021bdf admin admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:54.237295 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdfa9ef-37c4-45b7-af4a-067f94021bdf admin admin] PATH_INFO: `/v3/domains` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:54.238307 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bdfa9ef-37c4-45b7-af4a-067f94021bdf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:53:54.238629 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bdfa9ef-37c4-45b7-af4a-067f94021bdf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:54.240476 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bdfa9ef-37c4-45b7-af4a-067f94021bdf admin admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:54.260336 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 1063/2150] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Jul 14 10:53:54 2022] POST /identity/v3/users => generated 297 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:53:54.264709 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 1088/2151] 10.222.0.16 () {58 vars in 1152 bytes} [Thu Jul 14 10:53:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:53:54.264924 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b0ef42-c1dd-4234-897d-66abdf6b7b02 admin admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:54.265685 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bdfa9ef-37c4-45b7-af4a-067f94021bdf admin admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:54.276754 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b0ef42-c1dd-4234-897d-66abdf6b7b02 admin admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:54.277080 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bdfa9ef-37c4-45b7-af4a-067f94021bdf admin admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:54.282446 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0062d350-0b32-4a67-bebb-7209577e862e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:54.282692 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae4ccde-6d97-4227-bb33-ac734d4690e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:54.283327 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0062d350-0b32-4a67-bebb-7209577e862e admin admin] REQUEST_METHOD: `POST` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:54.283454 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae4ccde-6d97-4227-bb33-ac734d4690e7 admin admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:54.283636 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae4ccde-6d97-4227-bb33-ac734d4690e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:54.283906 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0062d350-0b32-4a67-bebb-7209577e862e admin admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:54.283996 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae4ccde-6d97-4227-bb33-ac734d4690e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:54.284356 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0062d350-0b32-4a67-bebb-7209577e862e admin admin] PATH_INFO: `/v3/projects` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:54.284653 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae4ccde-6d97-4227-bb33-ac734d4690e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:54.285284 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0062d350-0b32-4a67-bebb-7209577e862e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:54.286306 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae4ccde-6d97-4227-bb33-ac734d4690e7 admin admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:54.287380 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0062d350-0b32-4a67-bebb-7209577e862e admin admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:54.298067 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 1064/2152] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jul 14 10:53:54 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 10:53:54.301704 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae4ccde-6d97-4227-bb33-ac734d4690e7 admin admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:54.312882 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae4ccde-6d97-4227-bb33-ac734d4690e7 admin admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:54.318555 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917d5869-665a-4c1a-9d0c-997bfff8331e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:54.319822 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917d5869-665a-4c1a-9d0c-997bfff8331e admin admin] REQUEST_METHOD: `PUT` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:54.320179 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917d5869-665a-4c1a-9d0c-997bfff8331e admin admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:54.320535 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917d5869-665a-4c1a-9d0c-997bfff8331e admin admin] PATH_INFO: `/v3/projects/866019d7aa374011b8479ae9be4595e2/users/9d2a80438eac45b19a5b5c21e1849aa0/roles/153539819e5542df99269d2913bbecfb` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:54.333876 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 1089/2153] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Jul 14 10:53:54 2022] POST /identity/v3/projects => generated 373 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:53:54.335063 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0062d350-0b32-4a67-bebb-7209577e862e admin admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:54.338792 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917d5869-665a-4c1a-9d0c-997bfff8331e admin admin] RBAC: Authorizing `identity:create_grant(project_id=866019d7aa374011b8479ae9be4595e2, user_id=9d2a80438eac45b19a5b5c21e1849aa0, role_id=153539819e5542df99269d2913bbecfb)` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:54.344250 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917d5869-665a-4c1a-9d0c-997bfff8331e admin admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:54.369524 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 1065/2154] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Jul 14 10:53:54 2022] PUT /identity/v3/projects/866019d7aa374011b8479ae9be4595e2/users/9d2a80438eac45b19a5b5c21e1849aa0/roles/153539819e5542df99269d2913bbecfb => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 10:53:54.373977 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917d5869-665a-4c1a-9d0c-997bfff8331e admin admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:54.402622 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:53:54.434476 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0062d350-0b32-4a67-bebb-7209577e862e admin admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:54.467956 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917d5869-665a-4c1a-9d0c-997bfff8331e admin admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:54.479629 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e6a140-afc2-4955-96bc-f441a741a4f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:54.480525 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e6a140-afc2-4955-96bc-f441a741a4f0 admin admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:54.480953 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e6a140-afc2-4955-96bc-f441a741a4f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:54.481418 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e6a140-afc2-4955-96bc-f441a741a4f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:54.483486 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e6a140-afc2-4955-96bc-f441a741a4f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:54.485319 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e6a140-afc2-4955-96bc-f441a741a4f0 admin admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:54.497913 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:53:54.519807 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 1066/2155] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jul 14 10:53:54 2022] GET /identity/v3/roles => generated 1420 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 10:53:54.523865 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e6a140-afc2-4955-96bc-f441a741a4f0 admin admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:54.532508 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d945cb-b60a-4ddc-84a0-a9549c7e1253 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:54.533425 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d945cb-b60a-4ddc-84a0-a9549c7e1253 admin admin] REQUEST_METHOD: `POST` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:54.533722 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d945cb-b60a-4ddc-84a0-a9549c7e1253 admin admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:54.534007 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d945cb-b60a-4ddc-84a0-a9549c7e1253 admin admin] PATH_INFO: `/v3/users` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:54.535034 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d945cb-b60a-4ddc-84a0-a9549c7e1253 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:54.537044 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d945cb-b60a-4ddc-84a0-a9549c7e1253 admin admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:54.543762 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e6a140-afc2-4955-96bc-f441a741a4f0 admin admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:54.551569 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6da417-7c35-47a7-a06f-d7512344a3b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:54.553175 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6da417-7c35-47a7-a06f-d7512344a3b7 admin admin] REQUEST_METHOD: `PUT` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:54.553995 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6da417-7c35-47a7-a06f-d7512344a3b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:54.554346 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6da417-7c35-47a7-a06f-d7512344a3b7 admin admin] PATH_INFO: `/v3/projects/866019d7aa374011b8479ae9be4595e2/users/9d2a80438eac45b19a5b5c21e1849aa0/roles/153539819e5542df99269d2913bbecfb` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:54.558185 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6da417-7c35-47a7-a06f-d7512344a3b7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=866019d7aa374011b8479ae9be4595e2, user_id=9d2a80438eac45b19a5b5c21e1849aa0, role_id=153539819e5542df99269d2913bbecfb)` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:54.568216 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 1090/2156] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Jul 14 10:53:54 2022] POST /identity/v3/users => generated 287 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:53:54.568841 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6da417-7c35-47a7-a06f-d7512344a3b7 admin admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:54.576944 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d945cb-b60a-4ddc-84a0-a9549c7e1253 admin admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:54.589124 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d945cb-b60a-4ddc-84a0-a9549c7e1253 admin admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:54.599658 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 1067/2157] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Jul 14 10:53:54 2022] PUT /identity/v3/projects/866019d7aa374011b8479ae9be4595e2/users/9d2a80438eac45b19a5b5c21e1849aa0/roles/153539819e5542df99269d2913bbecfb => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:53:54.601812 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189c5c10-32fc-4426-8dbe-c853f1b3259c None None] REQUEST_METHOD: `POST` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:54.602220 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189c5c10-32fc-4426-8dbe-c853f1b3259c None None] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:54.602716 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189c5c10-32fc-4426-8dbe-c853f1b3259c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:54.654541 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.auth.core [None req-189c5c10-32fc-4426-8dbe-c853f1b3259c None None] MFA Rules not processed for user `9d2a80438eac45b19a5b5c21e1849aa0`. Rule list: `[]` (Enabled: `True`). {{(pid=86656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:53:54.655828 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-189c5c10-32fc-4426-8dbe-c853f1b3259c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:54.713975 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3533c689-28e6-44f3-aa1e-d197afab6c6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:54.715023 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3533c689-28e6-44f3-aa1e-d197afab6c6f admin admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:54.715475 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3533c689-28e6-44f3-aa1e-d197afab6c6f admin admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:54.716174 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3533c689-28e6-44f3-aa1e-d197afab6c6f admin admin] PATH_INFO: `/v3/roles` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:54.717321 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3533c689-28e6-44f3-aa1e-d197afab6c6f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:54.719096 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3533c689-28e6-44f3-aa1e-d197afab6c6f admin admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:54.739833 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 1091/2158] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jul 14 10:53:54 2022] GET /identity/v3/roles => generated 1420 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:53:54.745546 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3533c689-28e6-44f3-aa1e-d197afab6c6f admin admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:54.758177 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3533c689-28e6-44f3-aa1e-d197afab6c6f admin admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:54.764712 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88f0575-733b-4bf0-889b-5fb4178b4be1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:54.765472 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88f0575-733b-4bf0-889b-5fb4178b4be1 admin admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:54.765777 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88f0575-733b-4bf0-889b-5fb4178b4be1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:54.766076 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88f0575-733b-4bf0-889b-5fb4178b4be1 admin admin] PATH_INFO: `/v3/roles` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:54.766827 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88f0575-733b-4bf0-889b-5fb4178b4be1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:54.770305 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88f0575-733b-4bf0-889b-5fb4178b4be1 admin admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:54.784037 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 1068/2159] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jul 14 10:53:54 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:53:54.787315 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 1092/2160] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jul 14 10:53:54 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 10:53:54.788155 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189c5c10-32fc-4426-8dbe-c853f1b3259c None None] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:54.804134 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88f0575-733b-4bf0-889b-5fb4178b4be1 admin admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:54.807924 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-c88f0575-733b-4bf0-889b-5fb4178b4be1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:54.816304 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189c5c10-32fc-4426-8dbe-c853f1b3259c None None] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:54.822760 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e306442-ed5a-4290-a6e8-936474c67347 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:54.823830 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e306442-ed5a-4290-a6e8-936474c67347 admin admin] REQUEST_METHOD: `PUT` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:54.824906 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e306442-ed5a-4290-a6e8-936474c67347 admin admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:54.824906 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e306442-ed5a-4290-a6e8-936474c67347 admin admin] PATH_INFO: `/v3/projects/b5c94fdc5bfb45c992ce010d70cce434/users/839b96e5092f44aead36bc311afac2d2/roles/0da46c267d354cce81495dfdd56c1ec2` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:54.846724 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e306442-ed5a-4290-a6e8-936474c67347 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b5c94fdc5bfb45c992ce010d70cce434, user_id=839b96e5092f44aead36bc311afac2d2, role_id=0da46c267d354cce81495dfdd56c1ec2)` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:54.852057 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e306442-ed5a-4290-a6e8-936474c67347 admin admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:54.868102 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 1069/2161] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Jul 14 10:53:54 2022] PUT /identity/v3/projects/b5c94fdc5bfb45c992ce010d70cce434/users/839b96e5092f44aead36bc311afac2d2/roles/0da46c267d354cce81495dfdd56c1ec2 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:53:54.879588 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88f0575-733b-4bf0-889b-5fb4178b4be1 admin admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:54.880566 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675df621-a5f0-4ebd-ba49-d20b6f8e0023 None None] REQUEST_METHOD: `POST` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:54.881009 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675df621-a5f0-4ebd-ba49-d20b6f8e0023 None None] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:54.881523 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675df621-a5f0-4ebd-ba49-d20b6f8e0023 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:54.920189 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.auth.core [None req-675df621-a5f0-4ebd-ba49-d20b6f8e0023 None None] MFA Rules not processed for user `839b96e5092f44aead36bc311afac2d2`. Rule list: `[]` (Enabled: `True`). {{(pid=86656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:53:54.921623 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-675df621-a5f0-4ebd-ba49-d20b6f8e0023 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:54.964963 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2decfd68-f00a-4526-86e4-31b5db28fa74 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68382432147a48c3b62271fd2a2eab04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59391272ecbe48b0aa736cb43807be1d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:54.966308 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2decfd68-f00a-4526-86e4-31b5db28fa74 service cinder] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:54.966606 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2decfd68-f00a-4526-86e4-31b5db28fa74 service cinder] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:54.966919 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2decfd68-f00a-4526-86e4-31b5db28fa74 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:55.010194 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:53:55.038035 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:53:55.057430 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2decfd68-f00a-4526-86e4-31b5db28fa74 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:55.059273 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2decfd68-f00a-4526-86e4-31b5db28fa74 service cinder] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:55.067511 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 1070/2162] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jul 14 10:53:54 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 10:53:55.068912 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675df621-a5f0-4ebd-ba49-d20b6f8e0023 None None] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:55.074197 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-675df621-a5f0-4ebd-ba49-d20b6f8e0023 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:55.076574 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 1093/2163] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jul 14 10:53:54 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 273 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:53:55.088831 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2decfd68-f00a-4526-86e4-31b5db28fa74 service cinder] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:55.092239 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-2decfd68-f00a-4526-86e4-31b5db28fa74 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:55.120927 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2decfd68-f00a-4526-86e4-31b5db28fa74 service cinder] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:55.137485 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f36e529-14e2-4b67-9187-c17a290ab900 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68382432147a48c3b62271fd2a2eab04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59391272ecbe48b0aa736cb43807be1d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:55.138353 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f36e529-14e2-4b67-9187-c17a290ab900 service cinder] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:55.138994 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f36e529-14e2-4b67-9187-c17a290ab900 service cinder] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:55.139319 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f36e529-14e2-4b67-9187-c17a290ab900 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:55.164261 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f36e529-14e2-4b67-9187-c17a290ab900 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:55.167201 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f36e529-14e2-4b67-9187-c17a290ab900 service cinder] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:55.190757 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 1094/2164] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jul 14 10:53:55 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 10:53:55.192210 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675df621-a5f0-4ebd-ba49-d20b6f8e0023 None None] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:55.198933 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c37d94c-3a94-4cd2-8589-3afe6eb75d14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:55.199860 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c37d94c-3a94-4cd2-8589-3afe6eb75d14 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:55.200197 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c37d94c-3a94-4cd2-8589-3afe6eb75d14 admin admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:55.200671 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c37d94c-3a94-4cd2-8589-3afe6eb75d14 admin admin] PATH_INFO: `/v3/projects/80749a2d012044668530313a1ebe2cbf` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:55.205875 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c37d94c-3a94-4cd2-8589-3afe6eb75d14 admin admin] RBAC: Authorizing `identity:delete_project(project_id=80749a2d012044668530313a1ebe2cbf)` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:55.208138 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c37d94c-3a94-4cd2-8589-3afe6eb75d14 admin admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:55.214486 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f36e529-14e2-4b67-9187-c17a290ab900 service cinder] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:55.236692 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f36e529-14e2-4b67-9187-c17a290ab900 service cinder] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:55.242292 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae747d9-6be9-49e3-ae35-7dbbee56a889 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:55.243819 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae747d9-6be9-49e3-ae35-7dbbee56a889 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:55.244195 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae747d9-6be9-49e3-ae35-7dbbee56a889 admin admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:55.244538 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae747d9-6be9-49e3-ae35-7dbbee56a889 admin admin] PATH_INFO: `/v3/users/839b96e5092f44aead36bc311afac2d2` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:55.250453 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae747d9-6be9-49e3-ae35-7dbbee56a889 admin admin] RBAC: Authorizing `identity:delete_user(user_id=839b96e5092f44aead36bc311afac2d2)` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:55.253272 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae747d9-6be9-49e3-ae35-7dbbee56a889 admin admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:55.346124 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-3c37d94c-3a94-4cd2-8589-3afe6eb75d14 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '80749a2d012044668530313a1ebe2cbf', 'request_id': 'req-3c37d94c-3a94-4cd2-8589-3afe6eb75d14'} {{(pid=86656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:55.353410 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-5ae747d9-6be9-49e3-ae35-7dbbee56a889 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '839b96e5092f44aead36bc311afac2d2'} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:55.359710 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-3c37d94c-3a94-4cd2-8589-3afe6eb75d14 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '80749a2d012044668530313a1ebe2cbf', 'request_id': 'req-3c37d94c-3a94-4cd2-8589-3afe6eb75d14'} {{(pid=86656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:55.367030 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-5ae747d9-6be9-49e3-ae35-7dbbee56a889 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '839b96e5092f44aead36bc311afac2d2'} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:55.368233 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-5ae747d9-6be9-49e3-ae35-7dbbee56a889 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '839b96e5092f44aead36bc311afac2d2'} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:55.377563 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-3c37d94c-3a94-4cd2-8589-3afe6eb75d14 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '80749a2d012044668530313a1ebe2cbf', 'request_id': 'req-3c37d94c-3a94-4cd2-8589-3afe6eb75d14'} {{(pid=86656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:55.383695 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-5ae747d9-6be9-49e3-ae35-7dbbee56a889 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '839b96e5092f44aead36bc311afac2d2'} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:55.391677 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-5ae747d9-6be9-49e3-ae35-7dbbee56a889 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '839b96e5092f44aead36bc311afac2d2'} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:55.408034 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-3c37d94c-3a94-4cd2-8589-3afe6eb75d14 admin admin] The token cache is being invalidate because project 80749a2d012044668530313a1ebe2cbf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86656) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 10:53:55.408034 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-3c37d94c-3a94-4cd2-8589-3afe6eb75d14 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:55.411627 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-3c37d94c-3a94-4cd2-8589-3afe6eb75d14 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:55.414664 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 1071/2165] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Jul 14 10:53:55 2022] DELETE /identity/v3/projects/80749a2d012044668530313a1ebe2cbf => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:53:55.422167 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671c3b19-318c-433a-a4c0-90c341074c2d None None] REQUEST_METHOD: `POST` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:55.422467 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671c3b19-318c-433a-a4c0-90c341074c2d None None] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:55.422750 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671c3b19-318c-433a-a4c0-90c341074c2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:55.449166 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 1095/2166] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Jul 14 10:53:55 2022] DELETE /identity/v3/users/839b96e5092f44aead36bc311afac2d2 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 10:53:55.463680 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f648294-43dd-421b-92eb-4fa933f8eb62 None None] REQUEST_METHOD: `POST` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:55.463985 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f648294-43dd-421b-92eb-4fa933f8eb62 None None] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:55.464379 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f648294-43dd-421b-92eb-4fa933f8eb62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:55.464952 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.auth.core [None req-671c3b19-318c-433a-a4c0-90c341074c2d None None] MFA Rules not processed for user `ae4bcdd8106d4bebbdcae96be33505bc`. Rule list: `[]` (Enabled: `True`). {{(pid=86656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:53:55.466108 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-671c3b19-318c-433a-a4c0-90c341074c2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:55.513961 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.auth.core [None req-8f648294-43dd-421b-92eb-4fa933f8eb62 None None] MFA Rules not processed for user `ae4bcdd8106d4bebbdcae96be33505bc`. Rule list: `[]` (Enabled: `True`). {{(pid=86655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:53:55.516265 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-8f648294-43dd-421b-92eb-4fa933f8eb62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:55.592819 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 1072/2167] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jul 14 10:53:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:53:55.600645 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d32e14-0f08-40c4-9bae-41f6fd130022 None None] REQUEST_METHOD: `POST` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:55.601167 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d32e14-0f08-40c4-9bae-41f6fd130022 None None] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:55.601802 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d32e14-0f08-40c4-9bae-41f6fd130022 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:55.642400 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.auth.core [None req-e9d32e14-0f08-40c4-9bae-41f6fd130022 None None] MFA Rules not processed for user `ae4bcdd8106d4bebbdcae96be33505bc`. Rule list: `[]` (Enabled: `True`). {{(pid=86656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:53:55.643979 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-e9d32e14-0f08-40c4-9bae-41f6fd130022 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:55.661706 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 1073/2168] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jul 14 10:53:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:53:55.663781 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d32e14-0f08-40c4-9bae-41f6fd130022 None None] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:55.687406 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d32e14-0f08-40c4-9bae-41f6fd130022 None None] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:55.690975 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b4ac8b-3df9-4f47-b35d-2eb4b1867937 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:55.692357 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b4ac8b-3df9-4f47-b35d-2eb4b1867937 admin admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:55.692522 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 1096/2169] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jul 14 10:53:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:53:55.692615 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b4ac8b-3df9-4f47-b35d-2eb4b1867937 admin admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:55.693081 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b4ac8b-3df9-4f47-b35d-2eb4b1867937 admin admin] PATH_INFO: `/v3/domains` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:55.694163 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b4ac8b-3df9-4f47-b35d-2eb4b1867937 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:53:55.694957 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b4ac8b-3df9-4f47-b35d-2eb4b1867937 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:55.697117 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b4ac8b-3df9-4f47-b35d-2eb4b1867937 admin admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:55.703747 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f648294-43dd-421b-92eb-4fa933f8eb62 None None] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:55.709000 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-8f648294-43dd-421b-92eb-4fa933f8eb62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:55.725878 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 1074/2170] 10.222.0.16 () {58 vars in 1152 bytes} [Thu Jul 14 10:53:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:53:55.728700 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b4ac8b-3df9-4f47-b35d-2eb4b1867937 admin admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:55.735266 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:53:55.745789 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b4ac8b-3df9-4f47-b35d-2eb4b1867937 admin admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:55.754295 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c347023-1788-4fc7-877e-12b4727c7159 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:55.754978 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c347023-1788-4fc7-877e-12b4727c7159 admin admin] REQUEST_METHOD: `POST` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:55.755599 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c347023-1788-4fc7-877e-12b4727c7159 admin admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:55.756207 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c347023-1788-4fc7-877e-12b4727c7159 admin admin] PATH_INFO: `/v3/projects` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:55.757490 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c347023-1788-4fc7-877e-12b4727c7159 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:55.759583 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c347023-1788-4fc7-877e-12b4727c7159 admin admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:55.766071 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:53:55.810544 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 1075/2171] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Jul 14 10:53:55 2022] POST /identity/v3/projects => generated 363 bytes in 84 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:53:55.816456 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c347023-1788-4fc7-877e-12b4727c7159 admin admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:55.853716 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f648294-43dd-421b-92eb-4fa933f8eb62 None None] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:55.937509 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4593a3-bfaa-4b59-b302-f5609466d22e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dddf93691844886982c91fea974385d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59391272ecbe48b0aa736cb43807be1d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:55.938180 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4593a3-bfaa-4b59-b302-f5609466d22e service neutron] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:55.938474 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4593a3-bfaa-4b59-b302-f5609466d22e service neutron] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:55.938761 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4593a3-bfaa-4b59-b302-f5609466d22e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:55.973821 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c347023-1788-4fc7-877e-12b4727c7159 admin admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:55.980171 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f939e42e-6c85-40ff-8af1-5acbd5d1ef0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:55.981200 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f939e42e-6c85-40ff-8af1-5acbd5d1ef0e admin admin] REQUEST_METHOD: `POST` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:55.982170 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f939e42e-6c85-40ff-8af1-5acbd5d1ef0e admin admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:55.982568 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f939e42e-6c85-40ff-8af1-5acbd5d1ef0e admin admin] PATH_INFO: `/v3/users` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:55.983730 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f939e42e-6c85-40ff-8af1-5acbd5d1ef0e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:55.986782 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f939e42e-6c85-40ff-8af1-5acbd5d1ef0e admin admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:56.017960 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 1076/2172] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Jul 14 10:53:55 2022] POST /identity/v3/users => generated 282 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 10:53:56.019277 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f939e42e-6c85-40ff-8af1-5acbd5d1ef0e admin admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:56.022115 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-f939e42e-6c85-40ff-8af1-5acbd5d1ef0e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:56.041156 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f939e42e-6c85-40ff-8af1-5acbd5d1ef0e admin admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:56.042180 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4593a3-bfaa-4b59-b302-f5609466d22e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:56.044647 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4593a3-bfaa-4b59-b302-f5609466d22e service neutron] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:56.049428 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07f4923-2297-4f6e-a3d5-2c908e8702d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:56.051472 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07f4923-2297-4f6e-a3d5-2c908e8702d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:56.051762 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07f4923-2297-4f6e-a3d5-2c908e8702d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:56.052047 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07f4923-2297-4f6e-a3d5-2c908e8702d8 admin admin] PATH_INFO: `/v3/users/2ece1b2f202044a2a8bd954ae5b556e2` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:56.054377 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07f4923-2297-4f6e-a3d5-2c908e8702d8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2ece1b2f202044a2a8bd954ae5b556e2)` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:56.056594 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07f4923-2297-4f6e-a3d5-2c908e8702d8 admin admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:56.064701 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 1097/2173] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jul 14 10:53:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 10:53:56.065855 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4593a3-bfaa-4b59-b302-f5609466d22e service neutron] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:56.078333 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4593a3-bfaa-4b59-b302-f5609466d22e service neutron] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:56.083335 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9470ce25-475d-4968-8bc3-30dbd8c7d387 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:56.084175 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9470ce25-475d-4968-8bc3-30dbd8c7d387 admin admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:56.084617 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9470ce25-475d-4968-8bc3-30dbd8c7d387 admin admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:56.085011 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9470ce25-475d-4968-8bc3-30dbd8c7d387 admin admin] PATH_INFO: `/v3/roles` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:56.085841 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9470ce25-475d-4968-8bc3-30dbd8c7d387 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:56.087627 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9470ce25-475d-4968-8bc3-30dbd8c7d387 admin admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:56.101667 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 1098/2174] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jul 14 10:53:56 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:53:56.105927 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9470ce25-475d-4968-8bc3-30dbd8c7d387 admin admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:56.135834 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-b07f4923-2297-4f6e-a3d5-2c908e8702d8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2ece1b2f202044a2a8bd954ae5b556e2'} {{(pid=86656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:56.148119 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9470ce25-475d-4968-8bc3-30dbd8c7d387 admin admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:56.151858 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-b07f4923-2297-4f6e-a3d5-2c908e8702d8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2ece1b2f202044a2a8bd954ae5b556e2'} {{(pid=86656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:56.153223 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-b07f4923-2297-4f6e-a3d5-2c908e8702d8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2ece1b2f202044a2a8bd954ae5b556e2'} {{(pid=86656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:56.162711 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9329f3f-534e-47ca-954b-2af08c56bfd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:56.163697 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9329f3f-534e-47ca-954b-2af08c56bfd7 admin admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:56.165060 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9329f3f-534e-47ca-954b-2af08c56bfd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:56.165488 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9329f3f-534e-47ca-954b-2af08c56bfd7 admin admin] PATH_INFO: `/v3/roles` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:56.166877 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9329f3f-534e-47ca-954b-2af08c56bfd7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:56.167240 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-b07f4923-2297-4f6e-a3d5-2c908e8702d8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2ece1b2f202044a2a8bd954ae5b556e2'} {{(pid=86656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:56.170665 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9329f3f-534e-47ca-954b-2af08c56bfd7 admin admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:56.170906 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-b07f4923-2297-4f6e-a3d5-2c908e8702d8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2ece1b2f202044a2a8bd954ae5b556e2'} {{(pid=86656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:56.213249 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 1099/2175] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jul 14 10:53:56 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 10:53:56.214206 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9329f3f-534e-47ca-954b-2af08c56bfd7 admin admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:56.216688 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-c9329f3f-534e-47ca-954b-2af08c56bfd7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:56.228524 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 1077/2176] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Jul 14 10:53:56 2022] DELETE /identity/v3/users/2ece1b2f202044a2a8bd954ae5b556e2 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:53:56.231092 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45aea89-df79-485a-a538-3d7023aa04d9 None None] REQUEST_METHOD: `POST` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:56.232048 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45aea89-df79-485a-a538-3d7023aa04d9 None None] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:56.233241 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45aea89-df79-485a-a538-3d7023aa04d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:56.235563 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9329f3f-534e-47ca-954b-2af08c56bfd7 admin admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:56.260355 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.auth.core [None req-d45aea89-df79-485a-a538-3d7023aa04d9 None None] MFA Rules not processed for user `ae4bcdd8106d4bebbdcae96be33505bc`. Rule list: `[]` (Enabled: `True`). {{(pid=86656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:53:56.262127 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-d45aea89-df79-485a-a538-3d7023aa04d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:56.334627 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=85,keystone:INSERT=5,keystone:DELETE=10 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:53:56.375368 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 1078/2177] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jul 14 10:53:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:53:56.377243 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45aea89-df79-485a-a538-3d7023aa04d9 None None] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:56.378872 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-d45aea89-df79-485a-a538-3d7023aa04d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:56.400980 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873f67c0-5a89-4c52-8474-a62988bb81a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:56.404207 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873f67c0-5a89-4c52-8474-a62988bb81a9 admin admin] REQUEST_METHOD: `PUT` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:56.406185 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873f67c0-5a89-4c52-8474-a62988bb81a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:56.406864 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873f67c0-5a89-4c52-8474-a62988bb81a9 admin admin] PATH_INFO: `/v3/projects/ac971faddc4b433db47f63d4d7542927/users/780b32b7f69941148bec5f6d7dd40f4f/roles/0da46c267d354cce81495dfdd56c1ec2` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:56.440063 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=100 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:53:56.445517 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873f67c0-5a89-4c52-8474-a62988bb81a9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ac971faddc4b433db47f63d4d7542927, user_id=780b32b7f69941148bec5f6d7dd40f4f, role_id=0da46c267d354cce81495dfdd56c1ec2)` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:56.452154 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873f67c0-5a89-4c52-8474-a62988bb81a9 admin admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:56.481976 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 1100/2178] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Jul 14 10:53:56 2022] PUT /identity/v3/projects/ac971faddc4b433db47f63d4d7542927/users/780b32b7f69941148bec5f6d7dd40f4f/roles/0da46c267d354cce81495dfdd56c1ec2 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:53:56.502672 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff8fad3-8b6c-4749-a545-dcc0923e2500 None None] REQUEST_METHOD: `POST` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:56.503073 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff8fad3-8b6c-4749-a545-dcc0923e2500 None None] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:56.503383 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff8fad3-8b6c-4749-a545-dcc0923e2500 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:56.511401 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45aea89-df79-485a-a538-3d7023aa04d9 None None] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:56.547619 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.auth.core [None req-aff8fad3-8b6c-4749-a545-dcc0923e2500 None None] MFA Rules not processed for user `780b32b7f69941148bec5f6d7dd40f4f`. Rule list: `[]` (Enabled: `True`). {{(pid=86655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:53:56.549939 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-aff8fad3-8b6c-4749-a545-dcc0923e2500 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:56.617731 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8daa2de-61e9-49af-9d97-51c7643584b8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dddf93691844886982c91fea974385d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59391272ecbe48b0aa736cb43807be1d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:56.618415 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8daa2de-61e9-49af-9d97-51c7643584b8 service neutron] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:56.618779 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8daa2de-61e9-49af-9d97-51c7643584b8 service neutron] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:56.618963 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8daa2de-61e9-49af-9d97-51c7643584b8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:56.723292 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 1101/2179] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jul 14 10:53:56 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:53:56.724036 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff8fad3-8b6c-4749-a545-dcc0923e2500 None None] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:56.725539 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-aff8fad3-8b6c-4749-a545-dcc0923e2500 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:56.727811 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8daa2de-61e9-49af-9d97-51c7643584b8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:56.730069 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8daa2de-61e9-49af-9d97-51c7643584b8 service neutron] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:56.742616 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff8fad3-8b6c-4749-a545-dcc0923e2500 None None] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:56.744612 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 1079/2180] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jul 14 10:53:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 10:53:56.745476 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8daa2de-61e9-49af-9d97-51c7643584b8 service neutron] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:56.755931 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8daa2de-61e9-49af-9d97-51c7643584b8 service neutron] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:56.762144 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b86e65d-cd67-4cce-aff5-1e9206a9e0d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:56.762917 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b86e65d-cd67-4cce-aff5-1e9206a9e0d4 admin admin] REQUEST_METHOD: `POST` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:56.763209 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b86e65d-cd67-4cce-aff5-1e9206a9e0d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:56.763621 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b86e65d-cd67-4cce-aff5-1e9206a9e0d4 admin admin] PATH_INFO: `/v3/projects` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:56.764339 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b86e65d-cd67-4cce-aff5-1e9206a9e0d4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:56.765560 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf140769-bd00-491f-b832-609d28ef20e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:56.766303 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b86e65d-cd67-4cce-aff5-1e9206a9e0d4 admin admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:56.766674 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf140769-bd00-491f-b832-609d28ef20e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:56.767137 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf140769-bd00-491f-b832-609d28ef20e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:56.767449 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf140769-bd00-491f-b832-609d28ef20e8 admin admin] PATH_INFO: `/v3/projects/b5c94fdc5bfb45c992ce010d70cce434` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:56.768846 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf140769-bd00-491f-b832-609d28ef20e8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b5c94fdc5bfb45c992ce010d70cce434)` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:56.773437 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf140769-bd00-491f-b832-609d28ef20e8 admin admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:56.803974 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 1080/2181] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Jul 14 10:53:56 2022] POST /identity/v3/projects => generated 365 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:53:56.809020 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b86e65d-cd67-4cce-aff5-1e9206a9e0d4 admin admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:56.885152 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-cf140769-bd00-491f-b832-609d28ef20e8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b5c94fdc5bfb45c992ce010d70cce434', 'request_id': 'req-cf140769-bd00-491f-b832-609d28ef20e8'} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:56.886993 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:53:56.900943 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-cf140769-bd00-491f-b832-609d28ef20e8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b5c94fdc5bfb45c992ce010d70cce434', 'request_id': 'req-cf140769-bd00-491f-b832-609d28ef20e8'} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:56.916499 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-cf140769-bd00-491f-b832-609d28ef20e8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b5c94fdc5bfb45c992ce010d70cce434', 'request_id': 'req-cf140769-bd00-491f-b832-609d28ef20e8'} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:56.939649 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-cf140769-bd00-491f-b832-609d28ef20e8 admin admin] The token cache is being invalidate because project b5c94fdc5bfb45c992ce010d70cce434 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86655) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 10:53:56.939958 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-cf140769-bd00-491f-b832-609d28ef20e8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:56.943033 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-cf140769-bd00-491f-b832-609d28ef20e8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:56.952080 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 1102/2182] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Jul 14 10:53:56 2022] DELETE /identity/v3/projects/b5c94fdc5bfb45c992ce010d70cce434 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:53:56.957822 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca20488-20a5-4c2e-9df5-cd698802e52f None None] REQUEST_METHOD: `POST` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:56.958444 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca20488-20a5-4c2e-9df5-cd698802e52f None None] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:56.958934 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca20488-20a5-4c2e-9df5-cd698802e52f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:56.989583 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b86e65d-cd67-4cce-aff5-1e9206a9e0d4 admin admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:56.999194 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.auth.core [None req-9ca20488-20a5-4c2e-9df5-cd698802e52f None None] MFA Rules not processed for user `ae4bcdd8106d4bebbdcae96be33505bc`. Rule list: `[]` (Enabled: `True`). {{(pid=86655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:53:57.000450 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-9ca20488-20a5-4c2e-9df5-cd698802e52f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:57.161225 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 1103/2183] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jul 14 10:53:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 10:53:57.161225 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70566359-bf80-49be-8a24-4361f13d4dbc None None] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:57.161225 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70566359-bf80-49be-8a24-4361f13d4dbc None None] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:57.161225 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70566359-bf80-49be-8a24-4361f13d4dbc None None] PATH_INFO: `/` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:57.161225 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 1104/2184] 10.222.0.16 () {54 vars in 921 bytes} [Thu Jul 14 10:53:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:53:57.163806 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fe41d2-1730-4ea8-9350-0b01be648828 None None] REQUEST_METHOD: `POST` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:57.164197 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fe41d2-1730-4ea8-9350-0b01be648828 None None] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:57.164581 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fe41d2-1730-4ea8-9350-0b01be648828 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:57.173146 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:53:57.174979 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca82622-0d6e-4d42-ba3a-208828937511 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:57.176424 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca82622-0d6e-4d42-ba3a-208828937511 admin admin] REQUEST_METHOD: `POST` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:57.176719 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca82622-0d6e-4d42-ba3a-208828937511 admin admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:57.177290 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca82622-0d6e-4d42-ba3a-208828937511 admin admin] PATH_INFO: `/v3/users` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:57.178018 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca82622-0d6e-4d42-ba3a-208828937511 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:57.181298 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca82622-0d6e-4d42-ba3a-208828937511 admin admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:57.190272 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.auth.core [None req-54fe41d2-1730-4ea8-9350-0b01be648828 None None] MFA Rules not processed for user `ae4bcdd8106d4bebbdcae96be33505bc`. Rule list: `[]` (Enabled: `True`). {{(pid=86655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:53:57.192902 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-54fe41d2-1730-4ea8-9350-0b01be648828 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:57.221868 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 1105/2185] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jul 14 10:53:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 10:53:57.223482 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5590250-e0d9-42ec-89a3-df4bd950a30e None None] REQUEST_METHOD: `POST` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:57.223683 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5590250-e0d9-42ec-89a3-df4bd950a30e None None] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:57.223976 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5590250-e0d9-42ec-89a3-df4bd950a30e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:57.247846 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 1081/2186] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Jul 14 10:53:56 2022] POST /identity/v3/users => generated 289 bytes in 440 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 10:53:57.253933 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca82622-0d6e-4d42-ba3a-208828937511 admin admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:57.266426 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca82622-0d6e-4d42-ba3a-208828937511 admin admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:57.270433 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.auth.core [None req-f5590250-e0d9-42ec-89a3-df4bd950a30e None None] MFA Rules not processed for user `16846111ee2a42dd99c3052d40980f72`. Rule list: `[]` (Enabled: `True`). {{(pid=86655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:53:57.271773 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-f5590250-e0d9-42ec-89a3-df4bd950a30e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:57.273111 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082f985a-9e6b-4df7-b700-b1d27ca0c974 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:57.274175 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082f985a-9e6b-4df7-b700-b1d27ca0c974 admin admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:57.274680 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082f985a-9e6b-4df7-b700-b1d27ca0c974 admin admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:57.275032 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082f985a-9e6b-4df7-b700-b1d27ca0c974 admin admin] PATH_INFO: `/v3/domains` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:57.275890 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082f985a-9e6b-4df7-b700-b1d27ca0c974 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:53:57.276280 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082f985a-9e6b-4df7-b700-b1d27ca0c974 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:57.279037 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082f985a-9e6b-4df7-b700-b1d27ca0c974 admin admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:57.298900 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 1082/2187] 10.222.0.16 () {58 vars in 1152 bytes} [Thu Jul 14 10:53:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:53:57.300024 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082f985a-9e6b-4df7-b700-b1d27ca0c974 admin admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:57.301950 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-082f985a-9e6b-4df7-b700-b1d27ca0c974 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:57.317129 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082f985a-9e6b-4df7-b700-b1d27ca0c974 admin admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:57.322768 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc167153-588e-4ff5-b79c-b252774d195e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:57.323524 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc167153-588e-4ff5-b79c-b252774d195e admin admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:57.323812 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc167153-588e-4ff5-b79c-b252774d195e admin admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:57.324095 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc167153-588e-4ff5-b79c-b252774d195e admin admin] PATH_INFO: `/v3/roles` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:57.324869 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc167153-588e-4ff5-b79c-b252774d195e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:57.327179 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc167153-588e-4ff5-b79c-b252774d195e admin admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:57.341858 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 1083/2188] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jul 14 10:53:57 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:53:57.342736 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc167153-588e-4ff5-b79c-b252774d195e admin admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:57.345226 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-fc167153-588e-4ff5-b79c-b252774d195e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:57.355052 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 1106/2189] 10.222.0.16 () {58 vars in 1018 bytes} [Thu Jul 14 10:53:57 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:53:57.355927 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5590250-e0d9-42ec-89a3-df4bd950a30e None None] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:57.357887 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-f5590250-e0d9-42ec-89a3-df4bd950a30e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:57.363540 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc167153-588e-4ff5-b79c-b252774d195e admin admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:57.368573 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e69a29-cac6-40fc-bcb6-80270f72e502 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:57.370180 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e69a29-cac6-40fc-bcb6-80270f72e502 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:57.370468 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e69a29-cac6-40fc-bcb6-80270f72e502 admin admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:57.370751 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e69a29-cac6-40fc-bcb6-80270f72e502 admin admin] PATH_INFO: `/v3/users/e3b4a13350ec406ab5ca248cf2c06ea4` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:57.372565 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e69a29-cac6-40fc-bcb6-80270f72e502 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e3b4a13350ec406ab5ca248cf2c06ea4)` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:57.375077 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e69a29-cac6-40fc-bcb6-80270f72e502 admin admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:57.388463 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5590250-e0d9-42ec-89a3-df4bd950a30e None None] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:57.397580 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4c7569-5f31-4323-a395-2d07f1da36cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:57.399665 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4c7569-5f31-4323-a395-2d07f1da36cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:57.401044 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4c7569-5f31-4323-a395-2d07f1da36cc admin admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:57.401926 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4c7569-5f31-4323-a395-2d07f1da36cc admin admin] PATH_INFO: `/v3/projects/e8e4b832024b4d57abd61499c89747c2` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:57.403598 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4c7569-5f31-4323-a395-2d07f1da36cc admin admin] RBAC: Authorizing `identity:delete_project(project_id=e8e4b832024b4d57abd61499c89747c2)` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:57.407532 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4c7569-5f31-4323-a395-2d07f1da36cc admin admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:57.446878 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-37e69a29-cac6-40fc-bcb6-80270f72e502 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e3b4a13350ec406ab5ca248cf2c06ea4'} {{(pid=86656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:57.458805 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-37e69a29-cac6-40fc-bcb6-80270f72e502 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e3b4a13350ec406ab5ca248cf2c06ea4'} {{(pid=86656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:57.459758 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-37e69a29-cac6-40fc-bcb6-80270f72e502 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e3b4a13350ec406ab5ca248cf2c06ea4'} {{(pid=86656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:57.470413 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-37e69a29-cac6-40fc-bcb6-80270f72e502 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e3b4a13350ec406ab5ca248cf2c06ea4'} {{(pid=86656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:57.471310 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-37e69a29-cac6-40fc-bcb6-80270f72e502 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e3b4a13350ec406ab5ca248cf2c06ea4'} {{(pid=86656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:57.498968 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 1084/2190] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Jul 14 10:53:57 2022] DELETE /identity/v3/users/e3b4a13350ec406ab5ca248cf2c06ea4 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:53:57.499203 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e69a29-cac6-40fc-bcb6-80270f72e502 admin admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:57.501615 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-37e69a29-cac6-40fc-bcb6-80270f72e502 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:57.519108 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:53:57.520721 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-fc4c7569-5f31-4323-a395-2d07f1da36cc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e8e4b832024b4d57abd61499c89747c2', 'request_id': 'req-fc4c7569-5f31-4323-a395-2d07f1da36cc'} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:57.530073 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-fc4c7569-5f31-4323-a395-2d07f1da36cc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e8e4b832024b4d57abd61499c89747c2', 'request_id': 'req-fc4c7569-5f31-4323-a395-2d07f1da36cc'} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:57.542412 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-fc4c7569-5f31-4323-a395-2d07f1da36cc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e8e4b832024b4d57abd61499c89747c2', 'request_id': 'req-fc4c7569-5f31-4323-a395-2d07f1da36cc'} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:57.561519 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-fc4c7569-5f31-4323-a395-2d07f1da36cc admin admin] The token cache is being invalidate because project e8e4b832024b4d57abd61499c89747c2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86655) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 10:53:57.561519 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-fc4c7569-5f31-4323-a395-2d07f1da36cc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:57.562722 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-fc4c7569-5f31-4323-a395-2d07f1da36cc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:57.565303 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 1107/2191] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Jul 14 10:53:57 2022] DELETE /identity/v3/projects/e8e4b832024b4d57abd61499c89747c2 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:53:57.566985 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4c7569-5f31-4323-a395-2d07f1da36cc admin admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:57.569370 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-fc4c7569-5f31-4323-a395-2d07f1da36cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:57.590333 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e69a29-cac6-40fc-bcb6-80270f72e502 admin admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:57.672947 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587d90ba-26df-4846-9aa5-629283ecc813 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:57.673553 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4c7569-5f31-4323-a395-2d07f1da36cc admin admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:57.673887 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587d90ba-26df-4846-9aa5-629283ecc813 admin admin] REQUEST_METHOD: `POST` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:57.674278 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587d90ba-26df-4846-9aa5-629283ecc813 admin admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:57.674659 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587d90ba-26df-4846-9aa5-629283ecc813 admin admin] PATH_INFO: `/v3/projects` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:57.675723 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587d90ba-26df-4846-9aa5-629283ecc813 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:57.686523 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587d90ba-26df-4846-9aa5-629283ecc813 admin admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:57.686719 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4caedc9e-2f75-4394-9a83-7ad071fbddce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:57.686719 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4caedc9e-2f75-4394-9a83-7ad071fbddce admin admin] REQUEST_METHOD: `PUT` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:57.686719 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4caedc9e-2f75-4394-9a83-7ad071fbddce admin admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:57.686719 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4caedc9e-2f75-4394-9a83-7ad071fbddce admin admin] PATH_INFO: `/v3/projects/6eeafb259478442f8bd07d43cf9851e0/users/a93024211e7c440fa21b7a42ec00c270/roles/153539819e5542df99269d2913bbecfb` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:57.699844 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4caedc9e-2f75-4394-9a83-7ad071fbddce admin admin] RBAC: Authorizing `identity:create_grant(project_id=6eeafb259478442f8bd07d43cf9851e0, user_id=a93024211e7c440fa21b7a42ec00c270, role_id=153539819e5542df99269d2913bbecfb)` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:57.703932 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4caedc9e-2f75-4394-9a83-7ad071fbddce admin admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:57.712906 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 1085/2192] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Jul 14 10:53:57 2022] POST /identity/v3/projects => generated 385 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:53:57.712906 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587d90ba-26df-4846-9aa5-629283ecc813 admin admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:57.712906 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-587d90ba-26df-4846-9aa5-629283ecc813 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:57.718133 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:53:57.723479 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 1108/2193] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Jul 14 10:53:57 2022] PUT /identity/v3/projects/6eeafb259478442f8bd07d43cf9851e0/users/a93024211e7c440fa21b7a42ec00c270/roles/153539819e5542df99269d2913bbecfb => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:53:57.724366 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4caedc9e-2f75-4394-9a83-7ad071fbddce admin admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:57.726942 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-4caedc9e-2f75-4394-9a83-7ad071fbddce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:57.807299 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587d90ba-26df-4846-9aa5-629283ecc813 admin admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:57.807559 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4caedc9e-2f75-4394-9a83-7ad071fbddce admin admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:57.812264 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862879b9-1e9d-4f01-97fe-4a9a9473cbc2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68382432147a48c3b62271fd2a2eab04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59391272ecbe48b0aa736cb43807be1d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:57.813008 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862879b9-1e9d-4f01-97fe-4a9a9473cbc2 service cinder] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:57.813304 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862879b9-1e9d-4f01-97fe-4a9a9473cbc2 service cinder] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:57.813592 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862879b9-1e9d-4f01-97fe-4a9a9473cbc2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:57.815522 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-862879b9-1e9d-4f01-97fe-4a9a9473cbc2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:57.860441 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:53:57.881464 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ddba4c7-678f-4bee-8c62-4d09088c22cf service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16846111ee2a42dd99c3052d40980f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59391272ecbe48b0aa736cb43807be1d', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:57.882317 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddba4c7-678f-4bee-8c62-4d09088c22cf service placement] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:57.882746 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddba4c7-678f-4bee-8c62-4d09088c22cf service placement] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:57.883127 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddba4c7-678f-4bee-8c62-4d09088c22cf service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:57.885175 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-6ddba4c7-678f-4bee-8c62-4d09088c22cf service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:57.889303 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862879b9-1e9d-4f01-97fe-4a9a9473cbc2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:57.890759 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862879b9-1e9d-4f01-97fe-4a9a9473cbc2 service cinder] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:57.898607 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ddba4c7-678f-4bee-8c62-4d09088c22cf service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:57.900442 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ddba4c7-678f-4bee-8c62-4d09088c22cf service placement] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:57.901713 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 1109/2194] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jul 14 10:53:57 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:53:57.911252 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862879b9-1e9d-4f01-97fe-4a9a9473cbc2 service cinder] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:57.914417 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 1086/2195] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jul 14 10:53:57 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:53:57.915331 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-862879b9-1e9d-4f01-97fe-4a9a9473cbc2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:57.925055 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ddba4c7-678f-4bee-8c62-4d09088c22cf service placement] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:57.929070 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-6ddba4c7-678f-4bee-8c62-4d09088c22cf service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:58.027303 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ddba4c7-678f-4bee-8c62-4d09088c22cf service placement] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:58.032548 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b611c57-212b-44ec-a2da-c4dbcaf96234 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:58.033275 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b611c57-212b-44ec-a2da-c4dbcaf96234 admin admin] REQUEST_METHOD: `POST` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:58.033737 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b611c57-212b-44ec-a2da-c4dbcaf96234 admin admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:58.034022 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b611c57-212b-44ec-a2da-c4dbcaf96234 admin admin] PATH_INFO: `/v3/users` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:58.034541 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862879b9-1e9d-4f01-97fe-4a9a9473cbc2 service cinder] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:58.035379 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b611c57-212b-44ec-a2da-c4dbcaf96234 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:58.037269 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b611c57-212b-44ec-a2da-c4dbcaf96234 admin admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:58.041814 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec6f42e-f5ce-4c14-927e-555af7f1087e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:58.043200 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec6f42e-f5ce-4c14-927e-555af7f1087e admin admin] REQUEST_METHOD: `DELETE` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:58.043608 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec6f42e-f5ce-4c14-927e-555af7f1087e admin admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:58.044067 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec6f42e-f5ce-4c14-927e-555af7f1087e admin admin] PATH_INFO: `/v3/users/9d2a80438eac45b19a5b5c21e1849aa0` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:58.045722 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec6f42e-f5ce-4c14-927e-555af7f1087e admin admin] RBAC: Authorizing `identity:delete_user(user_id=9d2a80438eac45b19a5b5c21e1849aa0)` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:58.047798 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec6f42e-f5ce-4c14-927e-555af7f1087e admin admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:58.060121 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 1087/2196] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Jul 14 10:53:57 2022] POST /identity/v3/users => generated 293 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:53:58.061694 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b611c57-212b-44ec-a2da-c4dbcaf96234 admin admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:58.076073 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b611c57-212b-44ec-a2da-c4dbcaf96234 admin admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:58.081919 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123f0d4a-e0f8-4df3-9726-d21df0b2e861 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:58.082799 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123f0d4a-e0f8-4df3-9726-d21df0b2e861 admin admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:58.083082 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123f0d4a-e0f8-4df3-9726-d21df0b2e861 admin admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:58.083367 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123f0d4a-e0f8-4df3-9726-d21df0b2e861 admin admin] PATH_INFO: `/v3/roles` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:58.084115 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123f0d4a-e0f8-4df3-9726-d21df0b2e861 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:58.085791 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123f0d4a-e0f8-4df3-9726-d21df0b2e861 admin admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:58.098284 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 1088/2197] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jul 14 10:53:58 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:53:58.098969 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123f0d4a-e0f8-4df3-9726-d21df0b2e861 admin admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:58.102901 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-123f0d4a-e0f8-4df3-9726-d21df0b2e861 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:58.107002 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-eec6f42e-f5ce-4c14-927e-555af7f1087e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9d2a80438eac45b19a5b5c21e1849aa0'} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:58.112091 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:53:58.115722 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-eec6f42e-f5ce-4c14-927e-555af7f1087e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9d2a80438eac45b19a5b5c21e1849aa0'} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:58.116689 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-eec6f42e-f5ce-4c14-927e-555af7f1087e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9d2a80438eac45b19a5b5c21e1849aa0'} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:58.120017 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123f0d4a-e0f8-4df3-9726-d21df0b2e861 admin admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:58.126180 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abf71e3-c479-4f12-94bf-b69b89737a61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:58.127127 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abf71e3-c479-4f12-94bf-b69b89737a61 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:58.127279 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-eec6f42e-f5ce-4c14-927e-555af7f1087e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9d2a80438eac45b19a5b5c21e1849aa0'} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:58.127447 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abf71e3-c479-4f12-94bf-b69b89737a61 admin admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:58.127757 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abf71e3-c479-4f12-94bf-b69b89737a61 admin admin] PATH_INFO: `/v3/projects/33dbae05ece84d4dbaec126f580a49c1` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:58.128077 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-eec6f42e-f5ce-4c14-927e-555af7f1087e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9d2a80438eac45b19a5b5c21e1849aa0'} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:58.129003 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1abf71e3-c479-4f12-94bf-b69b89737a61 admin admin] RBAC: Authorizing `identity:delete_project(project_id=33dbae05ece84d4dbaec126f580a49c1)` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:58.130966 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1abf71e3-c479-4f12-94bf-b69b89737a61 admin admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:58.148322 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 1110/2198] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Jul 14 10:53:57 2022] DELETE /identity/v3/users/9d2a80438eac45b19a5b5c21e1849aa0 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:53:58.149243 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec6f42e-f5ce-4c14-927e-555af7f1087e admin admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:58.150664 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-eec6f42e-f5ce-4c14-927e-555af7f1087e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:58.195351 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-1abf71e3-c479-4f12-94bf-b69b89737a61 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '33dbae05ece84d4dbaec126f580a49c1', 'request_id': 'req-1abf71e3-c479-4f12-94bf-b69b89737a61'} {{(pid=86656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:58.205209 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-1abf71e3-c479-4f12-94bf-b69b89737a61 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '33dbae05ece84d4dbaec126f580a49c1', 'request_id': 'req-1abf71e3-c479-4f12-94bf-b69b89737a61'} {{(pid=86656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:58.215840 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-1abf71e3-c479-4f12-94bf-b69b89737a61 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '33dbae05ece84d4dbaec126f580a49c1', 'request_id': 'req-1abf71e3-c479-4f12-94bf-b69b89737a61'} {{(pid=86656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:58.247471 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-1abf71e3-c479-4f12-94bf-b69b89737a61 admin admin] The token cache is being invalidate because project 33dbae05ece84d4dbaec126f580a49c1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86656) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 10:53:58.247471 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-1abf71e3-c479-4f12-94bf-b69b89737a61 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:58.249684 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-1abf71e3-c479-4f12-94bf-b69b89737a61 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:58.252320 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 1089/2199] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Jul 14 10:53:58 2022] DELETE /identity/v3/projects/33dbae05ece84d4dbaec126f580a49c1 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:53:58.253597 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abf71e3-c479-4f12-94bf-b69b89737a61 admin admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:58.255804 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-1abf71e3-c479-4f12-94bf-b69b89737a61 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:58.257807 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec6f42e-f5ce-4c14-927e-555af7f1087e admin admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:58.353629 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:53:58.384254 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abf71e3-c479-4f12-94bf-b69b89737a61 admin admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:58.390567 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b4f7c8-c41d-4754-a7b4-f1099ca16fb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:58.391701 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b4f7c8-c41d-4754-a7b4-f1099ca16fb6 admin admin] REQUEST_METHOD: `PUT` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:58.391990 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b4f7c8-c41d-4754-a7b4-f1099ca16fb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:58.392268 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b4f7c8-c41d-4754-a7b4-f1099ca16fb6 admin admin] PATH_INFO: `/v3/projects/6eeafb259478442f8bd07d43cf9851e0/users/a93024211e7c440fa21b7a42ec00c270/roles/153539819e5542df99269d2913bbecfb` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:58.394353 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b4f7c8-c41d-4754-a7b4-f1099ca16fb6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6eeafb259478442f8bd07d43cf9851e0, user_id=a93024211e7c440fa21b7a42ec00c270, role_id=153539819e5542df99269d2913bbecfb)` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:58.397063 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b4f7c8-c41d-4754-a7b4-f1099ca16fb6 admin admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:58.409192 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 1090/2200] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Jul 14 10:53:58 2022] PUT /identity/v3/projects/6eeafb259478442f8bd07d43cf9851e0/users/a93024211e7c440fa21b7a42ec00c270/roles/153539819e5542df99269d2913bbecfb => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:53:58.410625 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1089bf1a-ba51-412a-9b92-54965601500f None None] REQUEST_METHOD: `POST` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:58.410925 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1089bf1a-ba51-412a-9b92-54965601500f None None] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:58.411256 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1089bf1a-ba51-412a-9b92-54965601500f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:58.432798 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.auth.core [None req-1089bf1a-ba51-412a-9b92-54965601500f None None] MFA Rules not processed for user `ae4bcdd8106d4bebbdcae96be33505bc`. Rule list: `[]` (Enabled: `True`). {{(pid=86656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:53:58.434144 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-1089bf1a-ba51-412a-9b92-54965601500f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:58.435242 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4d41d1-981a-446a-a1ee-db92433dc5c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:58.436030 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4d41d1-981a-446a-a1ee-db92433dc5c9 admin admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:58.436397 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4d41d1-981a-446a-a1ee-db92433dc5c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:58.436756 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4d41d1-981a-446a-a1ee-db92433dc5c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:58.437830 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4d41d1-981a-446a-a1ee-db92433dc5c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:58.441181 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4d41d1-981a-446a-a1ee-db92433dc5c9 admin admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:58.457764 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 1111/2201] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jul 14 10:53:58 2022] GET /identity/v3/roles => generated 1420 bytes in 309 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:53:58.464923 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740da4d7-9784-4ee9-8392-6e38da4c5d39 None None] REQUEST_METHOD: `POST` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:58.464923 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740da4d7-9784-4ee9-8392-6e38da4c5d39 None None] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:58.464923 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740da4d7-9784-4ee9-8392-6e38da4c5d39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:58.503782 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.auth.core [None req-740da4d7-9784-4ee9-8392-6e38da4c5d39 None None] MFA Rules not processed for user `a93024211e7c440fa21b7a42ec00c270`. Rule list: `[]` (Enabled: `True`). {{(pid=86655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:53:58.505209 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-740da4d7-9784-4ee9-8392-6e38da4c5d39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:58.521151 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 1091/2202] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jul 14 10:53:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:53:58.523349 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1089bf1a-ba51-412a-9b92-54965601500f None None] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:58.525372 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-1089bf1a-ba51-412a-9b92-54965601500f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:58.544397 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1089bf1a-ba51-412a-9b92-54965601500f None None] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:58.574597 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c48fbe-2076-4f75-a76c-6d0648ad5166 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:58.578576 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c48fbe-2076-4f75-a76c-6d0648ad5166 admin admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:58.578576 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c48fbe-2076-4f75-a76c-6d0648ad5166 admin admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:58.578576 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c48fbe-2076-4f75-a76c-6d0648ad5166 admin admin] PATH_INFO: `/v3/roles` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:58.578576 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c48fbe-2076-4f75-a76c-6d0648ad5166 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:58.580338 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c48fbe-2076-4f75-a76c-6d0648ad5166 admin admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:58.608961 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 1092/2203] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jul 14 10:53:58 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:53:58.610187 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f3e5e1-549e-4726-8e5e-5966d83268c3 None None] REQUEST_METHOD: `POST` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:58.610482 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f3e5e1-549e-4726-8e5e-5966d83268c3 None None] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:58.610765 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f3e5e1-549e-4726-8e5e-5966d83268c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:58.646126 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.auth.core [None req-13f3e5e1-549e-4726-8e5e-5966d83268c3 None None] MFA Rules not processed for user `ae4bcdd8106d4bebbdcae96be33505bc`. Rule list: `[]` (Enabled: `True`). {{(pid=86656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:53:58.648461 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:53:58.649050 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-13f3e5e1-549e-4726-8e5e-5966d83268c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:58.657093 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 1112/2204] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jul 14 10:53:58 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:53:58.658826 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740da4d7-9784-4ee9-8392-6e38da4c5d39 None None] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:58.659181 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 1093/2205] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jul 14 10:53:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:53:58.660793 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f3e5e1-549e-4726-8e5e-5966d83268c3 None None] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:58.662040 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-740da4d7-9784-4ee9-8392-6e38da4c5d39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:58.673350 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f3e5e1-549e-4726-8e5e-5966d83268c3 None None] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:58.679807 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba94563c-32e1-48f7-b1ef-2d8b4ac120a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:58.681198 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba94563c-32e1-48f7-b1ef-2d8b4ac120a6 admin admin] REQUEST_METHOD: `PUT` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:58.682300 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba94563c-32e1-48f7-b1ef-2d8b4ac120a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:58.682497 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba94563c-32e1-48f7-b1ef-2d8b4ac120a6 admin admin] PATH_INFO: `/v3/projects/45519db65a3f45b780927af7aa18cc1d/users/0bea076eadcf4b9585ca56a3d0f7834d/roles/0da46c267d354cce81495dfdd56c1ec2` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:58.687787 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740da4d7-9784-4ee9-8392-6e38da4c5d39 None None] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:58.694960 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd6bc66-6c13-4f22-ba0b-b88caa310939 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:58.696550 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd6bc66-6c13-4f22-ba0b-b88caa310939 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:58.697105 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd6bc66-6c13-4f22-ba0b-b88caa310939 admin admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:58.697525 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd6bc66-6c13-4f22-ba0b-b88caa310939 admin admin] PATH_INFO: `/v3/projects/866019d7aa374011b8479ae9be4595e2` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:58.700512 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd6bc66-6c13-4f22-ba0b-b88caa310939 admin admin] RBAC: Authorizing `identity:delete_project(project_id=866019d7aa374011b8479ae9be4595e2)` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:58.703266 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd6bc66-6c13-4f22-ba0b-b88caa310939 admin admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:58.720923 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba94563c-32e1-48f7-b1ef-2d8b4ac120a6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=45519db65a3f45b780927af7aa18cc1d, user_id=0bea076eadcf4b9585ca56a3d0f7834d, role_id=0da46c267d354cce81495dfdd56c1ec2)` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:58.723710 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba94563c-32e1-48f7-b1ef-2d8b4ac120a6 admin admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:58.743602 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 1094/2206] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Jul 14 10:53:58 2022] PUT /identity/v3/projects/45519db65a3f45b780927af7aa18cc1d/users/0bea076eadcf4b9585ca56a3d0f7834d/roles/0da46c267d354cce81495dfdd56c1ec2 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:53:58.744513 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba94563c-32e1-48f7-b1ef-2d8b4ac120a6 admin admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:58.802657 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-efd6bc66-6c13-4f22-ba0b-b88caa310939 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '866019d7aa374011b8479ae9be4595e2', 'request_id': 'req-efd6bc66-6c13-4f22-ba0b-b88caa310939'} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:58.819120 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-efd6bc66-6c13-4f22-ba0b-b88caa310939 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '866019d7aa374011b8479ae9be4595e2', 'request_id': 'req-efd6bc66-6c13-4f22-ba0b-b88caa310939'} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:58.833860 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-efd6bc66-6c13-4f22-ba0b-b88caa310939 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '866019d7aa374011b8479ae9be4595e2', 'request_id': 'req-efd6bc66-6c13-4f22-ba0b-b88caa310939'} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:58.855305 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-efd6bc66-6c13-4f22-ba0b-b88caa310939 admin admin] The token cache is being invalidate because project 866019d7aa374011b8479ae9be4595e2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86655) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 10:53:58.855673 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-efd6bc66-6c13-4f22-ba0b-b88caa310939 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:58.856647 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-efd6bc66-6c13-4f22-ba0b-b88caa310939 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:53:58.860167 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 1113/2207] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Jul 14 10:53:58 2022] DELETE /identity/v3/projects/866019d7aa374011b8479ae9be4595e2 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:53:58.861036 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd6bc66-6c13-4f22-ba0b-b88caa310939 admin admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:58.862490 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-efd6bc66-6c13-4f22-ba0b-b88caa310939 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:58.909177 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba94563c-32e1-48f7-b1ef-2d8b4ac120a6 admin admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:58.943922 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd6bc66-6c13-4f22-ba0b-b88caa310939 admin admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:58.953705 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05580030-d459-4fea-8abd-f6abccaab536 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68382432147a48c3b62271fd2a2eab04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59391272ecbe48b0aa736cb43807be1d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:58.954930 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05580030-d459-4fea-8abd-f6abccaab536 service cinder] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:58.954930 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05580030-d459-4fea-8abd-f6abccaab536 service cinder] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:58.955130 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05580030-d459-4fea-8abd-f6abccaab536 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:58.958018 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-05580030-d459-4fea-8abd-f6abccaab536 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:59.015662 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:53:59.056107 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05580030-d459-4fea-8abd-f6abccaab536 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:59.057282 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39df9d44-8f24-4465-a5f1-88c16d827ae9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:59.057943 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05580030-d459-4fea-8abd-f6abccaab536 service cinder] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:59.058749 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39df9d44-8f24-4465-a5f1-88c16d827ae9 admin admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:59.059344 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39df9d44-8f24-4465-a5f1-88c16d827ae9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:59.060088 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39df9d44-8f24-4465-a5f1-88c16d827ae9 admin admin] PATH_INFO: `/v3/domains` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:59.061230 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39df9d44-8f24-4465-a5f1-88c16d827ae9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:53:59.062585 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39df9d44-8f24-4465-a5f1-88c16d827ae9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:59.065232 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39df9d44-8f24-4465-a5f1-88c16d827ae9 admin admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:59.069363 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 1114/2208] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jul 14 10:53:58 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:53:59.070821 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09b090b-3e5e-4c31-8ad0-c4f2e3f3888d None None] REQUEST_METHOD: `POST` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:59.071119 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09b090b-3e5e-4c31-8ad0-c4f2e3f3888d None None] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:59.071405 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09b090b-3e5e-4c31-8ad0-c4f2e3f3888d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:59.086778 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 1095/2209] 10.222.0.16 () {58 vars in 1152 bytes} [Thu Jul 14 10:53:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 343 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:53:59.089383 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1354d713-fcd0-4dd0-9ed6-c707adb7df11 None None] REQUEST_METHOD: `POST` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:59.089711 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1354d713-fcd0-4dd0-9ed6-c707adb7df11 None None] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:59.090150 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1354d713-fcd0-4dd0-9ed6-c707adb7df11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:59.109105 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.auth.core [None req-b09b090b-3e5e-4c31-8ad0-c4f2e3f3888d None None] MFA Rules not processed for user `0bea076eadcf4b9585ca56a3d0f7834d`. Rule list: `[]` (Enabled: `True`). {{(pid=86655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:53:59.110675 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-b09b090b-3e5e-4c31-8ad0-c4f2e3f3888d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:59.115103 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.auth.core [None req-1354d713-fcd0-4dd0-9ed6-c707adb7df11 None None] MFA Rules not processed for user `ae4bcdd8106d4bebbdcae96be33505bc`. Rule list: `[]` (Enabled: `True`). {{(pid=86656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:53:59.116925 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-1354d713-fcd0-4dd0-9ed6-c707adb7df11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:59.128543 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 1096/2210] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jul 14 10:53:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:53:59.135682 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:53:59.136531 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1354d713-fcd0-4dd0-9ed6-c707adb7df11 None None] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:59.141229 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-1354d713-fcd0-4dd0-9ed6-c707adb7df11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:59.161386 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1354d713-fcd0-4dd0-9ed6-c707adb7df11 None None] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:59.169650 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32062701-02ec-4f59-93da-3d121ce3a0f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:59.170660 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32062701-02ec-4f59-93da-3d121ce3a0f9 admin admin] REQUEST_METHOD: `POST` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:59.170954 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32062701-02ec-4f59-93da-3d121ce3a0f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:59.171240 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32062701-02ec-4f59-93da-3d121ce3a0f9 admin admin] PATH_INFO: `/v3/projects` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:59.172383 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32062701-02ec-4f59-93da-3d121ce3a0f9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:59.174796 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32062701-02ec-4f59-93da-3d121ce3a0f9 admin admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:59.208602 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 1097/2211] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Jul 14 10:53:59 2022] POST /identity/v3/projects => generated 387 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:53:59.208602 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394bf204-3b6e-45ab-913c-45b083a3f011 None None] REQUEST_METHOD: `POST` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:59.208602 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394bf204-3b6e-45ab-913c-45b083a3f011 None None] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:59.208602 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394bf204-3b6e-45ab-913c-45b083a3f011 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:59.211459 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 1115/2212] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jul 14 10:53:59 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:53:59.212359 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09b090b-3e5e-4c31-8ad0-c4f2e3f3888d None None] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:59.223875 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09b090b-3e5e-4c31-8ad0-c4f2e3f3888d None None] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:59.228966 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.auth.core [None req-394bf204-3b6e-45ab-913c-45b083a3f011 None None] MFA Rules not processed for user `ae4bcdd8106d4bebbdcae96be33505bc`. Rule list: `[]` (Enabled: `True`). {{(pid=86656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:53:59.230241 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-394bf204-3b6e-45ab-913c-45b083a3f011 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:59.273418 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b0ca73-aaf9-40b3-817b-81bcc5cd7fe9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68382432147a48c3b62271fd2a2eab04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59391272ecbe48b0aa736cb43807be1d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:59.274082 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b0ca73-aaf9-40b3-817b-81bcc5cd7fe9 service cinder] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:59.274370 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b0ca73-aaf9-40b3-817b-81bcc5cd7fe9 service cinder] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:59.274654 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b0ca73-aaf9-40b3-817b-81bcc5cd7fe9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:59.276504 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-44b0ca73-aaf9-40b3-817b-81bcc5cd7fe9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:59.297287 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 1098/2213] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jul 14 10:53:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:53:59.300582 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394bf204-3b6e-45ab-913c-45b083a3f011 None None] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:59.308462 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394bf204-3b6e-45ab-913c-45b083a3f011 None None] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:59.313531 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a88ae78-f01b-4856-ad99-f1f875b4a533 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:59.314196 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a88ae78-f01b-4856-ad99-f1f875b4a533 admin admin] REQUEST_METHOD: `POST` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:59.314486 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a88ae78-f01b-4856-ad99-f1f875b4a533 admin admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:59.314766 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a88ae78-f01b-4856-ad99-f1f875b4a533 admin admin] PATH_INFO: `/v3/users` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:59.315715 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a88ae78-f01b-4856-ad99-f1f875b4a533 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:59.317948 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a88ae78-f01b-4856-ad99-f1f875b4a533 admin admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:59.336405 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b0ca73-aaf9-40b3-817b-81bcc5cd7fe9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:59.337888 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b0ca73-aaf9-40b3-817b-81bcc5cd7fe9 service cinder] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:59.342503 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 1099/2214] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Jul 14 10:53:59 2022] POST /identity/v3/users => generated 294 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:53:59.343476 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a88ae78-f01b-4856-ad99-f1f875b4a533 admin admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:59.345125 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-0a88ae78-f01b-4856-ad99-f1f875b4a533 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:59.351082 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 1116/2215] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jul 14 10:53:59 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:53:59.352147 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b0ca73-aaf9-40b3-817b-81bcc5cd7fe9 service cinder] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:59.356962 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a88ae78-f01b-4856-ad99-f1f875b4a533 admin admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:59.360851 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff55d37-4e6f-4964-ad2f-5f3b0e4fec56 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68382432147a48c3b62271fd2a2eab04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59391272ecbe48b0aa736cb43807be1d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:59.361498 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff55d37-4e6f-4964-ad2f-5f3b0e4fec56 service cinder] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:59.362474 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff55d37-4e6f-4964-ad2f-5f3b0e4fec56 service cinder] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:59.362768 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff55d37-4e6f-4964-ad2f-5f3b0e4fec56 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:59.364647 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b0ca73-aaf9-40b3-817b-81bcc5cd7fe9 service cinder] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:59.370034 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e226c39c-4630-48cb-89b7-67cd4f31faa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:59.370754 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e226c39c-4630-48cb-89b7-67cd4f31faa8 admin admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:59.371152 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e226c39c-4630-48cb-89b7-67cd4f31faa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:59.371578 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e226c39c-4630-48cb-89b7-67cd4f31faa8 admin admin] PATH_INFO: `/v3/domains` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:59.373107 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e226c39c-4630-48cb-89b7-67cd4f31faa8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:53:59.373524 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e226c39c-4630-48cb-89b7-67cd4f31faa8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:59.376278 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e226c39c-4630-48cb-89b7-67cd4f31faa8 admin admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:59.392480 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 1117/2216] 10.222.0.16 () {58 vars in 1152 bytes} [Thu Jul 14 10:53:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:53:59.393487 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e226c39c-4630-48cb-89b7-67cd4f31faa8 admin admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:59.404583 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e226c39c-4630-48cb-89b7-67cd4f31faa8 admin admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:59.410275 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2c0418-3b3a-4253-88c1-79047929a941 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:59.411192 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2c0418-3b3a-4253-88c1-79047929a941 admin admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:59.411688 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2c0418-3b3a-4253-88c1-79047929a941 admin admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:59.412176 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2c0418-3b3a-4253-88c1-79047929a941 admin admin] PATH_INFO: `/v3/roles` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:59.412916 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2c0418-3b3a-4253-88c1-79047929a941 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:59.414856 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2c0418-3b3a-4253-88c1-79047929a941 admin admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:59.429465 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 1118/2217] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jul 14 10:53:59 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:53:59.430895 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2c0418-3b3a-4253-88c1-79047929a941 admin admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:59.431211 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff55d37-4e6f-4964-ad2f-5f3b0e4fec56 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:59.433271 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff55d37-4e6f-4964-ad2f-5f3b0e4fec56 service cinder] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:59.442457 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2c0418-3b3a-4253-88c1-79047929a941 admin admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:59.444149 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 1100/2218] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jul 14 10:53:59 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:53:59.445328 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff55d37-4e6f-4964-ad2f-5f3b0e4fec56 service cinder] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:59.448877 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09c0a5f-0989-4ae7-b195-a5ffb3dc3a8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:59.449672 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09c0a5f-0989-4ae7-b195-a5ffb3dc3a8a admin admin] REQUEST_METHOD: `POST` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:59.450641 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09c0a5f-0989-4ae7-b195-a5ffb3dc3a8a admin admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:59.451206 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09c0a5f-0989-4ae7-b195-a5ffb3dc3a8a admin admin] PATH_INFO: `/v3/projects` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:59.452001 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09c0a5f-0989-4ae7-b195-a5ffb3dc3a8a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:59.454197 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09c0a5f-0989-4ae7-b195-a5ffb3dc3a8a admin admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:59.457813 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff55d37-4e6f-4964-ad2f-5f3b0e4fec56 service cinder] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:59.469332 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47965ed2-e680-4da8-ace3-3cdd6746ecd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:59.470039 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47965ed2-e680-4da8-ace3-3cdd6746ecd0 admin admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:59.470330 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47965ed2-e680-4da8-ace3-3cdd6746ecd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:59.470613 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47965ed2-e680-4da8-ace3-3cdd6746ecd0 admin admin] PATH_INFO: `/v3/roles` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:59.471524 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47965ed2-e680-4da8-ace3-3cdd6746ecd0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:59.479391 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47965ed2-e680-4da8-ace3-3cdd6746ecd0 admin admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:59.495292 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 1119/2219] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Jul 14 10:53:59 2022] POST /identity/v3/projects => generated 375 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:53:59.496206 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09c0a5f-0989-4ae7-b195-a5ffb3dc3a8a admin admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:59.501752 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 1101/2220] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jul 14 10:53:59 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:53:59.507732 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47965ed2-e680-4da8-ace3-3cdd6746ecd0 admin admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:59.532805 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47965ed2-e680-4da8-ace3-3cdd6746ecd0 admin admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:59.533548 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:53:59.547670 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:53:59.577022 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09c0a5f-0989-4ae7-b195-a5ffb3dc3a8a admin admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:59.584471 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e9af8e-ef20-4581-aaff-dde3d739be99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:59.585205 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e9af8e-ef20-4581-aaff-dde3d739be99 admin admin] REQUEST_METHOD: `POST` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:59.585494 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e9af8e-ef20-4581-aaff-dde3d739be99 admin admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:59.585784 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e9af8e-ef20-4581-aaff-dde3d739be99 admin admin] PATH_INFO: `/v3/users` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:59.586494 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e9af8e-ef20-4581-aaff-dde3d739be99 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:59.588610 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e9af8e-ef20-4581-aaff-dde3d739be99 admin admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:59.613039 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 1120/2221] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Jul 14 10:53:59 2022] POST /identity/v3/users => generated 288 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:53:59.617319 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e9af8e-ef20-4581-aaff-dde3d739be99 admin admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:59.617535 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca2866f-8b80-47d6-9a6f-579a6064b3ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:59.618690 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca2866f-8b80-47d6-9a6f-579a6064b3ae admin admin] REQUEST_METHOD: `PUT` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:59.619002 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca2866f-8b80-47d6-9a6f-579a6064b3ae admin admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:59.619290 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca2866f-8b80-47d6-9a6f-579a6064b3ae admin admin] PATH_INFO: `/v3/projects/dc39ecdf094e417b8356ab40e9e7316d/users/9bf1e116dda742559eed6d9c25f1ff47/roles/0da46c267d354cce81495dfdd56c1ec2` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:59.630359 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e9af8e-ef20-4581-aaff-dde3d739be99 admin admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:59.638994 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca2866f-8b80-47d6-9a6f-579a6064b3ae admin admin] RBAC: Authorizing `identity:create_grant(project_id=dc39ecdf094e417b8356ab40e9e7316d, user_id=9bf1e116dda742559eed6d9c25f1ff47, role_id=0da46c267d354cce81495dfdd56c1ec2)` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:59.640342 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf03017-8e71-4f6a-98c0-89b773e370be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:59.641364 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf03017-8e71-4f6a-98c0-89b773e370be admin admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:59.641874 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf03017-8e71-4f6a-98c0-89b773e370be admin admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:59.642514 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf03017-8e71-4f6a-98c0-89b773e370be admin admin] PATH_INFO: `/v3/roles` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:59.642630 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca2866f-8b80-47d6-9a6f-579a6064b3ae admin admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:59.643531 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf03017-8e71-4f6a-98c0-89b773e370be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:59.645032 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf03017-8e71-4f6a-98c0-89b773e370be admin admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:59.657905 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 1121/2222] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jul 14 10:53:59 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 10:53:59.662148 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf03017-8e71-4f6a-98c0-89b773e370be admin admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:59.663556 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 1102/2223] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Jul 14 10:53:59 2022] PUT /identity/v3/projects/dc39ecdf094e417b8356ab40e9e7316d/users/9bf1e116dda742559eed6d9c25f1ff47/roles/0da46c267d354cce81495dfdd56c1ec2 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:53:59.669442 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d62f4a-7963-40e8-9c23-2cbc976bb254 None None] REQUEST_METHOD: `POST` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:59.669868 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d62f4a-7963-40e8-9c23-2cbc976bb254 None None] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:59.670168 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d62f4a-7963-40e8-9c23-2cbc976bb254 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:59.675814 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf03017-8e71-4f6a-98c0-89b773e370be admin admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:59.694569 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.auth.core [None req-33d62f4a-7963-40e8-9c23-2cbc976bb254 None None] MFA Rules not processed for user `ae4bcdd8106d4bebbdcae96be33505bc`. Rule list: `[]` (Enabled: `True`). {{(pid=86656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:53:59.695881 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-33d62f4a-7963-40e8-9c23-2cbc976bb254 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:59.755281 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c09a9fb-49b1-48b3-bfb4-da8d025f61ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:59.756297 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c09a9fb-49b1-48b3-bfb4-da8d025f61ad admin admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:59.756701 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c09a9fb-49b1-48b3-bfb4-da8d025f61ad admin admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:59.757144 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c09a9fb-49b1-48b3-bfb4-da8d025f61ad admin admin] PATH_INFO: `/v3/roles` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:59.758329 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c09a9fb-49b1-48b3-bfb4-da8d025f61ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:59.760366 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c09a9fb-49b1-48b3-bfb4-da8d025f61ad admin admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:59.770124 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 1103/2224] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jul 14 10:53:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:53:59.784182 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d62f4a-7963-40e8-9c23-2cbc976bb254 None None] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:59.787197 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 1122/2225] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jul 14 10:53:59 2022] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:53:59.787965 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-33d62f4a-7963-40e8-9c23-2cbc976bb254 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:59.788729 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c09a9fb-49b1-48b3-bfb4-da8d025f61ad admin admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:53:59.807091 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c09a9fb-49b1-48b3-bfb4-da8d025f61ad admin admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:59.816598 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c519f422-4a2c-4306-b50e-14027bf2c42f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:59.817987 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c519f422-4a2c-4306-b50e-14027bf2c42f admin admin] REQUEST_METHOD: `PUT` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:59.818822 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c519f422-4a2c-4306-b50e-14027bf2c42f admin admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:59.819529 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c519f422-4a2c-4306-b50e-14027bf2c42f admin admin] PATH_INFO: `/v3/projects/233573f2e7f04bfab9041b97605e5ba3/users/dce2641582d4434c9657d4335d70f964/roles/0da46c267d354cce81495dfdd56c1ec2` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:59.844545 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c519f422-4a2c-4306-b50e-14027bf2c42f admin admin] RBAC: Authorizing `identity:create_grant(project_id=233573f2e7f04bfab9041b97605e5ba3, user_id=dce2641582d4434c9657d4335d70f964, role_id=0da46c267d354cce81495dfdd56c1ec2)` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:53:59.849404 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c519f422-4a2c-4306-b50e-14027bf2c42f admin admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:53:59.878062 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 1123/2226] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Jul 14 10:53:59 2022] PUT /identity/v3/projects/233573f2e7f04bfab9041b97605e5ba3/users/dce2641582d4434c9657d4335d70f964/roles/0da46c267d354cce81495dfdd56c1ec2 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:53:59.889240 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0065e4-ecb0-49fa-8330-a070b2802f70 None None] REQUEST_METHOD: `POST` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:59.889921 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0065e4-ecb0-49fa-8330-a070b2802f70 None None] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:59.890266 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0065e4-ecb0-49fa-8330-a070b2802f70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:59.905683 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d62f4a-7963-40e8-9c23-2cbc976bb254 None None] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:53:59.921866 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.auth.core [None req-8e0065e4-ecb0-49fa-8330-a070b2802f70 None None] MFA Rules not processed for user `dce2641582d4434c9657d4335d70f964`. Rule list: `[]` (Enabled: `True`). {{(pid=86655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:53:59.923217 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-8e0065e4-ecb0-49fa-8330-a070b2802f70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:53:59.958395 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a97d198-1551-4ddd-ad02-d2fdb6f4919c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dddf93691844886982c91fea974385d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59391272ecbe48b0aa736cb43807be1d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:53:59.959105 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a97d198-1551-4ddd-ad02-d2fdb6f4919c service neutron] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:53:59.959426 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a97d198-1551-4ddd-ad02-d2fdb6f4919c service neutron] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:53:59.959664 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a97d198-1551-4ddd-ad02-d2fdb6f4919c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:53:59.965988 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:53:59.991537 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 1124/2227] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jul 14 10:53:59 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:54:00.003309 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0065e4-ecb0-49fa-8330-a070b2802f70 None None] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:54:00.004738 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-8e0065e4-ecb0-49fa-8330-a070b2802f70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:54:00.019757 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:54:00.028459 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a97d198-1551-4ddd-ad02-d2fdb6f4919c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:54:00.030379 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a97d198-1551-4ddd-ad02-d2fdb6f4919c service neutron] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:54:00.041078 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 1104/2228] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jul 14 10:53:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 257 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:54:00.093653 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0065e4-ecb0-49fa-8330-a070b2802f70 None None] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:54:00.097317 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e504f4e-bf8f-4f7b-9676-4950b7a27844 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cb877bf3f8241dcb2ecbb612c7f4f69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59391272ecbe48b0aa736cb43807be1d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:54:00.097973 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e504f4e-bf8f-4f7b-9676-4950b7a27844 service glance] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:00.098260 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e504f4e-bf8f-4f7b-9676-4950b7a27844 service glance] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:00.098543 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e504f4e-bf8f-4f7b-9676-4950b7a27844 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:00.108091 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e504f4e-bf8f-4f7b-9676-4950b7a27844 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:54:00.109576 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e504f4e-bf8f-4f7b-9676-4950b7a27844 service glance] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:54:00.118853 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 1125/2229] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jul 14 10:54:00 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 10:54:06.087906 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f580a2-443c-4a59-ac81-e0b534c256f1 None None] REQUEST_METHOD: `POST` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:06.089075 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f580a2-443c-4a59-ac81-e0b534c256f1 None None] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:06.089605 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f580a2-443c-4a59-ac81-e0b534c256f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:06.159930 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.auth.core [None req-f3f580a2-443c-4a59-ac81-e0b534c256f1 None None] MFA Rules not processed for user `9bf1e116dda742559eed6d9c25f1ff47`. Rule list: `[]` (Enabled: `True`). {{(pid=86656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:54:06.161549 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-f3f580a2-443c-4a59-ac81-e0b534c256f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:54:06.270604 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 1105/2230] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jul 14 10:54:06 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:54:06.285221 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e504f4e-bf8f-4f7b-9676-4950b7a27844 service glance] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:54:06.288301 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-9e504f4e-bf8f-4f7b-9676-4950b7a27844 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:54:06.383803 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e504f4e-bf8f-4f7b-9676-4950b7a27844 service glance] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:54:06.391317 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f962884-f94e-40c0-9a4a-8d490c14a356 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26aa294c913c408499a913ec25bb677d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59391272ecbe48b0aa736cb43807be1d', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:54:06.391994 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f962884-f94e-40c0-9a4a-8d490c14a356 service nova] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:06.392278 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f962884-f94e-40c0-9a4a-8d490c14a356 service nova] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:06.392556 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f962884-f94e-40c0-9a4a-8d490c14a356 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:06.401949 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f962884-f94e-40c0-9a4a-8d490c14a356 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:54:06.404991 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f962884-f94e-40c0-9a4a-8d490c14a356 service nova] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:54:06.420213 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 1126/2231] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jul 14 10:54:06 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:54:06.766931 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f580a2-443c-4a59-ac81-e0b534c256f1 None None] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:54:06.770114 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-f3f580a2-443c-4a59-ac81-e0b534c256f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:54:06.804165 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f962884-f94e-40c0-9a4a-8d490c14a356 service nova] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:54:06.806157 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f580a2-443c-4a59-ac81-e0b534c256f1 None None] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:54:06.812083 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-2f962884-f94e-40c0-9a4a-8d490c14a356 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:54:06.815560 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4172d8a0-db1f-4fc5-bb00-085d3b50e4c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:54:06.817285 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4172d8a0-db1f-4fc5-bb00-085d3b50e4c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:06.817285 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4172d8a0-db1f-4fc5-bb00-085d3b50e4c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:06.817604 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4172d8a0-db1f-4fc5-bb00-085d3b50e4c4 admin admin] PATH_INFO: `/v3/users/780b32b7f69941148bec5f6d7dd40f4f` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:06.819769 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4172d8a0-db1f-4fc5-bb00-085d3b50e4c4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=780b32b7f69941148bec5f6d7dd40f4f)` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:54:06.823554 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4172d8a0-db1f-4fc5-bb00-085d3b50e4c4 admin admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:54:06.852863 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f962884-f94e-40c0-9a4a-8d490c14a356 service nova] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:54:06.861361 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bc39df-1ccf-41b4-b47f-0cd227dcac1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:54:06.862313 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bc39df-1ccf-41b4-b47f-0cd227dcac1a admin admin] REQUEST_METHOD: `DELETE` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:06.862602 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bc39df-1ccf-41b4-b47f-0cd227dcac1a admin admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:06.862887 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bc39df-1ccf-41b4-b47f-0cd227dcac1a admin admin] PATH_INFO: `/v3/users/0bea076eadcf4b9585ca56a3d0f7834d` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:06.864809 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94bc39df-1ccf-41b4-b47f-0cd227dcac1a admin admin] RBAC: Authorizing `identity:delete_user(user_id=0bea076eadcf4b9585ca56a3d0f7834d)` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:54:06.880439 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94bc39df-1ccf-41b4-b47f-0cd227dcac1a admin admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:54:06.933672 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-4172d8a0-db1f-4fc5-bb00-085d3b50e4c4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '780b32b7f69941148bec5f6d7dd40f4f'} {{(pid=86656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:54:06.948105 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-4172d8a0-db1f-4fc5-bb00-085d3b50e4c4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '780b32b7f69941148bec5f6d7dd40f4f'} {{(pid=86656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:54:06.957598 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-4172d8a0-db1f-4fc5-bb00-085d3b50e4c4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '780b32b7f69941148bec5f6d7dd40f4f'} {{(pid=86656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:54:06.980127 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-4172d8a0-db1f-4fc5-bb00-085d3b50e4c4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '780b32b7f69941148bec5f6d7dd40f4f'} {{(pid=86656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:54:06.980928 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-4172d8a0-db1f-4fc5-bb00-085d3b50e4c4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '780b32b7f69941148bec5f6d7dd40f4f'} {{(pid=86656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:54:06.989713 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-94bc39df-1ccf-41b4-b47f-0cd227dcac1a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0bea076eadcf4b9585ca56a3d0f7834d'} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:54:07.001149 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-94bc39df-1ccf-41b4-b47f-0cd227dcac1a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0bea076eadcf4b9585ca56a3d0f7834d'} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:54:07.001932 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-94bc39df-1ccf-41b4-b47f-0cd227dcac1a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0bea076eadcf4b9585ca56a3d0f7834d'} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:54:07.009110 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 1106/2232] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Jul 14 10:54:06 2022] DELETE /identity/v3/users/780b32b7f69941148bec5f6d7dd40f4f => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:54:07.012332 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-94bc39df-1ccf-41b4-b47f-0cd227dcac1a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0bea076eadcf4b9585ca56a3d0f7834d'} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:54:07.013833 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-94bc39df-1ccf-41b4-b47f-0cd227dcac1a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0bea076eadcf4b9585ca56a3d0f7834d'} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:54:07.023940 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:54:07.040139 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5702c1fe-2753-45dd-83dc-0f1ed4ecb2d6 None None] REQUEST_METHOD: `POST` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:07.040470 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5702c1fe-2753-45dd-83dc-0f1ed4ecb2d6 None None] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:07.040765 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5702c1fe-2753-45dd-83dc-0f1ed4ecb2d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:07.050861 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 1127/2233] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Jul 14 10:54:06 2022] DELETE /identity/v3/users/0bea076eadcf4b9585ca56a3d0f7834d => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:54:07.052436 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab2d976-6eda-4a55-91d2-f340dbfbaf21 None None] REQUEST_METHOD: `POST` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:07.052924 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab2d976-6eda-4a55-91d2-f340dbfbaf21 None None] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:07.059002 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab2d976-6eda-4a55-91d2-f340dbfbaf21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:07.073848 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:54:07.105979 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.auth.core [None req-5702c1fe-2753-45dd-83dc-0f1ed4ecb2d6 None None] MFA Rules not processed for user `ae4bcdd8106d4bebbdcae96be33505bc`. Rule list: `[]` (Enabled: `True`). {{(pid=86656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:54:07.115791 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.auth.core [None req-cab2d976-6eda-4a55-91d2-f340dbfbaf21 None None] MFA Rules not processed for user `ae4bcdd8106d4bebbdcae96be33505bc`. Rule list: `[]` (Enabled: `True`). {{(pid=86655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:54:07.117087 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-cab2d976-6eda-4a55-91d2-f340dbfbaf21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:54:07.118702 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-5702c1fe-2753-45dd-83dc-0f1ed4ecb2d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:54:07.226985 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 1107/2234] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jul 14 10:54:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 10:54:07.242645 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 1128/2235] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jul 14 10:54:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:54:07.267506 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5702c1fe-2753-45dd-83dc-0f1ed4ecb2d6 None None] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:54:07.270161 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-5702c1fe-2753-45dd-83dc-0f1ed4ecb2d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:54:07.287048 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab2d976-6eda-4a55-91d2-f340dbfbaf21 None None] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:54:07.289799 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-cab2d976-6eda-4a55-91d2-f340dbfbaf21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:54:07.440017 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5702c1fe-2753-45dd-83dc-0f1ed4ecb2d6 None None] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:54:07.444276 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e040a55c-d9ca-4eeb-8fef-743361c09adb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dddf93691844886982c91fea974385d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59391272ecbe48b0aa736cb43807be1d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:54:07.444987 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e040a55c-d9ca-4eeb-8fef-743361c09adb service neutron] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:07.445319 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e040a55c-d9ca-4eeb-8fef-743361c09adb service neutron] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:07.445603 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e040a55c-d9ca-4eeb-8fef-743361c09adb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:07.458099 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e040a55c-d9ca-4eeb-8fef-743361c09adb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:54:07.460000 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e040a55c-d9ca-4eeb-8fef-743361c09adb service neutron] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:54:07.460675 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab2d976-6eda-4a55-91d2-f340dbfbaf21 None None] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:54:07.471803 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93bc6d04-6be0-4f02-a703-77b46f731a00 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dddf93691844886982c91fea974385d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59391272ecbe48b0aa736cb43807be1d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:54:07.472579 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bc6d04-6be0-4f02-a703-77b46f731a00 service neutron] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:07.472907 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bc6d04-6be0-4f02-a703-77b46f731a00 service neutron] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:07.473230 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bc6d04-6be0-4f02-a703-77b46f731a00 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:07.474036 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 1108/2236] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jul 14 10:54:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:54:07.499406 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93bc6d04-6be0-4f02-a703-77b46f731a00 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:54:07.501028 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93bc6d04-6be0-4f02-a703-77b46f731a00 service neutron] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:54:07.515097 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 1129/2237] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jul 14 10:54:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 228 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 10:54:07.801628 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42332a66-edcf-4f18-b685-373a59e748fe None None] REQUEST_METHOD: `POST` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:07.801853 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42332a66-edcf-4f18-b685-373a59e748fe None None] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:07.802135 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42332a66-edcf-4f18-b685-373a59e748fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:07.832993 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.auth.core [None req-42332a66-edcf-4f18-b685-373a59e748fe None None] MFA Rules not processed for user `e67b2b8b1f154708ac2d3d70fa24d6d0`. Rule list: `[]` (Enabled: `True`). {{(pid=86656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:54:07.834441 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-42332a66-edcf-4f18-b685-373a59e748fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:54:07.935435 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 1109/2238] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jul 14 10:54:07 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:54:07.997086 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93bc6d04-6be0-4f02-a703-77b46f731a00 service neutron] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:54:07.999254 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-93bc6d04-6be0-4f02-a703-77b46f731a00 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:54:08.014060 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93bc6d04-6be0-4f02-a703-77b46f731a00 service neutron] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:54:08.019994 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b9edfc-6cdb-448f-a14b-0f938bae0330 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:54:08.021222 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b9edfc-6cdb-448f-a14b-0f938bae0330 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:08.021732 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b9edfc-6cdb-448f-a14b-0f938bae0330 admin admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:08.022329 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b9edfc-6cdb-448f-a14b-0f938bae0330 admin admin] PATH_INFO: `/v3/projects/45519db65a3f45b780927af7aa18cc1d` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:08.024061 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b9edfc-6cdb-448f-a14b-0f938bae0330 admin admin] RBAC: Authorizing `identity:delete_project(project_id=45519db65a3f45b780927af7aa18cc1d)` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:54:08.026268 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b9edfc-6cdb-448f-a14b-0f938bae0330 admin admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:54:08.089485 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-d6b9edfc-6cdb-448f-a14b-0f938bae0330 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '45519db65a3f45b780927af7aa18cc1d', 'request_id': 'req-d6b9edfc-6cdb-448f-a14b-0f938bae0330'} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:54:08.095829 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-d6b9edfc-6cdb-448f-a14b-0f938bae0330 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '45519db65a3f45b780927af7aa18cc1d', 'request_id': 'req-d6b9edfc-6cdb-448f-a14b-0f938bae0330'} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:54:08.108152 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-d6b9edfc-6cdb-448f-a14b-0f938bae0330 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '45519db65a3f45b780927af7aa18cc1d', 'request_id': 'req-d6b9edfc-6cdb-448f-a14b-0f938bae0330'} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:54:08.126464 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-d6b9edfc-6cdb-448f-a14b-0f938bae0330 admin admin] The token cache is being invalidate because project 45519db65a3f45b780927af7aa18cc1d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86655) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 10:54:08.127000 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-d6b9edfc-6cdb-448f-a14b-0f938bae0330 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:54:08.127821 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-d6b9edfc-6cdb-448f-a14b-0f938bae0330 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:54:08.129631 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 1130/2239] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Jul 14 10:54:07 2022] DELETE /identity/v3/projects/45519db65a3f45b780927af7aa18cc1d => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:54:08.134597 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2c6d77-761b-45e9-927b-0dd65a610376 None None] REQUEST_METHOD: `POST` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:08.135182 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2c6d77-761b-45e9-927b-0dd65a610376 None None] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:08.135182 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2c6d77-761b-45e9-927b-0dd65a610376 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:08.158357 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.auth.core [None req-1c2c6d77-761b-45e9-927b-0dd65a610376 None None] MFA Rules not processed for user `ae4bcdd8106d4bebbdcae96be33505bc`. Rule list: `[]` (Enabled: `True`). {{(pid=86656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:54:08.159788 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-1c2c6d77-761b-45e9-927b-0dd65a610376 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:54:08.233755 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b9edfc-6cdb-448f-a14b-0f938bae0330 admin admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:54:08.235291 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-d6b9edfc-6cdb-448f-a14b-0f938bae0330 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:54:08.239500 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=100 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:54:08.260179 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:54:08.260380 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 1110/2240] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jul 14 10:54:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 10:54:08.269505 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fce9433-b740-4d3f-a0ef-930d29b4ef01 None None] REQUEST_METHOD: `POST` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:08.269740 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fce9433-b740-4d3f-a0ef-930d29b4ef01 None None] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:08.270246 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fce9433-b740-4d3f-a0ef-930d29b4ef01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:08.323333 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.auth.core [None req-4fce9433-b740-4d3f-a0ef-930d29b4ef01 None None] MFA Rules not processed for user `ae4bcdd8106d4bebbdcae96be33505bc`. Rule list: `[]` (Enabled: `True`). {{(pid=86656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:54:08.324554 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-4fce9433-b740-4d3f-a0ef-930d29b4ef01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:54:08.334357 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b9edfc-6cdb-448f-a14b-0f938bae0330 admin admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:54:08.340142 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec267699-99c0-41e8-8144-a472305a43ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:54:08.341332 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec267699-99c0-41e8-8144-a472305a43ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:08.341855 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec267699-99c0-41e8-8144-a472305a43ae admin admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:08.342283 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec267699-99c0-41e8-8144-a472305a43ae admin admin] PATH_INFO: `/v3/projects/ac971faddc4b433db47f63d4d7542927` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:08.344115 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec267699-99c0-41e8-8144-a472305a43ae admin admin] RBAC: Authorizing `identity:delete_project(project_id=ac971faddc4b433db47f63d4d7542927)` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:54:08.346551 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec267699-99c0-41e8-8144-a472305a43ae admin admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:54:08.359877 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 1111/2241] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jul 14 10:54:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:54:08.364174 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fce9433-b740-4d3f-a0ef-930d29b4ef01 None None] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:54:08.376509 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fce9433-b740-4d3f-a0ef-930d29b4ef01 None None] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:54:08.386212 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037e7fe0-202a-4229-88ed-be40ca8d4c99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:54:08.386929 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037e7fe0-202a-4229-88ed-be40ca8d4c99 admin admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:08.387709 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037e7fe0-202a-4229-88ed-be40ca8d4c99 admin admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:08.388010 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037e7fe0-202a-4229-88ed-be40ca8d4c99 admin admin] PATH_INFO: `/v3/domains` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:08.388790 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037e7fe0-202a-4229-88ed-be40ca8d4c99 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:54:08.389285 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037e7fe0-202a-4229-88ed-be40ca8d4c99 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:54:08.391179 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037e7fe0-202a-4229-88ed-be40ca8d4c99 admin admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:54:08.425482 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 1112/2242] 10.222.0.16 () {58 vars in 1152 bytes} [Thu Jul 14 10:54:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 10:54:08.428949 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037e7fe0-202a-4229-88ed-be40ca8d4c99 admin admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:54:08.454557 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037e7fe0-202a-4229-88ed-be40ca8d4c99 admin admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:54:08.487657 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-ec267699-99c0-41e8-8144-a472305a43ae admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ac971faddc4b433db47f63d4d7542927', 'request_id': 'req-ec267699-99c0-41e8-8144-a472305a43ae'} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:54:08.524067 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-ec267699-99c0-41e8-8144-a472305a43ae admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ac971faddc4b433db47f63d4d7542927', 'request_id': 'req-ec267699-99c0-41e8-8144-a472305a43ae'} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:54:08.550527 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-ec267699-99c0-41e8-8144-a472305a43ae admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ac971faddc4b433db47f63d4d7542927', 'request_id': 'req-ec267699-99c0-41e8-8144-a472305a43ae'} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:54:08.585000 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-ec267699-99c0-41e8-8144-a472305a43ae admin admin] The token cache is being invalidate because project ac971faddc4b433db47f63d4d7542927 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86655) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 10:54:08.585314 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-ec267699-99c0-41e8-8144-a472305a43ae admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:54:08.587078 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-ec267699-99c0-41e8-8144-a472305a43ae admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:54:08.589232 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 1131/2243] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Jul 14 10:54:08 2022] DELETE /identity/v3/projects/ac971faddc4b433db47f63d4d7542927 => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:54:08.596189 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1615b58d-1289-475e-a8da-99ff852ebbcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:54:08.596940 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1615b58d-1289-475e-a8da-99ff852ebbcc admin admin] REQUEST_METHOD: `POST` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:08.597119 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec267699-99c0-41e8-8144-a472305a43ae admin admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:54:08.597233 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1615b58d-1289-475e-a8da-99ff852ebbcc admin admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:08.597503 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1615b58d-1289-475e-a8da-99ff852ebbcc admin admin] PATH_INFO: `/v3/projects` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:08.598227 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1615b58d-1289-475e-a8da-99ff852ebbcc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:54:08.599288 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-ec267699-99c0-41e8-8144-a472305a43ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:54:08.601596 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1615b58d-1289-475e-a8da-99ff852ebbcc admin admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:54:08.629570 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec267699-99c0-41e8-8144-a472305a43ae admin admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:54:08.638715 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc37a07-73a5-414d-b48d-2dec75a8ac8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:54:08.640702 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc37a07-73a5-414d-b48d-2dec75a8ac8e admin admin] REQUEST_METHOD: `DELETE` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:08.641334 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc37a07-73a5-414d-b48d-2dec75a8ac8e admin admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:08.641870 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc37a07-73a5-414d-b48d-2dec75a8ac8e admin admin] PATH_INFO: `/v3/users/a93024211e7c440fa21b7a42ec00c270` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:08.643732 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc37a07-73a5-414d-b48d-2dec75a8ac8e admin admin] RBAC: Authorizing `identity:delete_user(user_id=a93024211e7c440fa21b7a42ec00c270)` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:54:08.646298 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc37a07-73a5-414d-b48d-2dec75a8ac8e admin admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:54:08.685370 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 1113/2244] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Jul 14 10:54:08 2022] POST /identity/v3/projects => generated 375 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:54:08.686727 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1615b58d-1289-475e-a8da-99ff852ebbcc admin admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:54:08.691025 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-1615b58d-1289-475e-a8da-99ff852ebbcc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:54:08.776071 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-0dc37a07-73a5-414d-b48d-2dec75a8ac8e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a93024211e7c440fa21b7a42ec00c270'} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:54:08.808031 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-0dc37a07-73a5-414d-b48d-2dec75a8ac8e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a93024211e7c440fa21b7a42ec00c270'} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:54:08.808249 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-0dc37a07-73a5-414d-b48d-2dec75a8ac8e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a93024211e7c440fa21b7a42ec00c270'} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:54:08.823905 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-0dc37a07-73a5-414d-b48d-2dec75a8ac8e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a93024211e7c440fa21b7a42ec00c270'} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:54:08.825890 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-0dc37a07-73a5-414d-b48d-2dec75a8ac8e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a93024211e7c440fa21b7a42ec00c270'} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:54:08.866494 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1615b58d-1289-475e-a8da-99ff852ebbcc admin admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:54:08.872047 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591360cf-635b-44e6-bba7-9802568971ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:54:08.872947 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591360cf-635b-44e6-bba7-9802568971ed admin admin] REQUEST_METHOD: `POST` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:08.873389 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591360cf-635b-44e6-bba7-9802568971ed admin admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:08.873782 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591360cf-635b-44e6-bba7-9802568971ed admin admin] PATH_INFO: `/v3/users` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:08.874600 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591360cf-635b-44e6-bba7-9802568971ed admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:54:08.877106 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591360cf-635b-44e6-bba7-9802568971ed admin admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:54:08.883501 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 1132/2245] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Jul 14 10:54:08 2022] DELETE /identity/v3/users/a93024211e7c440fa21b7a42ec00c270 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:54:08.904381 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 1114/2246] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Jul 14 10:54:08 2022] POST /identity/v3/users => generated 288 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:54:08.908322 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc37a07-73a5-414d-b48d-2dec75a8ac8e admin admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:54:08.909880 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-0dc37a07-73a5-414d-b48d-2dec75a8ac8e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:54:08.959220 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:54:09.101055 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc37a07-73a5-414d-b48d-2dec75a8ac8e admin admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:54:09.109950 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9a839f-6f16-4630-bc05-38fedd160d67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:54:09.113163 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9a839f-6f16-4630-bc05-38fedd160d67 admin admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:09.115315 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9a839f-6f16-4630-bc05-38fedd160d67 admin admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:09.115660 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9a839f-6f16-4630-bc05-38fedd160d67 admin admin] PATH_INFO: `/v3/roles` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:09.116437 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9a839f-6f16-4630-bc05-38fedd160d67 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:54:09.123724 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9a839f-6f16-4630-bc05-38fedd160d67 admin admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:54:09.151111 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 1133/2247] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jul 14 10:54:08 2022] GET /identity/v3/roles => generated 1420 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:54:09.153886 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591360cf-635b-44e6-bba7-9802568971ed admin admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:54:09.192310 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591360cf-635b-44e6-bba7-9802568971ed admin admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:54:09.208370 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af408253-fee9-4984-953e-9734078ca4c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:54:09.210216 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af408253-fee9-4984-953e-9734078ca4c9 admin admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:09.210505 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af408253-fee9-4984-953e-9734078ca4c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:09.210787 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af408253-fee9-4984-953e-9734078ca4c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:09.211536 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af408253-fee9-4984-953e-9734078ca4c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:54:09.224966 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af408253-fee9-4984-953e-9734078ca4c9 admin admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:54:09.253906 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 1115/2248] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jul 14 10:54:09 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:54:09.257899 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9a839f-6f16-4630-bc05-38fedd160d67 admin admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:54:09.273162 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9a839f-6f16-4630-bc05-38fedd160d67 admin admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:54:09.281507 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5931bdf5-2520-488e-a44f-3bc24ebe1e38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:54:09.282643 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5931bdf5-2520-488e-a44f-3bc24ebe1e38 admin admin] REQUEST_METHOD: `PUT` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:09.282967 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5931bdf5-2520-488e-a44f-3bc24ebe1e38 admin admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:09.283307 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5931bdf5-2520-488e-a44f-3bc24ebe1e38 admin admin] PATH_INFO: `/v3/projects/ad01cd79b23249d6b47a49fe5def929d/users/10e895f2ec794c11a45d45f6ab463799/roles/0da46c267d354cce81495dfdd56c1ec2` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:09.359915 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5931bdf5-2520-488e-a44f-3bc24ebe1e38 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ad01cd79b23249d6b47a49fe5def929d, user_id=10e895f2ec794c11a45d45f6ab463799, role_id=0da46c267d354cce81495dfdd56c1ec2)` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:54:09.364634 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5931bdf5-2520-488e-a44f-3bc24ebe1e38 admin admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:54:09.391313 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 1134/2249] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Jul 14 10:54:09 2022] PUT /identity/v3/projects/ad01cd79b23249d6b47a49fe5def929d/users/10e895f2ec794c11a45d45f6ab463799/roles/0da46c267d354cce81495dfdd56c1ec2 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:54:09.405089 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf90ff7-9f1a-4e8f-b135-ff37087d39df None None] REQUEST_METHOD: `POST` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:09.405799 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf90ff7-9f1a-4e8f-b135-ff37087d39df None None] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:09.406263 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf90ff7-9f1a-4e8f-b135-ff37087d39df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:09.481594 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.auth.core [None req-bcf90ff7-9f1a-4e8f-b135-ff37087d39df None None] MFA Rules not processed for user `10e895f2ec794c11a45d45f6ab463799`. Rule list: `[]` (Enabled: `True`). {{(pid=86656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:54:09.483224 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-bcf90ff7-9f1a-4e8f-b135-ff37087d39df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:54:09.539652 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:54:09.602323 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 1116/2250] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jul 14 10:54:09 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:54:09.615173 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5931bdf5-2520-488e-a44f-3bc24ebe1e38 admin admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:54:09.617265 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-5931bdf5-2520-488e-a44f-3bc24ebe1e38 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:54:09.676561 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7146b446-7022-4b34-80ff-0ca35cae4d79 None None] REQUEST_METHOD: `POST` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:09.676906 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7146b446-7022-4b34-80ff-0ca35cae4d79 None None] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:09.677158 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7146b446-7022-4b34-80ff-0ca35cae4d79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:09.705576 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.auth.core [None req-7146b446-7022-4b34-80ff-0ca35cae4d79 None None] MFA Rules not processed for user `9bf1e116dda742559eed6d9c25f1ff47`. Rule list: `[]` (Enabled: `True`). {{(pid=86656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:54:09.706878 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-7146b446-7022-4b34-80ff-0ca35cae4d79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:54:09.737097 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5931bdf5-2520-488e-a44f-3bc24ebe1e38 admin admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:54:09.742164 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc583c40-ff2b-4de1-b841-c8200a1c1430 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68382432147a48c3b62271fd2a2eab04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59391272ecbe48b0aa736cb43807be1d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:54:09.743177 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc583c40-ff2b-4de1-b841-c8200a1c1430 service cinder] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:09.743497 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc583c40-ff2b-4de1-b841-c8200a1c1430 service cinder] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:09.743792 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc583c40-ff2b-4de1-b841-c8200a1c1430 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:09.757024 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc583c40-ff2b-4de1-b841-c8200a1c1430 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:54:09.758499 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc583c40-ff2b-4de1-b841-c8200a1c1430 service cinder] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:54:09.786970 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 1135/2251] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jul 14 10:54:09 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:54:09.788663 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc583c40-ff2b-4de1-b841-c8200a1c1430 service cinder] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:54:09.792727 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-dc583c40-ff2b-4de1-b841-c8200a1c1430 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:54:09.817852 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 1117/2252] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jul 14 10:54:09 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:54:09.933926 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc583c40-ff2b-4de1-b841-c8200a1c1430 service cinder] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:54:09.941245 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4076cfe5-eaad-4c32-8297-f596481688c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:54:09.942416 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4076cfe5-eaad-4c32-8297-f596481688c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:09.942783 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4076cfe5-eaad-4c32-8297-f596481688c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:09.943132 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4076cfe5-eaad-4c32-8297-f596481688c8 admin admin] PATH_INFO: `/v3/projects/6eeafb259478442f8bd07d43cf9851e0` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:09.945004 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4076cfe5-eaad-4c32-8297-f596481688c8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6eeafb259478442f8bd07d43cf9851e0)` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:54:09.947849 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4076cfe5-eaad-4c32-8297-f596481688c8 admin admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:54:10.025840 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=97,keystone:INSERT=1,keystone:DELETE=2 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:54:10.055622 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-4076cfe5-eaad-4c32-8297-f596481688c8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6eeafb259478442f8bd07d43cf9851e0', 'request_id': 'req-4076cfe5-eaad-4c32-8297-f596481688c8'} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:54:10.071883 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-4076cfe5-eaad-4c32-8297-f596481688c8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6eeafb259478442f8bd07d43cf9851e0', 'request_id': 'req-4076cfe5-eaad-4c32-8297-f596481688c8'} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:54:10.085251 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-4076cfe5-eaad-4c32-8297-f596481688c8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6eeafb259478442f8bd07d43cf9851e0', 'request_id': 'req-4076cfe5-eaad-4c32-8297-f596481688c8'} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:54:10.112490 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-4076cfe5-eaad-4c32-8297-f596481688c8 admin admin] The token cache is being invalidate because project 6eeafb259478442f8bd07d43cf9851e0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86655) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 10:54:10.113180 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-4076cfe5-eaad-4c32-8297-f596481688c8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:54:10.114108 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-4076cfe5-eaad-4c32-8297-f596481688c8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:54:10.116318 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 1136/2253] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Jul 14 10:54:09 2022] DELETE /identity/v3/projects/6eeafb259478442f8bd07d43cf9851e0 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:54:10.123454 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98683de0-a307-46eb-9d91-ed285e99633e None None] REQUEST_METHOD: `POST` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:10.124042 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98683de0-a307-46eb-9d91-ed285e99633e None None] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:10.124670 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98683de0-a307-46eb-9d91-ed285e99633e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:10.157623 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.auth.core [None req-98683de0-a307-46eb-9d91-ed285e99633e None None] MFA Rules not processed for user `ae4bcdd8106d4bebbdcae96be33505bc`. Rule list: `[]` (Enabled: `True`). {{(pid=86656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:54:10.158938 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-98683de0-a307-46eb-9d91-ed285e99633e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:54:10.243066 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 1118/2254] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jul 14 10:54:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:54:10.251210 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4922400c-b699-4e54-97a2-e1ea066b4f5a None None] REQUEST_METHOD: `POST` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:10.251502 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4922400c-b699-4e54-97a2-e1ea066b4f5a None None] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:10.251784 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4922400c-b699-4e54-97a2-e1ea066b4f5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:10.283540 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.auth.core [None req-4922400c-b699-4e54-97a2-e1ea066b4f5a None None] MFA Rules not processed for user `ae4bcdd8106d4bebbdcae96be33505bc`. Rule list: `[]` (Enabled: `True`). {{(pid=86655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:54:10.286021 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-4922400c-b699-4e54-97a2-e1ea066b4f5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:54:10.298878 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 1137/2255] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jul 14 10:54:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:54:10.306239 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98683de0-a307-46eb-9d91-ed285e99633e None None] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:54:10.317438 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98683de0-a307-46eb-9d91-ed285e99633e None None] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:54:10.326008 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0eb445-151d-47f1-b756-ca51e4a830b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:54:10.327205 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0eb445-151d-47f1-b756-ca51e4a830b1 admin admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:10.328327 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0eb445-151d-47f1-b756-ca51e4a830b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:10.328864 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0eb445-151d-47f1-b756-ca51e4a830b1 admin admin] PATH_INFO: `/v3/domains` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:10.331008 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0eb445-151d-47f1-b756-ca51e4a830b1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:54:10.331483 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0eb445-151d-47f1-b756-ca51e4a830b1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:54:10.348497 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0eb445-151d-47f1-b756-ca51e4a830b1 admin admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:54:10.444060 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4922400c-b699-4e54-97a2-e1ea066b4f5a None None] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:54:10.445779 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 1119/2256] 10.222.0.16 () {58 vars in 1152 bytes} [Thu Jul 14 10:54:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:54:10.465483 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4922400c-b699-4e54-97a2-e1ea066b4f5a None None] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:54:10.486855 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b8b2e7-938a-4fca-9997-23dfd5016f76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:54:10.487545 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b8b2e7-938a-4fca-9997-23dfd5016f76 admin admin] REQUEST_METHOD: `POST` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:10.489026 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b8b2e7-938a-4fca-9997-23dfd5016f76 admin admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:10.489316 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b8b2e7-938a-4fca-9997-23dfd5016f76 admin admin] PATH_INFO: `/v3/projects` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:10.494114 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b8b2e7-938a-4fca-9997-23dfd5016f76 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:54:10.504518 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b8b2e7-938a-4fca-9997-23dfd5016f76 admin admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:54:10.596586 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 1138/2257] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Jul 14 10:54:10 2022] POST /identity/v3/projects => generated 383 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:54:10.602061 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0eb445-151d-47f1-b756-ca51e4a830b1 admin admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:54:10.641721 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0eb445-151d-47f1-b756-ca51e4a830b1 admin admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:54:10.787234 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338f5134-b821-42f5-a91e-fad58ef2cc43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:54:10.788157 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338f5134-b821-42f5-a91e-fad58ef2cc43 admin admin] REQUEST_METHOD: `POST` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:10.792815 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338f5134-b821-42f5-a91e-fad58ef2cc43 admin admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:10.792815 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338f5134-b821-42f5-a91e-fad58ef2cc43 admin admin] PATH_INFO: `/v3/users` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:10.792815 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338f5134-b821-42f5-a91e-fad58ef2cc43 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:54:10.792815 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338f5134-b821-42f5-a91e-fad58ef2cc43 admin admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:54:10.819433 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=100 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:54:10.850618 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 1120/2258] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Jul 14 10:54:10 2022] POST /identity/v3/users => generated 292 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:54:10.857644 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b8b2e7-938a-4fca-9997-23dfd5016f76 admin admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:54:10.875597 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b8b2e7-938a-4fca-9997-23dfd5016f76 admin admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:54:10.892504 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6aace70-b0ac-445d-afdf-556113b11f0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:54:10.893602 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6aace70-b0ac-445d-afdf-556113b11f0d admin admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:10.894146 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6aace70-b0ac-445d-afdf-556113b11f0d admin admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:10.894460 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6aace70-b0ac-445d-afdf-556113b11f0d admin admin] PATH_INFO: `/v3/roles` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:10.895313 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6aace70-b0ac-445d-afdf-556113b11f0d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:54:10.897337 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6aace70-b0ac-445d-afdf-556113b11f0d admin admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:54:10.911647 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 1139/2259] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jul 14 10:54:10 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:54:10.915452 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338f5134-b821-42f5-a91e-fad58ef2cc43 admin admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:54:10.932692 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338f5134-b821-42f5-a91e-fad58ef2cc43 admin admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:54:10.954025 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7486e4a1-8566-4c3e-9ceb-93f4c5628317 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:54:10.954998 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7486e4a1-8566-4c3e-9ceb-93f4c5628317 admin admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:10.955289 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7486e4a1-8566-4c3e-9ceb-93f4c5628317 admin admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:10.955570 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7486e4a1-8566-4c3e-9ceb-93f4c5628317 admin admin] PATH_INFO: `/v3/roles` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:10.960153 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7486e4a1-8566-4c3e-9ceb-93f4c5628317 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:54:10.961856 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7486e4a1-8566-4c3e-9ceb-93f4c5628317 admin admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:54:11.006376 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 1121/2260] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jul 14 10:54:10 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 10:54:11.007875 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6aace70-b0ac-445d-afdf-556113b11f0d admin admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:54:11.032299 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6aace70-b0ac-445d-afdf-556113b11f0d admin admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:54:11.051107 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c9f720-e14a-4406-9c23-133a7909beb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:54:11.052703 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c9f720-e14a-4406-9c23-133a7909beb2 admin admin] REQUEST_METHOD: `PUT` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:11.053159 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c9f720-e14a-4406-9c23-133a7909beb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:11.053637 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c9f720-e14a-4406-9c23-133a7909beb2 admin admin] PATH_INFO: `/v3/projects/d0c8fb1f5c6046ea9e99c5ad3eea1f78/users/463d0548728f42fcb30531a229395957/roles/0da46c267d354cce81495dfdd56c1ec2` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:11.095452 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c9f720-e14a-4406-9c23-133a7909beb2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d0c8fb1f5c6046ea9e99c5ad3eea1f78, user_id=463d0548728f42fcb30531a229395957, role_id=0da46c267d354cce81495dfdd56c1ec2)` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:54:11.098763 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c9f720-e14a-4406-9c23-133a7909beb2 admin admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:54:11.124377 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 1140/2261] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Jul 14 10:54:11 2022] PUT /identity/v3/projects/d0c8fb1f5c6046ea9e99c5ad3eea1f78/users/463d0548728f42fcb30531a229395957/roles/0da46c267d354cce81495dfdd56c1ec2 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:54:11.138287 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8d90cc-f652-4fd3-bbe0-9005207a5bfe None None] REQUEST_METHOD: `POST` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:11.138636 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8d90cc-f652-4fd3-bbe0-9005207a5bfe None None] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:11.139015 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8d90cc-f652-4fd3-bbe0-9005207a5bfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:11.177586 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.auth.core [None req-1f8d90cc-f652-4fd3-bbe0-9005207a5bfe None None] MFA Rules not processed for user `463d0548728f42fcb30531a229395957`. Rule list: `[]` (Enabled: `True`). {{(pid=86656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:54:11.179123 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-1f8d90cc-f652-4fd3-bbe0-9005207a5bfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:54:11.283666 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 1122/2262] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jul 14 10:54:11 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:54:11.284371 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c9f720-e14a-4406-9c23-133a7909beb2 admin admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:54:11.376187 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c9f720-e14a-4406-9c23-133a7909beb2 admin admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:54:11.381563 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cacc88c-fe88-4f49-b982-75317d5715e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:54:11.382101 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cacc88c-fe88-4f49-b982-75317d5715e2 admin admin] REQUEST_METHOD: `POST` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:11.382382 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cacc88c-fe88-4f49-b982-75317d5715e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:11.382658 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cacc88c-fe88-4f49-b982-75317d5715e2 admin admin] PATH_INFO: `/v3/projects` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:11.383358 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cacc88c-fe88-4f49-b982-75317d5715e2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:54:11.385466 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cacc88c-fe88-4f49-b982-75317d5715e2 admin admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:54:11.421722 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 1141/2263] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Jul 14 10:54:11 2022] POST /identity/v3/projects => generated 381 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:54:11.423463 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8d90cc-f652-4fd3-bbe0-9005207a5bfe None None] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:54:11.445222 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8d90cc-f652-4fd3-bbe0-9005207a5bfe None None] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:54:11.536034 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc616f2-8eab-438e-bc3c-2369304914a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:54:11.537090 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc616f2-8eab-438e-bc3c-2369304914a1 admin admin] REQUEST_METHOD: `POST` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:11.537784 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc616f2-8eab-438e-bc3c-2369304914a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:11.538195 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc616f2-8eab-438e-bc3c-2369304914a1 admin admin] PATH_INFO: `/v3/users` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:11.539411 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc616f2-8eab-438e-bc3c-2369304914a1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:54:11.542820 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc616f2-8eab-438e-bc3c-2369304914a1 admin admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:54:11.609477 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 1123/2264] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Jul 14 10:54:11 2022] POST /identity/v3/users => generated 297 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:54:11.610608 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cacc88c-fe88-4f49-b982-75317d5715e2 admin admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:54:11.633204 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cacc88c-fe88-4f49-b982-75317d5715e2 admin admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:54:11.646480 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdffa428-8d8e-418f-8c59-bcb87eb5ec56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:54:11.648242 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdffa428-8d8e-418f-8c59-bcb87eb5ec56 admin admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:11.648534 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdffa428-8d8e-418f-8c59-bcb87eb5ec56 admin admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:11.649987 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdffa428-8d8e-418f-8c59-bcb87eb5ec56 admin admin] PATH_INFO: `/v3/roles` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:11.651594 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdffa428-8d8e-418f-8c59-bcb87eb5ec56 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:54:11.656711 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdffa428-8d8e-418f-8c59-bcb87eb5ec56 admin admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:54:11.693863 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 1142/2265] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jul 14 10:54:11 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:54:11.698025 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc616f2-8eab-438e-bc3c-2369304914a1 admin admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:54:11.720379 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc616f2-8eab-438e-bc3c-2369304914a1 admin admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:54:11.743346 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44943f5-befb-44d6-ba0a-87d13b6ffca0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:54:11.744273 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44943f5-befb-44d6-ba0a-87d13b6ffca0 admin admin] REQUEST_METHOD: `PUT` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:11.744555 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44943f5-befb-44d6-ba0a-87d13b6ffca0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:11.744851 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44943f5-befb-44d6-ba0a-87d13b6ffca0 admin admin] PATH_INFO: `/v3/projects/d6c5676ff3194baea011c94234059c06/users/6a4478294fd148faa3be5be78ac51cd5/roles/153539819e5542df99269d2913bbecfb` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:11.807911 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44943f5-befb-44d6-ba0a-87d13b6ffca0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d6c5676ff3194baea011c94234059c06, user_id=6a4478294fd148faa3be5be78ac51cd5, role_id=153539819e5542df99269d2913bbecfb)` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:54:11.811720 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44943f5-befb-44d6-ba0a-87d13b6ffca0 admin admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:54:11.837241 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 1124/2266] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Jul 14 10:54:11 2022] PUT /identity/v3/projects/d6c5676ff3194baea011c94234059c06/users/6a4478294fd148faa3be5be78ac51cd5/roles/153539819e5542df99269d2913bbecfb => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:54:11.837923 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdffa428-8d8e-418f-8c59-bcb87eb5ec56 admin admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:54:11.859930 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdffa428-8d8e-418f-8c59-bcb87eb5ec56 admin admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:54:11.961675 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:DELETE=5,keystone:SELECT=91,keystone:INSERT=4 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:54:12.024863 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e02a18d-7ef9-40b0-8748-1cd5bfd37a43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:54:12.025551 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e02a18d-7ef9-40b0-8748-1cd5bfd37a43 admin admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:12.025837 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e02a18d-7ef9-40b0-8748-1cd5bfd37a43 admin admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:12.026112 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e02a18d-7ef9-40b0-8748-1cd5bfd37a43 admin admin] PATH_INFO: `/v3/roles` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:12.026853 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e02a18d-7ef9-40b0-8748-1cd5bfd37a43 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:54:12.028881 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e02a18d-7ef9-40b0-8748-1cd5bfd37a43 admin admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:54:12.061740 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 1143/2267] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jul 14 10:54:11 2022] GET /identity/v3/roles => generated 1420 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:54:12.066473 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44943f5-befb-44d6-ba0a-87d13b6ffca0 admin admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:54:12.086843 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44943f5-befb-44d6-ba0a-87d13b6ffca0 admin admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:54:12.102099 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a106304-c671-4c0a-bd89-340096e9ed21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:54:12.103023 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a106304-c671-4c0a-bd89-340096e9ed21 admin admin] REQUEST_METHOD: `PUT` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:12.103310 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a106304-c671-4c0a-bd89-340096e9ed21 admin admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:12.104154 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a106304-c671-4c0a-bd89-340096e9ed21 admin admin] PATH_INFO: `/v3/projects/d6c5676ff3194baea011c94234059c06/users/6a4478294fd148faa3be5be78ac51cd5/roles/153539819e5542df99269d2913bbecfb` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:12.109499 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a106304-c671-4c0a-bd89-340096e9ed21 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d6c5676ff3194baea011c94234059c06, user_id=6a4478294fd148faa3be5be78ac51cd5, role_id=153539819e5542df99269d2913bbecfb)` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:54:12.115296 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a106304-c671-4c0a-bd89-340096e9ed21 admin admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:54:12.145956 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 1125/2268] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Jul 14 10:54:12 2022] PUT /identity/v3/projects/d6c5676ff3194baea011c94234059c06/users/6a4478294fd148faa3be5be78ac51cd5/roles/153539819e5542df99269d2913bbecfb => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 10:54:12.156681 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5651f98a-8ef9-4a3d-8b0d-4a6743b18cc5 None None] REQUEST_METHOD: `POST` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:12.157001 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5651f98a-8ef9-4a3d-8b0d-4a6743b18cc5 None None] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:12.157288 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5651f98a-8ef9-4a3d-8b0d-4a6743b18cc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:12.232808 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.auth.core [None req-5651f98a-8ef9-4a3d-8b0d-4a6743b18cc5 None None] MFA Rules not processed for user `6a4478294fd148faa3be5be78ac51cd5`. Rule list: `[]` (Enabled: `True`). {{(pid=86655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:54:12.235406 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-5651f98a-8ef9-4a3d-8b0d-4a6743b18cc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:54:12.360520 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 1144/2269] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jul 14 10:54:12 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:54:12.474013 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a106304-c671-4c0a-bd89-340096e9ed21 admin admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:54:12.477042 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-4a106304-c671-4c0a-bd89-340096e9ed21 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:54:12.589595 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:INSERT=8,keystone:SELECT=92 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:54:12.686527 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a106304-c671-4c0a-bd89-340096e9ed21 admin admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:54:12.690630 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d421c2e-cfe0-4644-9c90-fac988683912 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68382432147a48c3b62271fd2a2eab04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59391272ecbe48b0aa736cb43807be1d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:54:12.691498 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d421c2e-cfe0-4644-9c90-fac988683912 service cinder] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:12.691788 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d421c2e-cfe0-4644-9c90-fac988683912 service cinder] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:12.692070 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d421c2e-cfe0-4644-9c90-fac988683912 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:12.717236 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d421c2e-cfe0-4644-9c90-fac988683912 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:54:12.721905 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d421c2e-cfe0-4644-9c90-fac988683912 service cinder] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:54:12.740945 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 1126/2270] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jul 14 10:54:12 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 268 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:54:12.948686 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5651f98a-8ef9-4a3d-8b0d-4a6743b18cc5 None None] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:54:12.967190 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5651f98a-8ef9-4a3d-8b0d-4a6743b18cc5 None None] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:54:12.971885 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ce7287-06d4-42bb-a14b-556673e8c4cc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68382432147a48c3b62271fd2a2eab04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59391272ecbe48b0aa736cb43807be1d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:54:12.973009 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ce7287-06d4-42bb-a14b-556673e8c4cc service cinder] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:12.974222 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ce7287-06d4-42bb-a14b-556673e8c4cc service cinder] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:12.978230 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ce7287-06d4-42bb-a14b-556673e8c4cc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:13.073639 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ce7287-06d4-42bb-a14b-556673e8c4cc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:54:13.075952 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ce7287-06d4-42bb-a14b-556673e8c4cc service cinder] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:54:13.086659 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 1145/2271] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jul 14 10:54:12 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:54:13.587067 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d421c2e-cfe0-4644-9c90-fac988683912 service cinder] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:54:13.699926 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d421c2e-cfe0-4644-9c90-fac988683912 service cinder] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:54:13.710631 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246df591-fd74-4391-80da-96de48f89aff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:54:13.711557 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246df591-fd74-4391-80da-96de48f89aff admin admin] REQUEST_METHOD: `DELETE` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:13.711844 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246df591-fd74-4391-80da-96de48f89aff admin admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:13.712131 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246df591-fd74-4391-80da-96de48f89aff admin admin] PATH_INFO: `/v3/users/463d0548728f42fcb30531a229395957` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:13.716322 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246df591-fd74-4391-80da-96de48f89aff admin admin] RBAC: Authorizing `identity:delete_user(user_id=463d0548728f42fcb30531a229395957)` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:54:13.718847 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246df591-fd74-4391-80da-96de48f89aff admin admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:54:13.811980 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-246df591-fd74-4391-80da-96de48f89aff admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '463d0548728f42fcb30531a229395957'} {{(pid=86656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:54:13.825210 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-246df591-fd74-4391-80da-96de48f89aff admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '463d0548728f42fcb30531a229395957'} {{(pid=86656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:54:13.825861 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-246df591-fd74-4391-80da-96de48f89aff admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '463d0548728f42fcb30531a229395957'} {{(pid=86656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:54:13.833988 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-246df591-fd74-4391-80da-96de48f89aff admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '463d0548728f42fcb30531a229395957'} {{(pid=86656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:54:13.834535 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-246df591-fd74-4391-80da-96de48f89aff admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '463d0548728f42fcb30531a229395957'} {{(pid=86656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:54:13.855586 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 1127/2272] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Jul 14 10:54:13 2022] DELETE /identity/v3/users/463d0548728f42fcb30531a229395957 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:54:13.860606 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723f43d7-fcfa-4987-8557-1da21deb8ff3 None None] REQUEST_METHOD: `POST` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:13.860939 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723f43d7-fcfa-4987-8557-1da21deb8ff3 None None] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:13.861402 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723f43d7-fcfa-4987-8557-1da21deb8ff3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:13.881144 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.auth.core [None req-723f43d7-fcfa-4987-8557-1da21deb8ff3 None None] MFA Rules not processed for user `ae4bcdd8106d4bebbdcae96be33505bc`. Rule list: `[]` (Enabled: `True`). {{(pid=86655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:54:13.882283 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-723f43d7-fcfa-4987-8557-1da21deb8ff3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:54:13.946294 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=100 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:54:13.964701 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 1146/2273] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jul 14 10:54:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:54:13.974660 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246df591-fd74-4391-80da-96de48f89aff admin admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:54:13.976470 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-246df591-fd74-4391-80da-96de48f89aff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:54:14.036623 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:54:14.053503 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246df591-fd74-4391-80da-96de48f89aff admin admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:54:14.060724 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb1f6d2-a0e9-4fed-9bbe-5dd7e516ef26 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dddf93691844886982c91fea974385d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59391272ecbe48b0aa736cb43807be1d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:54:14.062667 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb1f6d2-a0e9-4fed-9bbe-5dd7e516ef26 service neutron] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:14.063606 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb1f6d2-a0e9-4fed-9bbe-5dd7e516ef26 service neutron] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:14.064338 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb1f6d2-a0e9-4fed-9bbe-5dd7e516ef26 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:14.082416 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb1f6d2-a0e9-4fed-9bbe-5dd7e516ef26 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:54:14.084833 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb1f6d2-a0e9-4fed-9bbe-5dd7e516ef26 service neutron] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:54:14.098682 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 1128/2274] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jul 14 10:54:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:54:14.502247 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723f43d7-fcfa-4987-8557-1da21deb8ff3 None None] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:54:14.504081 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-723f43d7-fcfa-4987-8557-1da21deb8ff3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:54:14.528060 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723f43d7-fcfa-4987-8557-1da21deb8ff3 None None] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:54:14.549347 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6253021-4bff-483f-858b-ffec04b8f583 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:54:14.550246 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6253021-4bff-483f-858b-ffec04b8f583 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:14.550530 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6253021-4bff-483f-858b-ffec04b8f583 admin admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:14.550802 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6253021-4bff-483f-858b-ffec04b8f583 admin admin] PATH_INFO: `/v3/projects/d0c8fb1f5c6046ea9e99c5ad3eea1f78` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:14.553166 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6253021-4bff-483f-858b-ffec04b8f583 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d0c8fb1f5c6046ea9e99c5ad3eea1f78)` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:54:14.555240 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6253021-4bff-483f-858b-ffec04b8f583 admin admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:54:14.638681 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-b6253021-4bff-483f-858b-ffec04b8f583 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd0c8fb1f5c6046ea9e99c5ad3eea1f78', 'request_id': 'req-b6253021-4bff-483f-858b-ffec04b8f583'} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:54:14.651284 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-b6253021-4bff-483f-858b-ffec04b8f583 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd0c8fb1f5c6046ea9e99c5ad3eea1f78', 'request_id': 'req-b6253021-4bff-483f-858b-ffec04b8f583'} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:54:14.663518 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-b6253021-4bff-483f-858b-ffec04b8f583 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd0c8fb1f5c6046ea9e99c5ad3eea1f78', 'request_id': 'req-b6253021-4bff-483f-858b-ffec04b8f583'} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:54:14.680314 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-b6253021-4bff-483f-858b-ffec04b8f583 admin admin] The token cache is being invalidate because project d0c8fb1f5c6046ea9e99c5ad3eea1f78 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86655) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 10:54:14.680601 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-b6253021-4bff-483f-858b-ffec04b8f583 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:54:14.681387 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-b6253021-4bff-483f-858b-ffec04b8f583 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:54:14.683547 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 1147/2275] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Jul 14 10:54:14 2022] DELETE /identity/v3/projects/d0c8fb1f5c6046ea9e99c5ad3eea1f78 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:54:14.688273 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb1f6d2-a0e9-4fed-9bbe-5dd7e516ef26 service neutron] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:54:14.743270 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb1f6d2-a0e9-4fed-9bbe-5dd7e516ef26 service neutron] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:54:14.917947 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78836e79-437e-4b28-b088-fbcc201bee91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:54:14.919823 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78836e79-437e-4b28-b088-fbcc201bee91 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:14.920246 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78836e79-437e-4b28-b088-fbcc201bee91 admin admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:14.920702 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78836e79-437e-4b28-b088-fbcc201bee91 admin admin] PATH_INFO: `/v3/users/6a4478294fd148faa3be5be78ac51cd5` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:14.922322 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78836e79-437e-4b28-b088-fbcc201bee91 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6a4478294fd148faa3be5be78ac51cd5)` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:54:14.924662 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78836e79-437e-4b28-b088-fbcc201bee91 admin admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:54:14.987612 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-78836e79-437e-4b28-b088-fbcc201bee91 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6a4478294fd148faa3be5be78ac51cd5'} {{(pid=86656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:54:14.997604 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-78836e79-437e-4b28-b088-fbcc201bee91 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6a4478294fd148faa3be5be78ac51cd5'} {{(pid=86656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:54:14.998606 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-78836e79-437e-4b28-b088-fbcc201bee91 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6a4478294fd148faa3be5be78ac51cd5'} {{(pid=86656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:54:15.007263 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-78836e79-437e-4b28-b088-fbcc201bee91 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6a4478294fd148faa3be5be78ac51cd5'} {{(pid=86656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:54:15.008577 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-78836e79-437e-4b28-b088-fbcc201bee91 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6a4478294fd148faa3be5be78ac51cd5'} {{(pid=86656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:54:15.035712 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 1129/2276] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Jul 14 10:54:14 2022] DELETE /identity/v3/users/6a4478294fd148faa3be5be78ac51cd5 => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:54:15.897501 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6253021-4bff-483f-858b-ffec04b8f583 admin admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:54:15.899525 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-b6253021-4bff-483f-858b-ffec04b8f583 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:54:15.926872 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6253021-4bff-483f-858b-ffec04b8f583 admin admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:54:16.181497 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d889bf-6c04-4e6f-9cc5-59c564e2cd13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:54:16.182430 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d889bf-6c04-4e6f-9cc5-59c564e2cd13 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:16.182712 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d889bf-6c04-4e6f-9cc5-59c564e2cd13 admin admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:16.183141 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d889bf-6c04-4e6f-9cc5-59c564e2cd13 admin admin] PATH_INFO: `/v3/projects/d6c5676ff3194baea011c94234059c06` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:16.184796 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d889bf-6c04-4e6f-9cc5-59c564e2cd13 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d6c5676ff3194baea011c94234059c06)` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:54:16.186811 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d889bf-6c04-4e6f-9cc5-59c564e2cd13 admin admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:54:16.294972 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-f9d889bf-6c04-4e6f-9cc5-59c564e2cd13 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd6c5676ff3194baea011c94234059c06', 'request_id': 'req-f9d889bf-6c04-4e6f-9cc5-59c564e2cd13'} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:54:16.302173 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-f9d889bf-6c04-4e6f-9cc5-59c564e2cd13 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd6c5676ff3194baea011c94234059c06', 'request_id': 'req-f9d889bf-6c04-4e6f-9cc5-59c564e2cd13'} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:54:16.310840 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-f9d889bf-6c04-4e6f-9cc5-59c564e2cd13 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd6c5676ff3194baea011c94234059c06', 'request_id': 'req-f9d889bf-6c04-4e6f-9cc5-59c564e2cd13'} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:54:16.331294 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-f9d889bf-6c04-4e6f-9cc5-59c564e2cd13 admin admin] The token cache is being invalidate because project d6c5676ff3194baea011c94234059c06 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86655) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 10:54:16.331971 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-f9d889bf-6c04-4e6f-9cc5-59c564e2cd13 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:54:16.332639 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-f9d889bf-6c04-4e6f-9cc5-59c564e2cd13 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:54:16.335190 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 1148/2277] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Jul 14 10:54:15 2022] DELETE /identity/v3/projects/d6c5676ff3194baea011c94234059c06 => generated 0 bytes in 438 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 10:54:16.340980 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1259197-b350-4da0-889b-76b132376507 None None] REQUEST_METHOD: `POST` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:16.341512 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1259197-b350-4da0-889b-76b132376507 None None] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:16.341820 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1259197-b350-4da0-889b-76b132376507 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:16.365788 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.auth.core [None req-b1259197-b350-4da0-889b-76b132376507 None None] MFA Rules not processed for user `ae4bcdd8106d4bebbdcae96be33505bc`. Rule list: `[]` (Enabled: `True`). {{(pid=86656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:54:16.367227 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-b1259197-b350-4da0-889b-76b132376507 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:54:16.459663 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 1130/2278] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jul 14 10:54:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:54:16.469444 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b2edf9-e381-42c0-aeb6-81210ca79cbb None None] REQUEST_METHOD: `POST` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:16.469693 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b2edf9-e381-42c0-aeb6-81210ca79cbb None None] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:16.469979 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b2edf9-e381-42c0-aeb6-81210ca79cbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:16.486423 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:54:16.493460 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.auth.core [None req-65b2edf9-e381-42c0-aeb6-81210ca79cbb None None] MFA Rules not processed for user `ae4bcdd8106d4bebbdcae96be33505bc`. Rule list: `[]` (Enabled: `True`). {{(pid=86655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:54:16.495780 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-65b2edf9-e381-42c0-aeb6-81210ca79cbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:54:16.510005 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 1149/2279] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jul 14 10:54:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:54:16.510608 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1259197-b350-4da0-889b-76b132376507 None None] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:54:16.519558 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:54:16.525097 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1259197-b350-4da0-889b-76b132376507 None None] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:54:16.535112 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a06369-95d2-409e-a993-11917f2bb943 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:54:16.535891 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a06369-95d2-409e-a993-11917f2bb943 admin admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:16.536380 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a06369-95d2-409e-a993-11917f2bb943 admin admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:16.536885 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a06369-95d2-409e-a993-11917f2bb943 admin admin] PATH_INFO: `/v3/domains` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:16.537728 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a06369-95d2-409e-a993-11917f2bb943 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:54:16.538321 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a06369-95d2-409e-a993-11917f2bb943 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:54:16.540094 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a06369-95d2-409e-a993-11917f2bb943 admin admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:54:16.565590 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b2edf9-e381-42c0-aeb6-81210ca79cbb None None] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:54:16.575366 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 1131/2280] 10.222.0.16 () {58 vars in 1152 bytes} [Thu Jul 14 10:54:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 10:54:16.582547 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b2edf9-e381-42c0-aeb6-81210ca79cbb None None] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:54:16.591318 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b49a859-6205-49a3-9720-488e03b22831 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:54:16.592418 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b49a859-6205-49a3-9720-488e03b22831 admin admin] REQUEST_METHOD: `POST` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:16.592942 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b49a859-6205-49a3-9720-488e03b22831 admin admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:16.593262 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b49a859-6205-49a3-9720-488e03b22831 admin admin] PATH_INFO: `/v3/projects` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:16.594162 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b49a859-6205-49a3-9720-488e03b22831 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:54:16.596327 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b49a859-6205-49a3-9720-488e03b22831 admin admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:54:16.649055 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a06369-95d2-409e-a993-11917f2bb943 admin admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:54:16.649205 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 1150/2281] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Jul 14 10:54:16 2022] POST /identity/v3/projects => generated 385 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:54:16.670693 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a06369-95d2-409e-a993-11917f2bb943 admin admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:54:16.752663 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9275d6a0-cdd7-4d35-b33e-0387bc74b2c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:54:16.753635 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9275d6a0-cdd7-4d35-b33e-0387bc74b2c6 admin admin] REQUEST_METHOD: `POST` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:16.754284 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9275d6a0-cdd7-4d35-b33e-0387bc74b2c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:16.754574 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9275d6a0-cdd7-4d35-b33e-0387bc74b2c6 admin admin] PATH_INFO: `/v3/users` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:16.755288 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9275d6a0-cdd7-4d35-b33e-0387bc74b2c6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:54:16.757297 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9275d6a0-cdd7-4d35-b33e-0387bc74b2c6 admin admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:54:16.786300 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 1132/2282] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Jul 14 10:54:16 2022] POST /identity/v3/users => generated 293 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:54:16.791095 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b49a859-6205-49a3-9720-488e03b22831 admin admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:54:16.803058 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b49a859-6205-49a3-9720-488e03b22831 admin admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:54:16.808149 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcfebd4-14ac-4872-afe3-9f78af161878 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:54:16.809472 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcfebd4-14ac-4872-afe3-9f78af161878 admin admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:16.809855 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcfebd4-14ac-4872-afe3-9f78af161878 admin admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:16.810229 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcfebd4-14ac-4872-afe3-9f78af161878 admin admin] PATH_INFO: `/v3/roles` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:16.811134 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bcfebd4-14ac-4872-afe3-9f78af161878 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:54:16.812811 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bcfebd4-14ac-4872-afe3-9f78af161878 admin admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:54:16.825284 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 1151/2283] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jul 14 10:54:16 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 10:54:16.829223 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9275d6a0-cdd7-4d35-b33e-0387bc74b2c6 admin admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:54:16.839794 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9275d6a0-cdd7-4d35-b33e-0387bc74b2c6 admin admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:54:16.845588 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69694fcd-3cb3-4e2b-8fc8-95a5b0130691 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:54:16.846379 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69694fcd-3cb3-4e2b-8fc8-95a5b0130691 admin admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:16.846750 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69694fcd-3cb3-4e2b-8fc8-95a5b0130691 admin admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:16.847086 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69694fcd-3cb3-4e2b-8fc8-95a5b0130691 admin admin] PATH_INFO: `/v3/roles` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:16.848123 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69694fcd-3cb3-4e2b-8fc8-95a5b0130691 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:54:16.849827 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69694fcd-3cb3-4e2b-8fc8-95a5b0130691 admin admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:54:16.862128 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 1133/2284] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jul 14 10:54:16 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:54:16.867470 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcfebd4-14ac-4872-afe3-9f78af161878 admin admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:54:16.878401 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcfebd4-14ac-4872-afe3-9f78af161878 admin admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:54:16.883157 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1a065f-eed0-4407-887e-54da2a4a22bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:54:16.884045 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1a065f-eed0-4407-887e-54da2a4a22bc admin admin] REQUEST_METHOD: `PUT` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:16.884335 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1a065f-eed0-4407-887e-54da2a4a22bc admin admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:16.884620 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1a065f-eed0-4407-887e-54da2a4a22bc admin admin] PATH_INFO: `/v3/projects/3a4174b9c7f14b1fab03c6c36f1a0f6f/users/9343523c794744058bf3714e8cac8af7/roles/0da46c267d354cce81495dfdd56c1ec2` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:16.900211 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1a065f-eed0-4407-887e-54da2a4a22bc admin admin] RBAC: Authorizing `identity:create_grant(project_id=3a4174b9c7f14b1fab03c6c36f1a0f6f, user_id=9343523c794744058bf3714e8cac8af7, role_id=0da46c267d354cce81495dfdd56c1ec2)` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:54:16.903520 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1a065f-eed0-4407-887e-54da2a4a22bc admin admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:54:16.918017 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 1152/2285] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Jul 14 10:54:16 2022] PUT /identity/v3/projects/3a4174b9c7f14b1fab03c6c36f1a0f6f/users/9343523c794744058bf3714e8cac8af7/roles/0da46c267d354cce81495dfdd56c1ec2 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:54:16.929279 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a717ea87-49a7-489f-a6d7-92d7ebeb574a None None] REQUEST_METHOD: `POST` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:16.929646 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a717ea87-49a7-489f-a6d7-92d7ebeb574a None None] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:16.929995 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a717ea87-49a7-489f-a6d7-92d7ebeb574a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:16.961617 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.auth.core [None req-a717ea87-49a7-489f-a6d7-92d7ebeb574a None None] MFA Rules not processed for user `9343523c794744058bf3714e8cac8af7`. Rule list: `[]` (Enabled: `True`). {{(pid=86656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:54:16.962906 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-a717ea87-49a7-489f-a6d7-92d7ebeb574a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:54:17.030421 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 1134/2286] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jul 14 10:54:16 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:54:17.044970 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1a065f-eed0-4407-887e-54da2a4a22bc admin admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:54:17.046702 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-cb1a065f-eed0-4407-887e-54da2a4a22bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:54:17.109633 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1a065f-eed0-4407-887e-54da2a4a22bc admin admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:54:17.113304 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d556bc-8496-44db-bede-be77d0384d50 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68382432147a48c3b62271fd2a2eab04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59391272ecbe48b0aa736cb43807be1d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:54:17.113955 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d556bc-8496-44db-bede-be77d0384d50 service cinder] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:17.114241 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d556bc-8496-44db-bede-be77d0384d50 service cinder] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:17.114521 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d556bc-8496-44db-bede-be77d0384d50 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:17.124301 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d556bc-8496-44db-bede-be77d0384d50 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:54:17.125104 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d556bc-8496-44db-bede-be77d0384d50 service cinder] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:54:17.134793 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 1153/2287] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jul 14 10:54:17 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:54:17.158350 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a717ea87-49a7-489f-a6d7-92d7ebeb574a None None] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:54:17.249995 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a717ea87-49a7-489f-a6d7-92d7ebeb574a None None] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:54:17.255801 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52186730-3896-494f-90b6-4365117caa68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:54:17.256814 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52186730-3896-494f-90b6-4365117caa68 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:17.257118 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52186730-3896-494f-90b6-4365117caa68 admin admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:17.257380 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52186730-3896-494f-90b6-4365117caa68 admin admin] PATH_INFO: `/v3/users/9343523c794744058bf3714e8cac8af7` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:17.258816 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52186730-3896-494f-90b6-4365117caa68 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9343523c794744058bf3714e8cac8af7)` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:54:17.260750 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52186730-3896-494f-90b6-4365117caa68 admin admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:54:17.263034 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:54:17.343771 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-52186730-3896-494f-90b6-4365117caa68 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9343523c794744058bf3714e8cac8af7'} {{(pid=86656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:54:17.351856 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-52186730-3896-494f-90b6-4365117caa68 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9343523c794744058bf3714e8cac8af7'} {{(pid=86656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:54:17.352556 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-52186730-3896-494f-90b6-4365117caa68 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9343523c794744058bf3714e8cac8af7'} {{(pid=86656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:54:17.361145 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-52186730-3896-494f-90b6-4365117caa68 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9343523c794744058bf3714e8cac8af7'} {{(pid=86656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:54:17.361852 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-52186730-3896-494f-90b6-4365117caa68 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9343523c794744058bf3714e8cac8af7'} {{(pid=86656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:54:17.391878 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 1135/2288] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Jul 14 10:54:17 2022] DELETE /identity/v3/users/9343523c794744058bf3714e8cac8af7 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:54:17.393894 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767a2e64-1acc-4654-93c1-f18d2dafba62 None None] REQUEST_METHOD: `POST` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:17.394283 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767a2e64-1acc-4654-93c1-f18d2dafba62 None None] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:17.394786 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767a2e64-1acc-4654-93c1-f18d2dafba62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:17.413077 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.auth.core [None req-767a2e64-1acc-4654-93c1-f18d2dafba62 None None] MFA Rules not processed for user `ae4bcdd8106d4bebbdcae96be33505bc`. Rule list: `[]` (Enabled: `True`). {{(pid=86655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:54:17.414503 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-767a2e64-1acc-4654-93c1-f18d2dafba62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:54:17.521671 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 1154/2289] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jul 14 10:54:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:54:17.531332 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52186730-3896-494f-90b6-4365117caa68 admin admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:54:17.532999 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-52186730-3896-494f-90b6-4365117caa68 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:54:17.609884 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52186730-3896-494f-90b6-4365117caa68 admin admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:54:17.613953 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f7eb9b-1106-4229-947a-9999e79d142c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dddf93691844886982c91fea974385d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59391272ecbe48b0aa736cb43807be1d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:54:17.614774 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f7eb9b-1106-4229-947a-9999e79d142c service neutron] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:17.615227 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f7eb9b-1106-4229-947a-9999e79d142c service neutron] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:17.615699 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f7eb9b-1106-4229-947a-9999e79d142c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:17.626965 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f7eb9b-1106-4229-947a-9999e79d142c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:54:17.628413 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f7eb9b-1106-4229-947a-9999e79d142c service neutron] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:54:17.639648 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 1136/2290] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jul 14 10:54:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:54:18.041411 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767a2e64-1acc-4654-93c1-f18d2dafba62 None None] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:54:18.042784 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-767a2e64-1acc-4654-93c1-f18d2dafba62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:54:18.057946 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767a2e64-1acc-4654-93c1-f18d2dafba62 None None] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:54:18.077566 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762bc7fe-7b60-4af8-b914-038ed96ba19e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:54:18.078591 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762bc7fe-7b60-4af8-b914-038ed96ba19e admin admin] REQUEST_METHOD: `DELETE` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:18.078976 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762bc7fe-7b60-4af8-b914-038ed96ba19e admin admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:18.079384 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762bc7fe-7b60-4af8-b914-038ed96ba19e admin admin] PATH_INFO: `/v3/projects/3a4174b9c7f14b1fab03c6c36f1a0f6f` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:18.081808 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762bc7fe-7b60-4af8-b914-038ed96ba19e admin admin] RBAC: Authorizing `identity:delete_project(project_id=3a4174b9c7f14b1fab03c6c36f1a0f6f)` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:54:18.087114 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762bc7fe-7b60-4af8-b914-038ed96ba19e admin admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:54:18.135804 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:54:18.146051 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-762bc7fe-7b60-4af8-b914-038ed96ba19e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3a4174b9c7f14b1fab03c6c36f1a0f6f', 'request_id': 'req-762bc7fe-7b60-4af8-b914-038ed96ba19e'} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:54:18.153732 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-762bc7fe-7b60-4af8-b914-038ed96ba19e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3a4174b9c7f14b1fab03c6c36f1a0f6f', 'request_id': 'req-762bc7fe-7b60-4af8-b914-038ed96ba19e'} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:54:18.162039 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-762bc7fe-7b60-4af8-b914-038ed96ba19e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3a4174b9c7f14b1fab03c6c36f1a0f6f', 'request_id': 'req-762bc7fe-7b60-4af8-b914-038ed96ba19e'} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:54:18.175175 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-762bc7fe-7b60-4af8-b914-038ed96ba19e admin admin] The token cache is being invalidate because project 3a4174b9c7f14b1fab03c6c36f1a0f6f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86655) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 10:54:18.175470 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-762bc7fe-7b60-4af8-b914-038ed96ba19e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:54:18.176454 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-762bc7fe-7b60-4af8-b914-038ed96ba19e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:54:18.178573 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 1155/2291] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Jul 14 10:54:18 2022] DELETE /identity/v3/projects/3a4174b9c7f14b1fab03c6c36f1a0f6f => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:54:18.183138 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10decaf8-f382-443e-bf40-1dda4c54d1f2 None None] REQUEST_METHOD: `POST` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:18.183429 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10decaf8-f382-443e-bf40-1dda4c54d1f2 None None] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:18.183705 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10decaf8-f382-443e-bf40-1dda4c54d1f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:18.204957 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.auth.core [None req-10decaf8-f382-443e-bf40-1dda4c54d1f2 None None] MFA Rules not processed for user `ae4bcdd8106d4bebbdcae96be33505bc`. Rule list: `[]` (Enabled: `True`). {{(pid=86656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:54:18.206199 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-10decaf8-f382-443e-bf40-1dda4c54d1f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:54:18.275718 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 1137/2292] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jul 14 10:54:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 10:54:18.283290 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455efb4b-9cab-4ffa-9a4a-370e65559eb7 None None] REQUEST_METHOD: `POST` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:18.283588 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455efb4b-9cab-4ffa-9a4a-370e65559eb7 None None] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:18.283930 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455efb4b-9cab-4ffa-9a4a-370e65559eb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:18.303989 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.auth.core [None req-455efb4b-9cab-4ffa-9a4a-370e65559eb7 None None] MFA Rules not processed for user `ae4bcdd8106d4bebbdcae96be33505bc`. Rule list: `[]` (Enabled: `True`). {{(pid=86655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:54:18.305302 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-455efb4b-9cab-4ffa-9a4a-370e65559eb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:54:18.317741 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 1156/2293] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jul 14 10:54:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:54:18.322208 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10decaf8-f382-443e-bf40-1dda4c54d1f2 None None] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:54:18.332452 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10decaf8-f382-443e-bf40-1dda4c54d1f2 None None] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:54:18.337012 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86d26dd-370e-434a-b774-68312d9c714d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:54:18.337662 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86d26dd-370e-434a-b774-68312d9c714d admin admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:18.337948 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86d26dd-370e-434a-b774-68312d9c714d admin admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:18.338226 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86d26dd-370e-434a-b774-68312d9c714d admin admin] PATH_INFO: `/v3/domains` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:18.338952 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86d26dd-370e-434a-b774-68312d9c714d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:54:18.339259 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86d26dd-370e-434a-b774-68312d9c714d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:54:18.341204 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86d26dd-370e-434a-b774-68312d9c714d admin admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:54:18.352822 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 1138/2294] 10.222.0.16 () {58 vars in 1152 bytes} [Thu Jul 14 10:54:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:54:18.357443 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455efb4b-9cab-4ffa-9a4a-370e65559eb7 None None] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:54:18.367078 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455efb4b-9cab-4ffa-9a4a-370e65559eb7 None None] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:54:18.372408 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6d0236-6af5-4113-bd89-2c1e43d3f479 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:54:18.373091 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6d0236-6af5-4113-bd89-2c1e43d3f479 admin admin] REQUEST_METHOD: `POST` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:18.373380 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6d0236-6af5-4113-bd89-2c1e43d3f479 admin admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:18.373657 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6d0236-6af5-4113-bd89-2c1e43d3f479 admin admin] PATH_INFO: `/v3/projects` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:18.374346 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6d0236-6af5-4113-bd89-2c1e43d3f479 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:54:18.376235 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6d0236-6af5-4113-bd89-2c1e43d3f479 admin admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:54:18.402315 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 1157/2295] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Jul 14 10:54:18 2022] POST /identity/v3/projects => generated 371 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:54:18.407832 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86d26dd-370e-434a-b774-68312d9c714d admin admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:54:18.418748 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86d26dd-370e-434a-b774-68312d9c714d admin admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:54:18.423552 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:54:18.482136 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7baca9-1efb-41b3-897b-2a214127ca2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:54:18.482852 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7baca9-1efb-41b3-897b-2a214127ca2c admin admin] REQUEST_METHOD: `POST` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:18.483143 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7baca9-1efb-41b3-897b-2a214127ca2c admin admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:18.483419 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7baca9-1efb-41b3-897b-2a214127ca2c admin admin] PATH_INFO: `/v3/users` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:18.484117 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7baca9-1efb-41b3-897b-2a214127ca2c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:54:18.486080 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7baca9-1efb-41b3-897b-2a214127ca2c admin admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:54:18.508857 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 1139/2296] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Jul 14 10:54:18 2022] POST /identity/v3/users => generated 286 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:54:18.510590 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6d0236-6af5-4113-bd89-2c1e43d3f479 admin admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:54:18.521537 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6d0236-6af5-4113-bd89-2c1e43d3f479 admin admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:54:18.527254 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1340931-7e22-46d9-bfbd-245a8df32ea8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:54:18.527907 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1340931-7e22-46d9-bfbd-245a8df32ea8 admin admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:18.528194 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1340931-7e22-46d9-bfbd-245a8df32ea8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:18.528470 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1340931-7e22-46d9-bfbd-245a8df32ea8 admin admin] PATH_INFO: `/v3/roles` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:18.529819 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1340931-7e22-46d9-bfbd-245a8df32ea8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:54:18.531424 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1340931-7e22-46d9-bfbd-245a8df32ea8 admin admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:54:18.546177 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 1158/2297] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jul 14 10:54:18 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:54:18.550210 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7baca9-1efb-41b3-897b-2a214127ca2c admin admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:54:18.563963 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7baca9-1efb-41b3-897b-2a214127ca2c admin admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:54:18.572304 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f25474-7c1e-42fc-b65e-72f27984853d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:54:18.573049 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f25474-7c1e-42fc-b65e-72f27984853d admin admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:18.573336 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f25474-7c1e-42fc-b65e-72f27984853d admin admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:18.573618 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f25474-7c1e-42fc-b65e-72f27984853d admin admin] PATH_INFO: `/v3/roles` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:18.574376 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f25474-7c1e-42fc-b65e-72f27984853d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:54:18.576106 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f25474-7c1e-42fc-b65e-72f27984853d admin admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:54:18.586821 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 1140/2298] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jul 14 10:54:18 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:54:18.592132 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1340931-7e22-46d9-bfbd-245a8df32ea8 admin admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:54:18.603334 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1340931-7e22-46d9-bfbd-245a8df32ea8 admin admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:54:18.609189 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab0505d-e963-430e-ad8d-12048b4e2027 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:54:18.610118 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab0505d-e963-430e-ad8d-12048b4e2027 admin admin] REQUEST_METHOD: `PUT` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:18.610411 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab0505d-e963-430e-ad8d-12048b4e2027 admin admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:18.610692 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab0505d-e963-430e-ad8d-12048b4e2027 admin admin] PATH_INFO: `/v3/projects/5c1608af4e6b468c898482fc78655ed3/users/d8d1c8a2e1a94ebbbb44e8fb61b4c180/roles/0da46c267d354cce81495dfdd56c1ec2` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:18.627654 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab0505d-e963-430e-ad8d-12048b4e2027 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5c1608af4e6b468c898482fc78655ed3, user_id=d8d1c8a2e1a94ebbbb44e8fb61b4c180, role_id=0da46c267d354cce81495dfdd56c1ec2)` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:54:18.630407 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab0505d-e963-430e-ad8d-12048b4e2027 admin admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:54:18.644487 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 1159/2299] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Jul 14 10:54:18 2022] PUT /identity/v3/projects/5c1608af4e6b468c898482fc78655ed3/users/d8d1c8a2e1a94ebbbb44e8fb61b4c180/roles/0da46c267d354cce81495dfdd56c1ec2 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:54:18.654859 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05db330f-5adc-4815-8477-0046c4b48a23 None None] REQUEST_METHOD: `POST` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:18.655162 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05db330f-5adc-4815-8477-0046c4b48a23 None None] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:18.655443 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05db330f-5adc-4815-8477-0046c4b48a23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:18.683210 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.auth.core [None req-05db330f-5adc-4815-8477-0046c4b48a23 None None] MFA Rules not processed for user `d8d1c8a2e1a94ebbbb44e8fb61b4c180`. Rule list: `[]` (Enabled: `True`). {{(pid=86656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:54:18.685130 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-05db330f-5adc-4815-8477-0046c4b48a23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:54:18.750607 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 1141/2300] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jul 14 10:54:18 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:54:18.761773 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab0505d-e963-430e-ad8d-12048b4e2027 admin admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:54:18.763526 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-0ab0505d-e963-430e-ad8d-12048b4e2027 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:54:18.822513 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab0505d-e963-430e-ad8d-12048b4e2027 admin admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:54:18.826545 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a020f7-8399-41a6-bd78-70e57ba1c6d0 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cb877bf3f8241dcb2ecbb612c7f4f69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59391272ecbe48b0aa736cb43807be1d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:54:18.827203 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a020f7-8399-41a6-bd78-70e57ba1c6d0 service glance] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:18.827493 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a020f7-8399-41a6-bd78-70e57ba1c6d0 service glance] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:18.827776 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a020f7-8399-41a6-bd78-70e57ba1c6d0 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:18.836052 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a020f7-8399-41a6-bd78-70e57ba1c6d0 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:54:18.837520 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a020f7-8399-41a6-bd78-70e57ba1c6d0 service glance] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:54:18.846890 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 1160/2301] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jul 14 10:54:18 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:54:21.792685 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7486d57-97af-4a6d-93e1-a9035b7d4fed None None] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:21.793098 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7486d57-97af-4a6d-93e1-a9035b7d4fed None None] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:21.793098 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7486d57-97af-4a6d-93e1-a9035b7d4fed None None] PATH_INFO: `/` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:21.794883 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 1142/2302] 10.222.0.16 () {54 vars in 921 bytes} [Thu Jul 14 10:54:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:54:21.814882 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d08bd4f-a769-41a2-88ef-019b22522159 None None] REQUEST_METHOD: `POST` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:21.816502 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d08bd4f-a769-41a2-88ef-019b22522159 None None] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:21.817048 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d08bd4f-a769-41a2-88ef-019b22522159 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:21.823696 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7486d57-97af-4a6d-93e1-a9035b7d4fed None None] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:54:21.826137 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-e7486d57-97af-4a6d-93e1-a9035b7d4fed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:54:21.841023 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.auth.core [None req-5d08bd4f-a769-41a2-88ef-019b22522159 None None] MFA Rules not processed for user `16846111ee2a42dd99c3052d40980f72`. Rule list: `[]` (Enabled: `True`). {{(pid=86655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:54:21.842517 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-5d08bd4f-a769-41a2-88ef-019b22522159 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:54:21.913808 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7486d57-97af-4a6d-93e1-a9035b7d4fed None None] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:54:21.918958 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f191704e-2666-42a5-a9e3-c9ef07a83b85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:54:21.919865 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f191704e-2666-42a5-a9e3-c9ef07a83b85 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:21.920268 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f191704e-2666-42a5-a9e3-c9ef07a83b85 admin admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:21.920700 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f191704e-2666-42a5-a9e3-c9ef07a83b85 admin admin] PATH_INFO: `/v3/users/10e895f2ec794c11a45d45f6ab463799` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:21.922209 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f191704e-2666-42a5-a9e3-c9ef07a83b85 admin admin] RBAC: Authorizing `identity:delete_user(user_id=10e895f2ec794c11a45d45f6ab463799)` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:54:21.922934 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 1161/2303] 10.222.0.16 () {58 vars in 1018 bytes} [Thu Jul 14 10:54:21 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:54:21.923839 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d08bd4f-a769-41a2-88ef-019b22522159 None None] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:54:21.926743 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f191704e-2666-42a5-a9e3-c9ef07a83b85 admin admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:54:21.928634 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-5d08bd4f-a769-41a2-88ef-019b22522159 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:54:21.942736 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:54:21.948546 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d08bd4f-a769-41a2-88ef-019b22522159 None None] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:54:21.959558 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2cf871-f280-4cb0-a789-6395235ca62d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:54:21.961559 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2cf871-f280-4cb0-a789-6395235ca62d admin admin] REQUEST_METHOD: `DELETE` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:21.961863 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2cf871-f280-4cb0-a789-6395235ca62d admin admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:21.962123 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2cf871-f280-4cb0-a789-6395235ca62d admin admin] PATH_INFO: `/v3/users/7a8d60520be840a181ffc48b3811255a` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:21.963499 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2cf871-f280-4cb0-a789-6395235ca62d admin admin] RBAC: Authorizing `identity:delete_user(user_id=7a8d60520be840a181ffc48b3811255a)` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:54:21.965918 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2cf871-f280-4cb0-a789-6395235ca62d admin admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:54:21.968434 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=95,keystone:INSERT=3,keystone:DELETE=2 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:54:21.997883 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-f191704e-2666-42a5-a9e3-c9ef07a83b85 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '10e895f2ec794c11a45d45f6ab463799'} {{(pid=86656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:54:22.005895 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-f191704e-2666-42a5-a9e3-c9ef07a83b85 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '10e895f2ec794c11a45d45f6ab463799'} {{(pid=86656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:54:22.006622 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-f191704e-2666-42a5-a9e3-c9ef07a83b85 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '10e895f2ec794c11a45d45f6ab463799'} {{(pid=86656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:54:22.015670 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-f191704e-2666-42a5-a9e3-c9ef07a83b85 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '10e895f2ec794c11a45d45f6ab463799'} {{(pid=86656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:54:22.017107 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-f191704e-2666-42a5-a9e3-c9ef07a83b85 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '10e895f2ec794c11a45d45f6ab463799'} {{(pid=86656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:54:22.022753 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-7b2cf871-f280-4cb0-a789-6395235ca62d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7a8d60520be840a181ffc48b3811255a'} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:54:22.031605 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-7b2cf871-f280-4cb0-a789-6395235ca62d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7a8d60520be840a181ffc48b3811255a'} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:54:22.032271 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-7b2cf871-f280-4cb0-a789-6395235ca62d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7a8d60520be840a181ffc48b3811255a'} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:54:22.037254 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 1143/2304] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Jul 14 10:54:21 2022] DELETE /identity/v3/users/10e895f2ec794c11a45d45f6ab463799 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 10:54:22.038195 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f191704e-2666-42a5-a9e3-c9ef07a83b85 admin admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:54:22.040116 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-f191704e-2666-42a5-a9e3-c9ef07a83b85 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:54:22.045550 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-7b2cf871-f280-4cb0-a789-6395235ca62d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7a8d60520be840a181ffc48b3811255a'} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:54:22.048023 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-7b2cf871-f280-4cb0-a789-6395235ca62d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7a8d60520be840a181ffc48b3811255a'} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:54:22.075134 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 1162/2305] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Jul 14 10:54:21 2022] DELETE /identity/v3/users/7a8d60520be840a181ffc48b3811255a => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:54:22.076810 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0952fd-cfdc-44b5-a0c8-4f1609e6a176 None None] REQUEST_METHOD: `POST` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:22.077280 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0952fd-cfdc-44b5-a0c8-4f1609e6a176 None None] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:22.077565 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0952fd-cfdc-44b5-a0c8-4f1609e6a176 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:22.097862 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.auth.core [None req-0d0952fd-cfdc-44b5-a0c8-4f1609e6a176 None None] MFA Rules not processed for user `ae4bcdd8106d4bebbdcae96be33505bc`. Rule list: `[]` (Enabled: `True`). {{(pid=86655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:54:22.099276 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-0d0952fd-cfdc-44b5-a0c8-4f1609e6a176 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:54:22.134766 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f191704e-2666-42a5-a9e3-c9ef07a83b85 admin admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:54:22.170160 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 1163/2306] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jul 14 10:54:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:54:22.185261 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0952fd-cfdc-44b5-a0c8-4f1609e6a176 None None] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:54:22.187913 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-0d0952fd-cfdc-44b5-a0c8-4f1609e6a176 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:54:22.225899 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244ae55c-4a79-443d-a91e-056b40197098 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16846111ee2a42dd99c3052d40980f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59391272ecbe48b0aa736cb43807be1d', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:54:22.226576 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244ae55c-4a79-443d-a91e-056b40197098 service placement] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:22.226869 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244ae55c-4a79-443d-a91e-056b40197098 service placement] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:22.227147 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244ae55c-4a79-443d-a91e-056b40197098 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:22.229264 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-244ae55c-4a79-443d-a91e-056b40197098 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:54:22.242837 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244ae55c-4a79-443d-a91e-056b40197098 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:54:22.244705 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244ae55c-4a79-443d-a91e-056b40197098 service placement] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:54:22.257226 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 1144/2307] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jul 14 10:54:22 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:54:22.271488 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0952fd-cfdc-44b5-a0c8-4f1609e6a176 None None] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:54:22.276747 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3360861c-d1d8-47d3-9fec-50580eb3b210 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dddf93691844886982c91fea974385d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59391272ecbe48b0aa736cb43807be1d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:54:22.278381 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3360861c-d1d8-47d3-9fec-50580eb3b210 service neutron] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:22.278740 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3360861c-d1d8-47d3-9fec-50580eb3b210 service neutron] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:22.279345 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3360861c-d1d8-47d3-9fec-50580eb3b210 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:22.291837 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3360861c-d1d8-47d3-9fec-50580eb3b210 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:54:22.293907 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3360861c-d1d8-47d3-9fec-50580eb3b210 service neutron] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:54:22.302004 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244ae55c-4a79-443d-a91e-056b40197098 service placement] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:54:22.303475 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-244ae55c-4a79-443d-a91e-056b40197098 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:54:22.310369 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 1164/2308] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jul 14 10:54:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 10:54:22.323779 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244ae55c-4a79-443d-a91e-056b40197098 service placement] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:54:22.332270 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83667456-a895-4602-bb72-bba223b666ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:54:22.335785 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83667456-a895-4602-bb72-bba223b666ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:22.336082 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83667456-a895-4602-bb72-bba223b666ec admin admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:22.336417 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83667456-a895-4602-bb72-bba223b666ec admin admin] PATH_INFO: `/v3/users/dce2641582d4434c9657d4335d70f964` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:22.338106 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83667456-a895-4602-bb72-bba223b666ec admin admin] RBAC: Authorizing `identity:delete_user(user_id=dce2641582d4434c9657d4335d70f964)` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:54:22.341145 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83667456-a895-4602-bb72-bba223b666ec admin admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:54:22.375257 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:DELETE=12,keystone:SELECT=87,keystone:INSERT=1 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:54:22.376721 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3360861c-d1d8-47d3-9fec-50580eb3b210 service neutron] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:54:22.383759 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-3360861c-d1d8-47d3-9fec-50580eb3b210 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:54:22.411970 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3360861c-d1d8-47d3-9fec-50580eb3b210 service neutron] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:54:22.428605 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0863f499-a852-4164-a9c8-edb171cc6e53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:54:22.431356 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0863f499-a852-4164-a9c8-edb171cc6e53 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:22.432265 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-83667456-a895-4602-bb72-bba223b666ec admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dce2641582d4434c9657d4335d70f964'} {{(pid=86656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:54:22.432470 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0863f499-a852-4164-a9c8-edb171cc6e53 admin admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:22.433247 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0863f499-a852-4164-a9c8-edb171cc6e53 admin admin] PATH_INFO: `/v3/projects/30e2ca082e514ba2b3a6a96f3d6e3df4` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:22.436662 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0863f499-a852-4164-a9c8-edb171cc6e53 admin admin] RBAC: Authorizing `identity:delete_project(project_id=30e2ca082e514ba2b3a6a96f3d6e3df4)` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:54:22.439985 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0863f499-a852-4164-a9c8-edb171cc6e53 admin admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:54:22.445166 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-83667456-a895-4602-bb72-bba223b666ec admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dce2641582d4434c9657d4335d70f964'} {{(pid=86656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:54:22.445982 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-83667456-a895-4602-bb72-bba223b666ec admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dce2641582d4434c9657d4335d70f964'} {{(pid=86656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:54:22.462342 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-83667456-a895-4602-bb72-bba223b666ec admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dce2641582d4434c9657d4335d70f964'} {{(pid=86656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:54:22.463364 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-83667456-a895-4602-bb72-bba223b666ec admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dce2641582d4434c9657d4335d70f964'} {{(pid=86656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:54:22.470026 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:54:22.501075 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 1145/2309] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Jul 14 10:54:22 2022] DELETE /identity/v3/users/dce2641582d4434c9657d4335d70f964 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 10:54:22.503528 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfaaed6-a0fa-4f3e-85f5-dde81f7a4d2b None None] REQUEST_METHOD: `POST` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:22.503718 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfaaed6-a0fa-4f3e-85f5-dde81f7a4d2b None None] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:22.504142 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfaaed6-a0fa-4f3e-85f5-dde81f7a4d2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:22.509816 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-0863f499-a852-4164-a9c8-edb171cc6e53 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '30e2ca082e514ba2b3a6a96f3d6e3df4', 'request_id': 'req-0863f499-a852-4164-a9c8-edb171cc6e53'} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:54:22.516929 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-0863f499-a852-4164-a9c8-edb171cc6e53 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '30e2ca082e514ba2b3a6a96f3d6e3df4', 'request_id': 'req-0863f499-a852-4164-a9c8-edb171cc6e53'} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:54:22.535077 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.auth.core [None req-fcfaaed6-a0fa-4f3e-85f5-dde81f7a4d2b None None] MFA Rules not processed for user `ae4bcdd8106d4bebbdcae96be33505bc`. Rule list: `[]` (Enabled: `True`). {{(pid=86656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:54:22.536923 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-fcfaaed6-a0fa-4f3e-85f5-dde81f7a4d2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:54:22.539654 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-0863f499-a852-4164-a9c8-edb171cc6e53 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '30e2ca082e514ba2b3a6a96f3d6e3df4', 'request_id': 'req-0863f499-a852-4164-a9c8-edb171cc6e53'} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:54:22.568150 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-0863f499-a852-4164-a9c8-edb171cc6e53 admin admin] The token cache is being invalidate because project 30e2ca082e514ba2b3a6a96f3d6e3df4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86655) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 10:54:22.569046 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-0863f499-a852-4164-a9c8-edb171cc6e53 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:54:22.569981 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-0863f499-a852-4164-a9c8-edb171cc6e53 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:54:22.572543 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 1165/2310] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Jul 14 10:54:22 2022] DELETE /identity/v3/projects/30e2ca082e514ba2b3a6a96f3d6e3df4 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 10:54:22.576847 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0863f499-a852-4164-a9c8-edb171cc6e53 admin admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:54:22.578466 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-0863f499-a852-4164-a9c8-edb171cc6e53 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:54:22.626472 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 1146/2311] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jul 14 10:54:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 10:54:22.638699 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfaaed6-a0fa-4f3e-85f5-dde81f7a4d2b None None] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:54:22.640121 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-fcfaaed6-a0fa-4f3e-85f5-dde81f7a4d2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:54:22.687025 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0863f499-a852-4164-a9c8-edb171cc6e53 admin admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:54:22.705202 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab32208-7672-4e08-a3d9-6115aecab27a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:54:22.706333 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab32208-7672-4e08-a3d9-6115aecab27a admin admin] REQUEST_METHOD: `DELETE` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:22.706765 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab32208-7672-4e08-a3d9-6115aecab27a admin admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:22.707166 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab32208-7672-4e08-a3d9-6115aecab27a admin admin] PATH_INFO: `/v3/users/56505ea13745436ba9e0d35b7e481732` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:22.709495 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab32208-7672-4e08-a3d9-6115aecab27a admin admin] RBAC: Authorizing `identity:delete_user(user_id=56505ea13745436ba9e0d35b7e481732)` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:54:22.714114 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab32208-7672-4e08-a3d9-6115aecab27a admin admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:54:22.720790 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfaaed6-a0fa-4f3e-85f5-dde81f7a4d2b None None] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:54:22.727351 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ba6c47-7a1a-4dea-85b5-a4b008ccc0bf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dddf93691844886982c91fea974385d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59391272ecbe48b0aa736cb43807be1d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:54:22.728270 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ba6c47-7a1a-4dea-85b5-a4b008ccc0bf service neutron] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:22.728390 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ba6c47-7a1a-4dea-85b5-a4b008ccc0bf service neutron] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:22.728654 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ba6c47-7a1a-4dea-85b5-a4b008ccc0bf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:22.743170 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ba6c47-7a1a-4dea-85b5-a4b008ccc0bf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:54:22.744921 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ba6c47-7a1a-4dea-85b5-a4b008ccc0bf service neutron] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:54:22.762280 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 1147/2312] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jul 14 10:54:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 10:54:22.763268 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ba6c47-7a1a-4dea-85b5-a4b008ccc0bf service neutron] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:54:22.764650 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-50ba6c47-7a1a-4dea-85b5-a4b008ccc0bf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:54:22.778410 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ba6c47-7a1a-4dea-85b5-a4b008ccc0bf service neutron] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:54:22.796313 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50bd6da-5a2c-42b2-a31f-79a32a6bd8a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:54:22.798198 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50bd6da-5a2c-42b2-a31f-79a32a6bd8a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:22.798740 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50bd6da-5a2c-42b2-a31f-79a32a6bd8a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:22.799164 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50bd6da-5a2c-42b2-a31f-79a32a6bd8a6 admin admin] PATH_INFO: `/v3/projects/ad01cd79b23249d6b47a49fe5def929d` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:22.802765 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50bd6da-5a2c-42b2-a31f-79a32a6bd8a6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ad01cd79b23249d6b47a49fe5def929d)` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:54:22.805742 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50bd6da-5a2c-42b2-a31f-79a32a6bd8a6 admin admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:54:22.809950 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-eab32208-7672-4e08-a3d9-6115aecab27a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '56505ea13745436ba9e0d35b7e481732'} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:54:22.820414 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-eab32208-7672-4e08-a3d9-6115aecab27a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '56505ea13745436ba9e0d35b7e481732'} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:54:22.821279 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-eab32208-7672-4e08-a3d9-6115aecab27a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '56505ea13745436ba9e0d35b7e481732'} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:54:22.834574 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-eab32208-7672-4e08-a3d9-6115aecab27a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '56505ea13745436ba9e0d35b7e481732'} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:54:22.835331 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-eab32208-7672-4e08-a3d9-6115aecab27a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '56505ea13745436ba9e0d35b7e481732'} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:54:22.864286 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 1166/2313] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Jul 14 10:54:22 2022] DELETE /identity/v3/users/56505ea13745436ba9e0d35b7e481732 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 10:54:22.882397 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:54:22.893823 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-d50bd6da-5a2c-42b2-a31f-79a32a6bd8a6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ad01cd79b23249d6b47a49fe5def929d', 'request_id': 'req-d50bd6da-5a2c-42b2-a31f-79a32a6bd8a6'} {{(pid=86656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:54:22.933105 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-d50bd6da-5a2c-42b2-a31f-79a32a6bd8a6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ad01cd79b23249d6b47a49fe5def929d', 'request_id': 'req-d50bd6da-5a2c-42b2-a31f-79a32a6bd8a6'} {{(pid=86656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:54:22.946735 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-d50bd6da-5a2c-42b2-a31f-79a32a6bd8a6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ad01cd79b23249d6b47a49fe5def929d', 'request_id': 'req-d50bd6da-5a2c-42b2-a31f-79a32a6bd8a6'} {{(pid=86656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:54:22.964105 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-d50bd6da-5a2c-42b2-a31f-79a32a6bd8a6 admin admin] The token cache is being invalidate because project ad01cd79b23249d6b47a49fe5def929d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86656) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 10:54:22.964485 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-d50bd6da-5a2c-42b2-a31f-79a32a6bd8a6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:54:22.965482 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-d50bd6da-5a2c-42b2-a31f-79a32a6bd8a6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:54:22.967399 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 1148/2314] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Jul 14 10:54:22 2022] DELETE /identity/v3/projects/ad01cd79b23249d6b47a49fe5def929d => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:54:22.972160 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3483709c-712e-4b21-abfe-a1a2e9c47a6d None None] REQUEST_METHOD: `POST` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:22.972525 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3483709c-712e-4b21-abfe-a1a2e9c47a6d None None] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:22.972907 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3483709c-712e-4b21-abfe-a1a2e9c47a6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:22.999087 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.auth.core [None req-3483709c-712e-4b21-abfe-a1a2e9c47a6d None None] MFA Rules not processed for user `ae4bcdd8106d4bebbdcae96be33505bc`. Rule list: `[]` (Enabled: `True`). {{(pid=86655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:54:23.000725 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-3483709c-712e-4b21-abfe-a1a2e9c47a6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:54:23.024816 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:54:23.080997 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 1167/2315] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jul 14 10:54:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:54:23.089116 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a99fe74-8934-4863-9268-e9d8bbd3cd76 None None] REQUEST_METHOD: `POST` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:23.089411 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a99fe74-8934-4863-9268-e9d8bbd3cd76 None None] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:23.089697 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a99fe74-8934-4863-9268-e9d8bbd3cd76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:23.112030 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.auth.core [None req-3a99fe74-8934-4863-9268-e9d8bbd3cd76 None None] MFA Rules not processed for user `ae4bcdd8106d4bebbdcae96be33505bc`. Rule list: `[]` (Enabled: `True`). {{(pid=86656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:54:23.114731 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-3a99fe74-8934-4863-9268-e9d8bbd3cd76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:54:23.122928 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 1149/2316] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jul 14 10:54:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 10:54:23.127230 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3483709c-712e-4b21-abfe-a1a2e9c47a6d None None] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:54:23.137472 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3483709c-712e-4b21-abfe-a1a2e9c47a6d None None] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:54:23.142226 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa85c4c0-c912-464d-89be-71c9cefcc341 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:54:23.142898 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa85c4c0-c912-464d-89be-71c9cefcc341 admin admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:23.143277 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa85c4c0-c912-464d-89be-71c9cefcc341 admin admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:23.143471 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa85c4c0-c912-464d-89be-71c9cefcc341 admin admin] PATH_INFO: `/v3/domains` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:23.144273 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa85c4c0-c912-464d-89be-71c9cefcc341 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:54:23.144588 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa85c4c0-c912-464d-89be-71c9cefcc341 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:54:23.146233 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa85c4c0-c912-464d-89be-71c9cefcc341 admin admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:54:23.160861 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 1168/2317] 10.222.0.16 () {58 vars in 1152 bytes} [Thu Jul 14 10:54:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:54:23.165239 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a99fe74-8934-4863-9268-e9d8bbd3cd76 None None] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:54:23.177027 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a99fe74-8934-4863-9268-e9d8bbd3cd76 None None] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:54:23.185656 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdb4cd2-4062-403b-870c-6ce8f6a1d2dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:54:23.187119 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdb4cd2-4062-403b-870c-6ce8f6a1d2dd admin admin] REQUEST_METHOD: `POST` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:23.187462 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdb4cd2-4062-403b-870c-6ce8f6a1d2dd admin admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:23.188119 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdb4cd2-4062-403b-870c-6ce8f6a1d2dd admin admin] PATH_INFO: `/v3/projects` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:23.189549 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acdb4cd2-4062-403b-870c-6ce8f6a1d2dd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:54:23.196984 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acdb4cd2-4062-403b-870c-6ce8f6a1d2dd admin admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:54:23.242373 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 1150/2318] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Jul 14 10:54:23 2022] POST /identity/v3/projects => generated 383 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:54:23.246877 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa85c4c0-c912-464d-89be-71c9cefcc341 admin admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:54:23.261751 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa85c4c0-c912-464d-89be-71c9cefcc341 admin admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:54:23.316308 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdb4cd2-4062-403b-870c-6ce8f6a1d2dd admin admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:54:23.319342 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-acdb4cd2-4062-403b-870c-6ce8f6a1d2dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:54:23.382816 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e3c687-d609-4e6a-9b5c-722d487466fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:54:23.383515 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e3c687-d609-4e6a-9b5c-722d487466fa admin admin] REQUEST_METHOD: `POST` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:23.383801 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e3c687-d609-4e6a-9b5c-722d487466fa admin admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:23.384554 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e3c687-d609-4e6a-9b5c-722d487466fa admin admin] PATH_INFO: `/v3/users` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:23.384823 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e3c687-d609-4e6a-9b5c-722d487466fa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:54:23.387379 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e3c687-d609-4e6a-9b5c-722d487466fa admin admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:54:23.416620 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 1169/2319] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Jul 14 10:54:23 2022] POST /identity/v3/users => generated 292 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:54:23.417508 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e3c687-d609-4e6a-9b5c-722d487466fa admin admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:54:23.421908 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-b0e3c687-d609-4e6a-9b5c-722d487466fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:54:23.438496 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e3c687-d609-4e6a-9b5c-722d487466fa admin admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:54:23.443198 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdb4cd2-4062-403b-870c-6ce8f6a1d2dd admin admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:54:23.446456 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f7ed95-1194-4021-a135-7b41d7dde97f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:54:23.448044 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f7ed95-1194-4021-a135-7b41d7dde97f admin admin] REQUEST_METHOD: `DELETE` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:23.448995 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f7ed95-1194-4021-a135-7b41d7dde97f admin admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:23.449094 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940660d4-64d4-4683-89dc-d0d50d22829b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:54:23.450060 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f7ed95-1194-4021-a135-7b41d7dde97f admin admin] PATH_INFO: `/v3/projects/233573f2e7f04bfab9041b97605e5ba3` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:23.451387 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940660d4-64d4-4683-89dc-d0d50d22829b admin admin] REQUEST_METHOD: `DELETE` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:23.451686 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940660d4-64d4-4683-89dc-d0d50d22829b admin admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:23.451974 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940660d4-64d4-4683-89dc-d0d50d22829b admin admin] PATH_INFO: `/v3/projects/e2b26230df5047bcba725e41934f02f1` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:23.452813 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f7ed95-1194-4021-a135-7b41d7dde97f admin admin] RBAC: Authorizing `identity:delete_project(project_id=233573f2e7f04bfab9041b97605e5ba3)` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:54:23.453461 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940660d4-64d4-4683-89dc-d0d50d22829b admin admin] RBAC: Authorizing `identity:delete_project(project_id=e2b26230df5047bcba725e41934f02f1)` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:54:23.454940 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f7ed95-1194-4021-a135-7b41d7dde97f admin admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:54:23.455464 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940660d4-64d4-4683-89dc-d0d50d22829b admin admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:54:23.521734 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-25f7ed95-1194-4021-a135-7b41d7dde97f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '233573f2e7f04bfab9041b97605e5ba3', 'request_id': 'req-25f7ed95-1194-4021-a135-7b41d7dde97f'} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:54:23.529989 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-25f7ed95-1194-4021-a135-7b41d7dde97f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '233573f2e7f04bfab9041b97605e5ba3', 'request_id': 'req-25f7ed95-1194-4021-a135-7b41d7dde97f'} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:54:23.530258 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-940660d4-64d4-4683-89dc-d0d50d22829b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e2b26230df5047bcba725e41934f02f1', 'request_id': 'req-940660d4-64d4-4683-89dc-d0d50d22829b'} {{(pid=86656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:54:23.543380 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-940660d4-64d4-4683-89dc-d0d50d22829b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e2b26230df5047bcba725e41934f02f1', 'request_id': 'req-940660d4-64d4-4683-89dc-d0d50d22829b'} {{(pid=86656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:54:23.546996 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-25f7ed95-1194-4021-a135-7b41d7dde97f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '233573f2e7f04bfab9041b97605e5ba3', 'request_id': 'req-25f7ed95-1194-4021-a135-7b41d7dde97f'} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:54:23.552294 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-940660d4-64d4-4683-89dc-d0d50d22829b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e2b26230df5047bcba725e41934f02f1', 'request_id': 'req-940660d4-64d4-4683-89dc-d0d50d22829b'} {{(pid=86656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:54:23.568799 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-25f7ed95-1194-4021-a135-7b41d7dde97f admin admin] The token cache is being invalidate because project 233573f2e7f04bfab9041b97605e5ba3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86655) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 10:54:23.568799 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-25f7ed95-1194-4021-a135-7b41d7dde97f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:54:23.569527 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-25f7ed95-1194-4021-a135-7b41d7dde97f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:54:23.579081 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 1170/2320] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Jul 14 10:54:23 2022] DELETE /identity/v3/projects/233573f2e7f04bfab9041b97605e5ba3 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:54:23.579081 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f7ed95-1194-4021-a135-7b41d7dde97f admin admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:54:23.581585 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-25f7ed95-1194-4021-a135-7b41d7dde97f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:54:23.586499 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-940660d4-64d4-4683-89dc-d0d50d22829b admin admin] The token cache is being invalidate because project e2b26230df5047bcba725e41934f02f1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86656) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 10:54:23.586865 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-940660d4-64d4-4683-89dc-d0d50d22829b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:54:23.588733 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-940660d4-64d4-4683-89dc-d0d50d22829b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:54:23.592704 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 1151/2321] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Jul 14 10:54:23 2022] DELETE /identity/v3/projects/e2b26230df5047bcba725e41934f02f1 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:54:23.594331 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1a26a0-6ccd-4a58-bf5e-c330dea949f3 None None] REQUEST_METHOD: `POST` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:23.594699 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1a26a0-6ccd-4a58-bf5e-c330dea949f3 None None] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:23.595058 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1a26a0-6ccd-4a58-bf5e-c330dea949f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:23.623394 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:54:23.624196 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.auth.core [None req-de1a26a0-6ccd-4a58-bf5e-c330dea949f3 None None] MFA Rules not processed for user `ae4bcdd8106d4bebbdcae96be33505bc`. Rule list: `[]` (Enabled: `True`). {{(pid=86656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:54:23.625988 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-de1a26a0-6ccd-4a58-bf5e-c330dea949f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:54:23.655358 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=86,keystone:DELETE=11,keystone:INSERT=3 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:54:23.674641 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f7ed95-1194-4021-a135-7b41d7dde97f admin admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:54:23.698891 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 1152/2322] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jul 14 10:54:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:54:23.700855 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10476c7-3991-4563-a0f1-817305164ae2 None None] REQUEST_METHOD: `POST` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:23.701213 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10476c7-3991-4563-a0f1-817305164ae2 None None] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:23.701557 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10476c7-3991-4563-a0f1-817305164ae2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:23.721530 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.auth.core [None req-c10476c7-3991-4563-a0f1-817305164ae2 None None] MFA Rules not processed for user `ae4bcdd8106d4bebbdcae96be33505bc`. Rule list: `[]` (Enabled: `True`). {{(pid=86656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:54:23.722769 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-c10476c7-3991-4563-a0f1-817305164ae2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:54:23.730930 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 1153/2323] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jul 14 10:54:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:54:23.732428 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae067b25-893f-453f-944b-82d0af253a51 None None] REQUEST_METHOD: `POST` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:23.732811 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae067b25-893f-453f-944b-82d0af253a51 None None] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:23.733170 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae067b25-893f-453f-944b-82d0af253a51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:23.744357 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e97d8da-96fa-4059-a45e-6be40d1a5b9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:54:23.745082 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e97d8da-96fa-4059-a45e-6be40d1a5b9f admin admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:23.745373 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e97d8da-96fa-4059-a45e-6be40d1a5b9f admin admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:23.745657 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e97d8da-96fa-4059-a45e-6be40d1a5b9f admin admin] PATH_INFO: `/v3/roles` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:23.747534 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e97d8da-96fa-4059-a45e-6be40d1a5b9f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:54:23.749220 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e97d8da-96fa-4059-a45e-6be40d1a5b9f admin admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:54:23.755041 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.auth.core [None req-ae067b25-893f-453f-944b-82d0af253a51 None None] MFA Rules not processed for user `ae4bcdd8106d4bebbdcae96be33505bc`. Rule list: `[]` (Enabled: `True`). {{(pid=86656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:54:23.756269 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-ae067b25-893f-453f-944b-82d0af253a51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:54:23.759575 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 1171/2324] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jul 14 10:54:23 2022] GET /identity/v3/roles => generated 1420 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:54:23.760919 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5779620e-4f9b-44f3-be06-7f1d73e02886 None None] REQUEST_METHOD: `POST` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:23.761217 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5779620e-4f9b-44f3-be06-7f1d73e02886 None None] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:23.761503 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5779620e-4f9b-44f3-be06-7f1d73e02886 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:23.765444 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 1154/2325] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jul 14 10:54:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:54:23.766075 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae067b25-893f-453f-944b-82d0af253a51 None None] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:54:23.767344 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-ae067b25-893f-453f-944b-82d0af253a51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:54:23.779304 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae067b25-893f-453f-944b-82d0af253a51 None None] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:54:23.784656 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092658d0-b988-4a7a-8d6b-c9c7adab4991 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:54:23.785527 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092658d0-b988-4a7a-8d6b-c9c7adab4991 admin admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:23.785763 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092658d0-b988-4a7a-8d6b-c9c7adab4991 admin admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:23.785981 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.auth.core [None req-5779620e-4f9b-44f3-be06-7f1d73e02886 None None] MFA Rules not processed for user `ae4bcdd8106d4bebbdcae96be33505bc`. Rule list: `[]` (Enabled: `True`). {{(pid=86655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:54:23.786087 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092658d0-b988-4a7a-8d6b-c9c7adab4991 admin admin] PATH_INFO: `/v3/roles` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:23.786771 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092658d0-b988-4a7a-8d6b-c9c7adab4991 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:54:23.787215 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-5779620e-4f9b-44f3-be06-7f1d73e02886 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:54:23.788383 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092658d0-b988-4a7a-8d6b-c9c7adab4991 admin admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:54:23.799829 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 1172/2326] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jul 14 10:54:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:54:23.802517 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 1155/2327] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jul 14 10:54:23 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:54:23.807020 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5779620e-4f9b-44f3-be06-7f1d73e02886 None None] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:54:23.810265 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092658d0-b988-4a7a-8d6b-c9c7adab4991 admin admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:54:23.819006 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5779620e-4f9b-44f3-be06-7f1d73e02886 None None] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:54:23.821680 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092658d0-b988-4a7a-8d6b-c9c7adab4991 admin admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:54:23.823834 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3232950-1068-43a6-bf28-9f0216ba67f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:54:23.824618 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3232950-1068-43a6-bf28-9f0216ba67f9 admin admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:23.825238 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3232950-1068-43a6-bf28-9f0216ba67f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:23.825238 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3232950-1068-43a6-bf28-9f0216ba67f9 admin admin] PATH_INFO: `/v3/domains` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:23.825977 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3232950-1068-43a6-bf28-9f0216ba67f9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:54:23.826289 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3232950-1068-43a6-bf28-9f0216ba67f9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:54:23.827893 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3232950-1068-43a6-bf28-9f0216ba67f9 admin admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:54:23.828015 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5ecc87-1712-4cd0-8756-5fc36a26fa61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:54:23.828935 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5ecc87-1712-4cd0-8756-5fc36a26fa61 admin admin] REQUEST_METHOD: `PUT` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:23.829219 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5ecc87-1712-4cd0-8756-5fc36a26fa61 admin admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:23.829495 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5ecc87-1712-4cd0-8756-5fc36a26fa61 admin admin] PATH_INFO: `/v3/projects/8247d5ed9be94578977f5aefa8b642de/users/a4034c8b54284229a38afc0c5210bc37/roles/0da46c267d354cce81495dfdd56c1ec2` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:23.842164 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 1173/2328] 10.222.0.16 () {58 vars in 1152 bytes} [Thu Jul 14 10:54:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:54:23.843044 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3232950-1068-43a6-bf28-9f0216ba67f9 admin admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:54:23.847119 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5ecc87-1712-4cd0-8756-5fc36a26fa61 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8247d5ed9be94578977f5aefa8b642de, user_id=a4034c8b54284229a38afc0c5210bc37, role_id=0da46c267d354cce81495dfdd56c1ec2)` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:54:23.850082 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5ecc87-1712-4cd0-8756-5fc36a26fa61 admin admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:54:23.853440 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3232950-1068-43a6-bf28-9f0216ba67f9 admin admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:54:23.858688 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a754ae5-41c4-4c1e-ac93-f31de58e73f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:54:23.859347 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a754ae5-41c4-4c1e-ac93-f31de58e73f2 admin admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:23.859637 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a754ae5-41c4-4c1e-ac93-f31de58e73f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:23.859996 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a754ae5-41c4-4c1e-ac93-f31de58e73f2 admin admin] PATH_INFO: `/v3/domains` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:23.860745 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a754ae5-41c4-4c1e-ac93-f31de58e73f2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:54:23.861077 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a754ae5-41c4-4c1e-ac93-f31de58e73f2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:54:23.862651 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a754ae5-41c4-4c1e-ac93-f31de58e73f2 admin admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:54:23.868367 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 1156/2329] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Jul 14 10:54:23 2022] PUT /identity/v3/projects/8247d5ed9be94578977f5aefa8b642de/users/a4034c8b54284229a38afc0c5210bc37/roles/0da46c267d354cce81495dfdd56c1ec2 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:54:23.868367 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5ecc87-1712-4cd0-8756-5fc36a26fa61 admin admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:54:23.880296 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 1174/2330] 10.222.0.16 () {58 vars in 1152 bytes} [Thu Jul 14 10:54:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:54:23.880296 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d24a85-ca9a-4526-8f0a-0213b15c15a5 None None] REQUEST_METHOD: `POST` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:23.880296 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d24a85-ca9a-4526-8f0a-0213b15c15a5 None None] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:23.880296 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d24a85-ca9a-4526-8f0a-0213b15c15a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:23.897372 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.auth.core [None req-87d24a85-ca9a-4526-8f0a-0213b15c15a5 None None] MFA Rules not processed for user `ae4bcdd8106d4bebbdcae96be33505bc`. Rule list: `[]` (Enabled: `True`). {{(pid=86655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:54:23.898611 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-87d24a85-ca9a-4526-8f0a-0213b15c15a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:54:23.938212 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5ecc87-1712-4cd0-8756-5fc36a26fa61 admin admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:54:23.944838 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ba13fa-8a35-4143-90a6-bbd3567a7196 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:54:23.945599 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ba13fa-8a35-4143-90a6-bbd3567a7196 admin admin] REQUEST_METHOD: `POST` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:23.946041 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ba13fa-8a35-4143-90a6-bbd3567a7196 admin admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:23.946400 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ba13fa-8a35-4143-90a6-bbd3567a7196 admin admin] PATH_INFO: `/v3/projects` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:23.948223 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ba13fa-8a35-4143-90a6-bbd3567a7196 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:54:23.949388 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ba13fa-8a35-4143-90a6-bbd3567a7196 admin admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:54:23.978915 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 1157/2331] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Jul 14 10:54:23 2022] POST /identity/v3/projects => generated 375 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:54:23.982451 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 1175/2332] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jul 14 10:54:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:54:23.982587 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ba13fa-8a35-4143-90a6-bbd3567a7196 admin admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:54:23.985308 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d24a85-ca9a-4526-8f0a-0213b15c15a5 None None] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:54:23.997376 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d24a85-ca9a-4526-8f0a-0213b15c15a5 None None] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:54:24.032143 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=100 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:54:24.065766 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2653babb-9b3b-4c0a-bb42-1689cd75a700 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:54:24.066633 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2653babb-9b3b-4c0a-bb42-1689cd75a700 admin admin] REQUEST_METHOD: `POST` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:24.066924 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2653babb-9b3b-4c0a-bb42-1689cd75a700 admin admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:24.067821 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2653babb-9b3b-4c0a-bb42-1689cd75a700 admin admin] PATH_INFO: `/v3/users` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:24.068882 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2653babb-9b3b-4c0a-bb42-1689cd75a700 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:54:24.070866 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2653babb-9b3b-4c0a-bb42-1689cd75a700 admin admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:54:24.076931 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ba13fa-8a35-4143-90a6-bbd3567a7196 admin admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:54:24.086046 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfa47e2-80a2-4939-b113-d20c36b001e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:54:24.086684 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfa47e2-80a2-4939-b113-d20c36b001e6 admin admin] REQUEST_METHOD: `POST` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:24.087004 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfa47e2-80a2-4939-b113-d20c36b001e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:24.087254 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfa47e2-80a2-4939-b113-d20c36b001e6 admin admin] PATH_INFO: `/v3/projects` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:24.087965 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cfa47e2-80a2-4939-b113-d20c36b001e6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:54:24.090494 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cfa47e2-80a2-4939-b113-d20c36b001e6 admin admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:54:24.096400 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 1176/2333] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Jul 14 10:54:23 2022] POST /identity/v3/users => generated 288 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:54:24.103990 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2653babb-9b3b-4c0a-bb42-1689cd75a700 admin admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:54:24.104206 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:54:24.106064 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-2653babb-9b3b-4c0a-bb42-1689cd75a700 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:54:24.131024 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 1158/2334] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Jul 14 10:54:23 2022] POST /identity/v3/projects => generated 361 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:54:24.132103 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfa47e2-80a2-4939-b113-d20c36b001e6 admin admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:54:24.170789 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2653babb-9b3b-4c0a-bb42-1689cd75a700 admin admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:54:24.200529 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfa47e2-80a2-4939-b113-d20c36b001e6 admin admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:54:24.205291 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2f008a-b222-485d-88e8-fde67eb0b9df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:54:24.205977 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2f008a-b222-485d-88e8-fde67eb0b9df admin admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:24.206262 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2f008a-b222-485d-88e8-fde67eb0b9df admin admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:24.206538 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2f008a-b222-485d-88e8-fde67eb0b9df admin admin] PATH_INFO: `/v3/roles` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:24.207270 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2f008a-b222-485d-88e8-fde67eb0b9df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:54:24.208903 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2f008a-b222-485d-88e8-fde67eb0b9df admin admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:54:24.222623 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 1159/2335] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jul 14 10:54:24 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:54:24.222994 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2f008a-b222-485d-88e8-fde67eb0b9df admin admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:54:24.233523 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d725b36f-c817-4c75-80ec-34461b45ba6d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dddf93691844886982c91fea974385d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59391272ecbe48b0aa736cb43807be1d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:54:24.233831 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2f008a-b222-485d-88e8-fde67eb0b9df admin admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:54:24.234191 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d725b36f-c817-4c75-80ec-34461b45ba6d service neutron] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:24.234482 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d725b36f-c817-4c75-80ec-34461b45ba6d service neutron] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:24.234767 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d725b36f-c817-4c75-80ec-34461b45ba6d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:24.238442 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5e4e97-bc54-4bd3-ab4c-e95ab00169a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:54:24.239105 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5e4e97-bc54-4bd3-ab4c-e95ab00169a8 admin admin] REQUEST_METHOD: `POST` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:24.239535 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5e4e97-bc54-4bd3-ab4c-e95ab00169a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:24.239816 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5e4e97-bc54-4bd3-ab4c-e95ab00169a8 admin admin] PATH_INFO: `/v3/users` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:24.240509 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5e4e97-bc54-4bd3-ab4c-e95ab00169a8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:54:24.243130 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5e4e97-bc54-4bd3-ab4c-e95ab00169a8 admin admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:54:24.244120 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d725b36f-c817-4c75-80ec-34461b45ba6d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:54:24.247199 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d725b36f-c817-4c75-80ec-34461b45ba6d service neutron] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:54:24.257762 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 1177/2336] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jul 14 10:54:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:54:24.258602 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d725b36f-c817-4c75-80ec-34461b45ba6d service neutron] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:54:24.266942 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 1160/2337] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Jul 14 10:54:24 2022] POST /identity/v3/users => generated 281 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:54:24.269279 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d725b36f-c817-4c75-80ec-34461b45ba6d service neutron] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:54:24.271010 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5e4e97-bc54-4bd3-ab4c-e95ab00169a8 admin admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:54:24.278415 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4271025-ca8a-43f5-91a9-15000cc76761 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:54:24.279137 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4271025-ca8a-43f5-91a9-15000cc76761 admin admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:24.279422 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4271025-ca8a-43f5-91a9-15000cc76761 admin admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:24.279712 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4271025-ca8a-43f5-91a9-15000cc76761 admin admin] PATH_INFO: `/v3/roles` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:24.280574 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4271025-ca8a-43f5-91a9-15000cc76761 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:54:24.282119 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4271025-ca8a-43f5-91a9-15000cc76761 admin admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:54:24.283063 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5e4e97-bc54-4bd3-ab4c-e95ab00169a8 admin admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:54:24.288970 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d34e1a4-4368-47b3-949b-0f5a98c72e46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:54:24.289772 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d34e1a4-4368-47b3-949b-0f5a98c72e46 admin admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:24.290136 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d34e1a4-4368-47b3-949b-0f5a98c72e46 admin admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:24.290492 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d34e1a4-4368-47b3-949b-0f5a98c72e46 admin admin] PATH_INFO: `/v3/roles` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:24.291329 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d34e1a4-4368-47b3-949b-0f5a98c72e46 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:54:24.293751 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d34e1a4-4368-47b3-949b-0f5a98c72e46 admin admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:54:24.297027 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 1178/2338] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jul 14 10:54:24 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:54:24.301782 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4271025-ca8a-43f5-91a9-15000cc76761 admin admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:54:24.306601 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 1161/2339] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jul 14 10:54:24 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 10:54:24.311026 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d34e1a4-4368-47b3-949b-0f5a98c72e46 admin admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:54:24.314575 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4271025-ca8a-43f5-91a9-15000cc76761 admin admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:54:24.321349 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98efbcf1-2b45-4162-a0e4-cae6f9f2cee7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:54:24.322333 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98efbcf1-2b45-4162-a0e4-cae6f9f2cee7 admin admin] REQUEST_METHOD: `PUT` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:24.322690 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98efbcf1-2b45-4162-a0e4-cae6f9f2cee7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:24.323042 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98efbcf1-2b45-4162-a0e4-cae6f9f2cee7 admin admin] PATH_INFO: `/v3/projects/3ad2261344634b5db40fb0e29915fe1d/users/9ae4697d243b42938d3406d39de6f23b/roles/0da46c267d354cce81495dfdd56c1ec2` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:24.325773 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d34e1a4-4368-47b3-949b-0f5a98c72e46 admin admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:54:24.330845 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1733abde-4f9c-4f85-8cec-f63e5d107405 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:54:24.331632 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1733abde-4f9c-4f85-8cec-f63e5d107405 admin admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:24.332188 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1733abde-4f9c-4f85-8cec-f63e5d107405 admin admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:24.332566 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1733abde-4f9c-4f85-8cec-f63e5d107405 admin admin] PATH_INFO: `/v3/roles` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:24.333743 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1733abde-4f9c-4f85-8cec-f63e5d107405 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:54:24.335061 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1733abde-4f9c-4f85-8cec-f63e5d107405 admin admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:54:24.344916 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98efbcf1-2b45-4162-a0e4-cae6f9f2cee7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3ad2261344634b5db40fb0e29915fe1d, user_id=9ae4697d243b42938d3406d39de6f23b, role_id=0da46c267d354cce81495dfdd56c1ec2)` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:54:24.347893 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98efbcf1-2b45-4162-a0e4-cae6f9f2cee7 admin admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:54:24.386628 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 1179/2340] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Jul 14 10:54:24 2022] PUT /identity/v3/projects/3ad2261344634b5db40fb0e29915fe1d/users/9ae4697d243b42938d3406d39de6f23b/roles/0da46c267d354cce81495dfdd56c1ec2 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:54:24.390059 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c83316-d560-4179-9466-0876ce98ab26 None None] REQUEST_METHOD: `POST` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:24.390354 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c83316-d560-4179-9466-0876ce98ab26 None None] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:24.390643 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c83316-d560-4179-9466-0876ce98ab26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:24.438580 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.auth.core [None req-09c83316-d560-4179-9466-0876ce98ab26 None None] MFA Rules not processed for user `9ae4697d243b42938d3406d39de6f23b`. Rule list: `[]` (Enabled: `True`). {{(pid=86655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:54:24.439985 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-09c83316-d560-4179-9466-0876ce98ab26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:54:24.491546 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 1162/2341] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jul 14 10:54:24 2022] GET /identity/v3/roles => generated 1420 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 10:54:24.492656 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1733abde-4f9c-4f85-8cec-f63e5d107405 admin admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:54:24.501286 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:54:24.511122 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1733abde-4f9c-4f85-8cec-f63e5d107405 admin admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:54:24.573341 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 1180/2342] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jul 14 10:54:24 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:54:24.588428 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c83316-d560-4179-9466-0876ce98ab26 None None] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:54:24.590970 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-09c83316-d560-4179-9466-0876ce98ab26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:54:24.637919 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f479e6-9e51-4ee4-95d4-9e04f0d82b32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:54:24.639145 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f479e6-9e51-4ee4-95d4-9e04f0d82b32 admin admin] REQUEST_METHOD: `PUT` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:24.639435 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f479e6-9e51-4ee4-95d4-9e04f0d82b32 admin admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:24.639717 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f479e6-9e51-4ee4-95d4-9e04f0d82b32 admin admin] PATH_INFO: `/v3/projects/9f826488295e40bebfe7c86d00778a00/users/c29df8efbfe54a40b8422a98cb83f53a/roles/0da46c267d354cce81495dfdd56c1ec2` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:24.660761 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f479e6-9e51-4ee4-95d4-9e04f0d82b32 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9f826488295e40bebfe7c86d00778a00, user_id=c29df8efbfe54a40b8422a98cb83f53a, role_id=0da46c267d354cce81495dfdd56c1ec2)` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:54:24.664074 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f479e6-9e51-4ee4-95d4-9e04f0d82b32 admin admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:54:24.683184 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 1163/2343] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Jul 14 10:54:24 2022] PUT /identity/v3/projects/9f826488295e40bebfe7c86d00778a00/users/c29df8efbfe54a40b8422a98cb83f53a/roles/0da46c267d354cce81495dfdd56c1ec2 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:54:24.691226 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c83316-d560-4179-9466-0876ce98ab26 None None] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:54:24.694416 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0baed9a7-036e-4093-810a-be5166c8c451 None None] REQUEST_METHOD: `POST` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:24.694732 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0baed9a7-036e-4093-810a-be5166c8c451 None None] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:24.694983 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0baed9a7-036e-4093-810a-be5166c8c451 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:24.739639 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.auth.core [None req-0baed9a7-036e-4093-810a-be5166c8c451 None None] MFA Rules not processed for user `c29df8efbfe54a40b8422a98cb83f53a`. Rule list: `[]` (Enabled: `True`). {{(pid=86656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:54:24.740916 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-0baed9a7-036e-4093-810a-be5166c8c451 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:54:24.787477 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:54:24.818972 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af06547-61d8-40ec-8141-edf0a2729bfc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68382432147a48c3b62271fd2a2eab04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59391272ecbe48b0aa736cb43807be1d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:54:24.820186 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af06547-61d8-40ec-8141-edf0a2729bfc service cinder] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:24.820716 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af06547-61d8-40ec-8141-edf0a2729bfc service cinder] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:24.821248 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af06547-61d8-40ec-8141-edf0a2729bfc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:24.853286 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 1164/2344] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jul 14 10:54:24 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:54:24.904346 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0baed9a7-036e-4093-810a-be5166c8c451 None None] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:54:24.906342 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-0baed9a7-036e-4093-810a-be5166c8c451 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:54:24.932685 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0baed9a7-036e-4093-810a-be5166c8c451 None None] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:54:24.945567 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d334d1-dd97-4726-8724-15cebe97bee2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68382432147a48c3b62271fd2a2eab04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59391272ecbe48b0aa736cb43807be1d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:54:24.947046 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d334d1-dd97-4726-8724-15cebe97bee2 service cinder] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:24.947476 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d334d1-dd97-4726-8724-15cebe97bee2 service cinder] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:24.948144 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d334d1-dd97-4726-8724-15cebe97bee2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:24.948867 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af06547-61d8-40ec-8141-edf0a2729bfc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:54:24.952449 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af06547-61d8-40ec-8141-edf0a2729bfc service cinder] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:54:24.968609 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 1181/2345] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jul 14 10:54:24 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:54:24.979739 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d334d1-dd97-4726-8724-15cebe97bee2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:54:24.982033 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d334d1-dd97-4726-8724-15cebe97bee2 service cinder] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:54:25.011294 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 1165/2346] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jul 14 10:54:24 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:54:25.036828 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af06547-61d8-40ec-8141-edf0a2729bfc service cinder] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:54:25.114585 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=100 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:54:25.146599 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af06547-61d8-40ec-8141-edf0a2729bfc service cinder] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:54:25.162516 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c9198d-b211-498a-a21b-46994e18654b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:54:25.164040 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c9198d-b211-498a-a21b-46994e18654b admin admin] REQUEST_METHOD: `DELETE` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:25.164720 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c9198d-b211-498a-a21b-46994e18654b admin admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:25.164720 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c9198d-b211-498a-a21b-46994e18654b admin admin] PATH_INFO: `/v3/users/c29df8efbfe54a40b8422a98cb83f53a` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:25.166089 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c9198d-b211-498a-a21b-46994e18654b admin admin] RBAC: Authorizing `identity:delete_user(user_id=c29df8efbfe54a40b8422a98cb83f53a)` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:54:25.169758 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c9198d-b211-498a-a21b-46994e18654b admin admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:54:25.270339 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-28c9198d-b211-498a-a21b-46994e18654b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c29df8efbfe54a40b8422a98cb83f53a'} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:54:25.285859 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-28c9198d-b211-498a-a21b-46994e18654b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c29df8efbfe54a40b8422a98cb83f53a'} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:54:25.287500 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-28c9198d-b211-498a-a21b-46994e18654b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c29df8efbfe54a40b8422a98cb83f53a'} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:54:25.298069 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-28c9198d-b211-498a-a21b-46994e18654b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c29df8efbfe54a40b8422a98cb83f53a'} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:54:25.299292 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-28c9198d-b211-498a-a21b-46994e18654b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c29df8efbfe54a40b8422a98cb83f53a'} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:54:25.326389 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 1182/2347] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Jul 14 10:54:25 2022] DELETE /identity/v3/users/c29df8efbfe54a40b8422a98cb83f53a => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:54:25.331340 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234245ff-1fa9-4f5b-b4dc-7f7bbd7b1d14 None None] REQUEST_METHOD: `POST` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:25.331836 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234245ff-1fa9-4f5b-b4dc-7f7bbd7b1d14 None None] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:25.332222 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234245ff-1fa9-4f5b-b4dc-7f7bbd7b1d14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:25.358617 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.auth.core [None req-234245ff-1fa9-4f5b-b4dc-7f7bbd7b1d14 None None] MFA Rules not processed for user `ae4bcdd8106d4bebbdcae96be33505bc`. Rule list: `[]` (Enabled: `True`). {{(pid=86656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:54:25.360094 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-234245ff-1fa9-4f5b-b4dc-7f7bbd7b1d14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:54:25.514385 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b57139-44f9-45f1-8423-1ee1dc5e9467 None None] REQUEST_METHOD: `POST` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:25.514686 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b57139-44f9-45f1-8423-1ee1dc5e9467 None None] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:25.514974 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b57139-44f9-45f1-8423-1ee1dc5e9467 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:25.522397 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 1166/2348] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jul 14 10:54:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:54:25.533252 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234245ff-1fa9-4f5b-b4dc-7f7bbd7b1d14 None None] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:54:25.534830 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-234245ff-1fa9-4f5b-b4dc-7f7bbd7b1d14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:54:25.553848 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.auth.core [None req-57b57139-44f9-45f1-8423-1ee1dc5e9467 None None] MFA Rules not processed for user `a4034c8b54284229a38afc0c5210bc37`. Rule list: `[]` (Enabled: `True`). {{(pid=86655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:54:25.555377 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-57b57139-44f9-45f1-8423-1ee1dc5e9467 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:54:25.610486 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234245ff-1fa9-4f5b-b4dc-7f7bbd7b1d14 None None] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:54:25.616057 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9cfa3a-403a-49e9-85f0-2a2fc470ed4d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dddf93691844886982c91fea974385d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59391272ecbe48b0aa736cb43807be1d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:54:25.616860 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9cfa3a-403a-49e9-85f0-2a2fc470ed4d service neutron] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:25.617160 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9cfa3a-403a-49e9-85f0-2a2fc470ed4d service neutron] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:25.617478 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9cfa3a-403a-49e9-85f0-2a2fc470ed4d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:25.628204 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9cfa3a-403a-49e9-85f0-2a2fc470ed4d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:54:25.629707 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9cfa3a-403a-49e9-85f0-2a2fc470ed4d service neutron] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:54:25.642730 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 1167/2349] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jul 14 10:54:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:54:25.645289 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 1183/2350] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jul 14 10:54:25 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:54:25.657669 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9cfa3a-403a-49e9-85f0-2a2fc470ed4d service neutron] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:54:25.659765 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-aa9cfa3a-403a-49e9-85f0-2a2fc470ed4d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:54:25.741040 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9cfa3a-403a-49e9-85f0-2a2fc470ed4d service neutron] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:54:25.745320 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f5fe5d-04c7-4b06-bb75-69a426ecce38 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68382432147a48c3b62271fd2a2eab04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59391272ecbe48b0aa736cb43807be1d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:54:25.746013 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f5fe5d-04c7-4b06-bb75-69a426ecce38 service cinder] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:25.746633 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f5fe5d-04c7-4b06-bb75-69a426ecce38 service cinder] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:25.746911 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f5fe5d-04c7-4b06-bb75-69a426ecce38 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:25.753223 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=100 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:54:25.758888 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f5fe5d-04c7-4b06-bb75-69a426ecce38 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:54:25.760749 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f5fe5d-04c7-4b06-bb75-69a426ecce38 service cinder] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:54:25.780968 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 1168/2351] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jul 14 10:54:25 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:54:26.167743 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b57139-44f9-45f1-8423-1ee1dc5e9467 None None] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:54:26.174694 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-57b57139-44f9-45f1-8423-1ee1dc5e9467 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:54:26.197679 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b57139-44f9-45f1-8423-1ee1dc5e9467 None None] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:54:26.204265 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4804aad3-2b8b-4903-a951-e997775dd96c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:54:26.206041 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4804aad3-2b8b-4903-a951-e997775dd96c admin admin] REQUEST_METHOD: `DELETE` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:26.206407 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4804aad3-2b8b-4903-a951-e997775dd96c admin admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:26.207052 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4804aad3-2b8b-4903-a951-e997775dd96c admin admin] PATH_INFO: `/v3/projects/9f826488295e40bebfe7c86d00778a00` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:26.208312 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4804aad3-2b8b-4903-a951-e997775dd96c admin admin] RBAC: Authorizing `identity:delete_project(project_id=9f826488295e40bebfe7c86d00778a00)` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:54:26.211022 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4804aad3-2b8b-4903-a951-e997775dd96c admin admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:54:26.308151 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-4804aad3-2b8b-4903-a951-e997775dd96c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9f826488295e40bebfe7c86d00778a00', 'request_id': 'req-4804aad3-2b8b-4903-a951-e997775dd96c'} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:54:26.311096 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:54:26.317184 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-4804aad3-2b8b-4903-a951-e997775dd96c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9f826488295e40bebfe7c86d00778a00', 'request_id': 'req-4804aad3-2b8b-4903-a951-e997775dd96c'} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:54:26.328105 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-4804aad3-2b8b-4903-a951-e997775dd96c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9f826488295e40bebfe7c86d00778a00', 'request_id': 'req-4804aad3-2b8b-4903-a951-e997775dd96c'} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:54:26.345128 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-4804aad3-2b8b-4903-a951-e997775dd96c admin admin] The token cache is being invalidate because project 9f826488295e40bebfe7c86d00778a00 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86655) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 10:54:26.345455 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-4804aad3-2b8b-4903-a951-e997775dd96c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:54:26.346122 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-4804aad3-2b8b-4903-a951-e997775dd96c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:54:26.352851 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 1184/2352] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Jul 14 10:54:26 2022] DELETE /identity/v3/projects/9f826488295e40bebfe7c86d00778a00 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:54:26.355186 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6994ed-2007-4748-a1dc-2b190dd920c1 None None] REQUEST_METHOD: `POST` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:26.356593 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6994ed-2007-4748-a1dc-2b190dd920c1 None None] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:26.356593 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6994ed-2007-4748-a1dc-2b190dd920c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:26.376210 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.auth.core [None req-ae6994ed-2007-4748-a1dc-2b190dd920c1 None None] MFA Rules not processed for user `ae4bcdd8106d4bebbdcae96be33505bc`. Rule list: `[]` (Enabled: `True`). {{(pid=86656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:54:26.377712 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-ae6994ed-2007-4748-a1dc-2b190dd920c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:54:26.460706 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 1169/2353] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jul 14 10:54:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:54:26.472144 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0664d29-071a-4b69-861f-4afd79a2f170 None None] REQUEST_METHOD: `POST` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:26.472804 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0664d29-071a-4b69-861f-4afd79a2f170 None None] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:26.473268 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0664d29-071a-4b69-861f-4afd79a2f170 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:26.502563 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.auth.core [None req-c0664d29-071a-4b69-861f-4afd79a2f170 None None] MFA Rules not processed for user `ae4bcdd8106d4bebbdcae96be33505bc`. Rule list: `[]` (Enabled: `True`). {{(pid=86655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:54:26.503825 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-c0664d29-071a-4b69-861f-4afd79a2f170 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:54:26.518172 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 1185/2354] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jul 14 10:54:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:54:26.522578 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6994ed-2007-4748-a1dc-2b190dd920c1 None None] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:54:26.535010 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6994ed-2007-4748-a1dc-2b190dd920c1 None None] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:54:26.548058 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b8b83c-af1d-46e8-af79-7eddff1caae1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:54:26.548996 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b8b83c-af1d-46e8-af79-7eddff1caae1 admin admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:26.549293 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b8b83c-af1d-46e8-af79-7eddff1caae1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:26.549572 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b8b83c-af1d-46e8-af79-7eddff1caae1 admin admin] PATH_INFO: `/v3/domains` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:26.550426 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b8b83c-af1d-46e8-af79-7eddff1caae1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:54:26.550626 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b8b83c-af1d-46e8-af79-7eddff1caae1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:54:26.552306 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b8b83c-af1d-46e8-af79-7eddff1caae1 admin admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:54:26.568714 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 1170/2355] 10.222.0.16 () {58 vars in 1152 bytes} [Thu Jul 14 10:54:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 10:54:26.573876 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0664d29-071a-4b69-861f-4afd79a2f170 None None] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:54:26.589533 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0664d29-071a-4b69-861f-4afd79a2f170 None None] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:54:26.596314 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f225fc41-9e44-42ba-90fc-ade801604f69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:54:26.597900 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f225fc41-9e44-42ba-90fc-ade801604f69 admin admin] REQUEST_METHOD: `POST` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:26.598470 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f225fc41-9e44-42ba-90fc-ade801604f69 admin admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:26.599012 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f225fc41-9e44-42ba-90fc-ade801604f69 admin admin] PATH_INFO: `/v3/projects` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:26.599835 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f225fc41-9e44-42ba-90fc-ade801604f69 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:54:26.601941 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f225fc41-9e44-42ba-90fc-ade801604f69 admin admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:54:26.643110 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 1186/2356] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Jul 14 10:54:26 2022] POST /identity/v3/projects => generated 397 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:54:26.647916 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b8b83c-af1d-46e8-af79-7eddff1caae1 admin admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:54:26.665469 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b8b83c-af1d-46e8-af79-7eddff1caae1 admin admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:54:26.774192 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b624644-84f0-4b8c-b766-79cfc82a7f77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:54:26.775088 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b624644-84f0-4b8c-b766-79cfc82a7f77 admin admin] REQUEST_METHOD: `POST` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:26.775386 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b624644-84f0-4b8c-b766-79cfc82a7f77 admin admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:26.775666 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b624644-84f0-4b8c-b766-79cfc82a7f77 admin admin] PATH_INFO: `/v3/users` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:26.776387 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b624644-84f0-4b8c-b766-79cfc82a7f77 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:54:26.779744 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b624644-84f0-4b8c-b766-79cfc82a7f77 admin admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:54:26.816104 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 1171/2357] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Jul 14 10:54:26 2022] POST /identity/v3/users => generated 299 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 10:54:26.826046 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f225fc41-9e44-42ba-90fc-ade801604f69 admin admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:54:26.838103 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f225fc41-9e44-42ba-90fc-ade801604f69 admin admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:54:26.846385 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bc977b-4a39-4f7b-b883-f0f14771bb64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:54:26.847127 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bc977b-4a39-4f7b-b883-f0f14771bb64 admin admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:26.847420 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bc977b-4a39-4f7b-b883-f0f14771bb64 admin admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:26.847826 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bc977b-4a39-4f7b-b883-f0f14771bb64 admin admin] PATH_INFO: `/v3/roles` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:26.848696 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69bc977b-4a39-4f7b-b883-f0f14771bb64 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:54:26.850817 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69bc977b-4a39-4f7b-b883-f0f14771bb64 admin admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:54:26.863816 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 1187/2358] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jul 14 10:54:26 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:54:26.867886 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b624644-84f0-4b8c-b766-79cfc82a7f77 admin admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:54:26.879723 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b624644-84f0-4b8c-b766-79cfc82a7f77 admin admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:54:26.885095 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5552090f-7597-4ed4-9283-a6d054c837cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:54:26.885777 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5552090f-7597-4ed4-9283-a6d054c837cb admin admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:26.886063 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5552090f-7597-4ed4-9283-a6d054c837cb admin admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:26.886336 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5552090f-7597-4ed4-9283-a6d054c837cb admin admin] PATH_INFO: `/v3/roles` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:26.887540 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5552090f-7597-4ed4-9283-a6d054c837cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:54:26.889332 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5552090f-7597-4ed4-9283-a6d054c837cb admin admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:54:26.904466 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 1172/2359] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jul 14 10:54:26 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:54:26.908273 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bc977b-4a39-4f7b-b883-f0f14771bb64 admin admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:54:26.919057 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bc977b-4a39-4f7b-b883-f0f14771bb64 admin admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:54:26.923722 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d6400c-21e6-4e9d-9680-bcf983314b33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:54:26.924608 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d6400c-21e6-4e9d-9680-bcf983314b33 admin admin] REQUEST_METHOD: `PUT` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:26.924944 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d6400c-21e6-4e9d-9680-bcf983314b33 admin admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:26.925229 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d6400c-21e6-4e9d-9680-bcf983314b33 admin admin] PATH_INFO: `/v3/projects/7208328ca6c841ba8de2d3d12d728f1a/users/be7d558530fa40f5b80d0f63a7ea208f/roles/0da46c267d354cce81495dfdd56c1ec2` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:26.945208 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d6400c-21e6-4e9d-9680-bcf983314b33 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7208328ca6c841ba8de2d3d12d728f1a, user_id=be7d558530fa40f5b80d0f63a7ea208f, role_id=0da46c267d354cce81495dfdd56c1ec2)` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:54:26.948072 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d6400c-21e6-4e9d-9680-bcf983314b33 admin admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:54:26.967203 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 1188/2360] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Jul 14 10:54:26 2022] PUT /identity/v3/projects/7208328ca6c841ba8de2d3d12d728f1a/users/be7d558530fa40f5b80d0f63a7ea208f/roles/0da46c267d354cce81495dfdd56c1ec2 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 10:54:26.978578 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e4bfeb-5f96-4217-9ef3-27f9dcf24f82 None None] REQUEST_METHOD: `POST` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:26.978889 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e4bfeb-5f96-4217-9ef3-27f9dcf24f82 None None] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:26.979133 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e4bfeb-5f96-4217-9ef3-27f9dcf24f82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:27.015550 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.auth.core [None req-24e4bfeb-5f96-4217-9ef3-27f9dcf24f82 None None] MFA Rules not processed for user `be7d558530fa40f5b80d0f63a7ea208f`. Rule list: `[]` (Enabled: `True`). {{(pid=86656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:54:27.017015 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-24e4bfeb-5f96-4217-9ef3-27f9dcf24f82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:54:27.092489 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:54:27.110590 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 1173/2361] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jul 14 10:54:26 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:54:27.122506 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d6400c-21e6-4e9d-9680-bcf983314b33 admin admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:54:27.124690 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-93d6400c-21e6-4e9d-9680-bcf983314b33 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:54:27.193336 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d6400c-21e6-4e9d-9680-bcf983314b33 admin admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:54:27.197807 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f039bc87-8abb-4eef-bfaf-7529ada4040a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68382432147a48c3b62271fd2a2eab04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59391272ecbe48b0aa736cb43807be1d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:54:27.199927 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f039bc87-8abb-4eef-bfaf-7529ada4040a service cinder] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:27.200233 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f039bc87-8abb-4eef-bfaf-7529ada4040a service cinder] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:27.201312 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f039bc87-8abb-4eef-bfaf-7529ada4040a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:27.211674 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f039bc87-8abb-4eef-bfaf-7529ada4040a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:54:27.213327 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f039bc87-8abb-4eef-bfaf-7529ada4040a service cinder] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:54:27.223878 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 1189/2362] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jul 14 10:54:27 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:54:27.375758 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b20dccb-3b9d-4491-8d6d-ec75444d4173 None None] REQUEST_METHOD: `POST` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:27.376185 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b20dccb-3b9d-4491-8d6d-ec75444d4173 None None] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:27.376271 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b20dccb-3b9d-4491-8d6d-ec75444d4173 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:27.396039 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.auth.core [None req-2b20dccb-3b9d-4491-8d6d-ec75444d4173 None None] MFA Rules not processed for user `a4034c8b54284229a38afc0c5210bc37`. Rule list: `[]` (Enabled: `True`). {{(pid=86656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:54:27.397672 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-2b20dccb-3b9d-4491-8d6d-ec75444d4173 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:54:27.468417 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 1174/2363] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jul 14 10:54:27 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:54:32.407060 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f039bc87-8abb-4eef-bfaf-7529ada4040a service cinder] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:54:32.512825 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f039bc87-8abb-4eef-bfaf-7529ada4040a service cinder] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:54:32.518821 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc084b79-53e8-4a41-b640-b37fa182b834 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:54:32.519755 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc084b79-53e8-4a41-b640-b37fa182b834 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:32.520048 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc084b79-53e8-4a41-b640-b37fa182b834 admin admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:32.520330 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc084b79-53e8-4a41-b640-b37fa182b834 admin admin] PATH_INFO: `/v3/users/be7d558530fa40f5b80d0f63a7ea208f` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:32.521842 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc084b79-53e8-4a41-b640-b37fa182b834 admin admin] RBAC: Authorizing `identity:delete_user(user_id=be7d558530fa40f5b80d0f63a7ea208f)` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:54:32.523608 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc084b79-53e8-4a41-b640-b37fa182b834 admin admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:54:32.547864 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:DELETE=5,keystone:SELECT=92,keystone:INSERT=3 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:54:32.582365 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-fc084b79-53e8-4a41-b640-b37fa182b834 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'be7d558530fa40f5b80d0f63a7ea208f'} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:54:32.594141 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-fc084b79-53e8-4a41-b640-b37fa182b834 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'be7d558530fa40f5b80d0f63a7ea208f'} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:54:32.595385 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-fc084b79-53e8-4a41-b640-b37fa182b834 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'be7d558530fa40f5b80d0f63a7ea208f'} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:54:32.607118 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-fc084b79-53e8-4a41-b640-b37fa182b834 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'be7d558530fa40f5b80d0f63a7ea208f'} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:54:32.607870 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-fc084b79-53e8-4a41-b640-b37fa182b834 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'be7d558530fa40f5b80d0f63a7ea208f'} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:54:32.629510 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 1190/2364] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Jul 14 10:54:32 2022] DELETE /identity/v3/users/be7d558530fa40f5b80d0f63a7ea208f => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:54:32.633735 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44de3c13-6da9-4b19-9360-cba21a60c95b None None] REQUEST_METHOD: `POST` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:32.634297 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44de3c13-6da9-4b19-9360-cba21a60c95b None None] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:32.634297 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44de3c13-6da9-4b19-9360-cba21a60c95b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:32.654110 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.auth.core [None req-44de3c13-6da9-4b19-9360-cba21a60c95b None None] MFA Rules not processed for user `ae4bcdd8106d4bebbdcae96be33505bc`. Rule list: `[]` (Enabled: `True`). {{(pid=86656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:54:32.655350 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-44de3c13-6da9-4b19-9360-cba21a60c95b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:54:32.719332 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 1175/2365] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jul 14 10:54:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:54:32.737064 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc084b79-53e8-4a41-b640-b37fa182b834 admin admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:54:32.738652 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-fc084b79-53e8-4a41-b640-b37fa182b834 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:54:32.809669 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc084b79-53e8-4a41-b640-b37fa182b834 admin admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:54:32.813900 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdb8b98-a1ea-4cec-8435-4cbe74264b38 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dddf93691844886982c91fea974385d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59391272ecbe48b0aa736cb43807be1d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:54:32.814686 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdb8b98-a1ea-4cec-8435-4cbe74264b38 service neutron] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:32.815074 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdb8b98-a1ea-4cec-8435-4cbe74264b38 service neutron] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:32.815457 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdb8b98-a1ea-4cec-8435-4cbe74264b38 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:32.828046 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfdb8b98-a1ea-4cec-8435-4cbe74264b38 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:54:32.829893 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfdb8b98-a1ea-4cec-8435-4cbe74264b38 service neutron] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:54:32.845827 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 1191/2366] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jul 14 10:54:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:54:33.849357 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44de3c13-6da9-4b19-9360-cba21a60c95b None None] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:54:33.850937 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-44de3c13-6da9-4b19-9360-cba21a60c95b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:54:33.864945 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44de3c13-6da9-4b19-9360-cba21a60c95b None None] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:54:33.870085 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30e9c1d-e83a-4eca-b912-12807d466e1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:54:33.871158 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30e9c1d-e83a-4eca-b912-12807d466e1a admin admin] REQUEST_METHOD: `DELETE` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:33.871560 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30e9c1d-e83a-4eca-b912-12807d466e1a admin admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:33.871913 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30e9c1d-e83a-4eca-b912-12807d466e1a admin admin] PATH_INFO: `/v3/projects/7208328ca6c841ba8de2d3d12d728f1a` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:33.873257 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30e9c1d-e83a-4eca-b912-12807d466e1a admin admin] RBAC: Authorizing `identity:delete_project(project_id=7208328ca6c841ba8de2d3d12d728f1a)` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:54:33.875395 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30e9c1d-e83a-4eca-b912-12807d466e1a admin admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:54:33.937986 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-e30e9c1d-e83a-4eca-b912-12807d466e1a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7208328ca6c841ba8de2d3d12d728f1a', 'request_id': 'req-e30e9c1d-e83a-4eca-b912-12807d466e1a'} {{(pid=86656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:54:33.947465 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-e30e9c1d-e83a-4eca-b912-12807d466e1a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7208328ca6c841ba8de2d3d12d728f1a', 'request_id': 'req-e30e9c1d-e83a-4eca-b912-12807d466e1a'} {{(pid=86656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:54:33.955118 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-e30e9c1d-e83a-4eca-b912-12807d466e1a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7208328ca6c841ba8de2d3d12d728f1a', 'request_id': 'req-e30e9c1d-e83a-4eca-b912-12807d466e1a'} {{(pid=86656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:54:33.966832 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-e30e9c1d-e83a-4eca-b912-12807d466e1a admin admin] The token cache is being invalidate because project 7208328ca6c841ba8de2d3d12d728f1a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86656) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 10:54:33.967360 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-e30e9c1d-e83a-4eca-b912-12807d466e1a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:54:33.968180 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-e30e9c1d-e83a-4eca-b912-12807d466e1a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:54:33.970420 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 1176/2367] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Jul 14 10:54:33 2022] DELETE /identity/v3/projects/7208328ca6c841ba8de2d3d12d728f1a => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:54:34.760763 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c53db76-f7a7-4c18-98ec-290f1b30ae43 None None] REQUEST_METHOD: `POST` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:34.761318 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c53db76-f7a7-4c18-98ec-290f1b30ae43 None None] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:34.763730 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c53db76-f7a7-4c18-98ec-290f1b30ae43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:34.790962 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.auth.core [None req-8c53db76-f7a7-4c18-98ec-290f1b30ae43 None None] MFA Rules not processed for user `0dfc7cd9c05e4f268d2ce316d531c4bd`. Rule list: `[]` (Enabled: `True`). {{(pid=86655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:54:34.790962 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-8c53db76-f7a7-4c18-98ec-290f1b30ae43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:54:34.848941 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 1192/2368] 10.222.0.16 () {58 vars in 1009 bytes} [Thu Jul 14 10:54:34 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:54:34.892683 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30e9c1d-e83a-4eca-b912-12807d466e1a admin admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:54:34.894168 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-e30e9c1d-e83a-4eca-b912-12807d466e1a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:54:34.914879 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:54:34.965678 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30e9c1d-e83a-4eca-b912-12807d466e1a admin admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:54:34.972193 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76da877d-3848-466d-9cfc-0b9f4f835b8c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a23de49b80643eaab7a212f2884d62e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59391272ecbe48b0aa736cb43807be1d', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:54:34.972904 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76da877d-3848-466d-9cfc-0b9f4f835b8c service swift] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:34.973196 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76da877d-3848-466d-9cfc-0b9f4f835b8c service swift] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:34.973479 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76da877d-3848-466d-9cfc-0b9f4f835b8c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:34.982284 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76da877d-3848-466d-9cfc-0b9f4f835b8c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:54:34.983883 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76da877d-3848-466d-9cfc-0b9f4f835b8c service swift] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:54:34.992466 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 1177/2369] 10.222.0.16 () {60 vars in 1384 bytes} [Thu Jul 14 10:54:34 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 14 10:54:40.343137 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c53db76-f7a7-4c18-98ec-290f1b30ae43 None None] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:54:40.347023 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-8c53db76-f7a7-4c18-98ec-290f1b30ae43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:54:40.407583 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:DELETE=8,keystone:SELECT=91,keystone:INSERT=1 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:54:40.447556 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c53db76-f7a7-4c18-98ec-290f1b30ae43 None None] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:54:40.455192 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced79ded-a8d9-4a14-84ca-7d1566751915 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:54:40.456616 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced79ded-a8d9-4a14-84ca-7d1566751915 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:40.456994 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced79ded-a8d9-4a14-84ca-7d1566751915 admin admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:40.457250 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced79ded-a8d9-4a14-84ca-7d1566751915 admin admin] PATH_INFO: `/v3/users/9ae4697d243b42938d3406d39de6f23b` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:40.458595 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced79ded-a8d9-4a14-84ca-7d1566751915 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9ae4697d243b42938d3406d39de6f23b)` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:54:40.463825 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced79ded-a8d9-4a14-84ca-7d1566751915 admin admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:54:40.535888 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-ced79ded-a8d9-4a14-84ca-7d1566751915 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9ae4697d243b42938d3406d39de6f23b'} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:54:40.547315 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-ced79ded-a8d9-4a14-84ca-7d1566751915 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9ae4697d243b42938d3406d39de6f23b'} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:54:40.548083 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-ced79ded-a8d9-4a14-84ca-7d1566751915 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9ae4697d243b42938d3406d39de6f23b'} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:54:40.559783 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-ced79ded-a8d9-4a14-84ca-7d1566751915 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9ae4697d243b42938d3406d39de6f23b'} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:54:40.560603 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-ced79ded-a8d9-4a14-84ca-7d1566751915 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9ae4697d243b42938d3406d39de6f23b'} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:54:40.586525 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 1193/2370] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Jul 14 10:54:40 2022] DELETE /identity/v3/users/9ae4697d243b42938d3406d39de6f23b => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:54:40.592571 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310b71ae-c12c-4d91-b532-f640fabb0eba None None] REQUEST_METHOD: `POST` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:40.593778 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310b71ae-c12c-4d91-b532-f640fabb0eba None None] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:40.593778 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310b71ae-c12c-4d91-b532-f640fabb0eba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:40.623870 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.auth.core [None req-310b71ae-c12c-4d91-b532-f640fabb0eba None None] MFA Rules not processed for user `ae4bcdd8106d4bebbdcae96be33505bc`. Rule list: `[]` (Enabled: `True`). {{(pid=86656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:54:40.626428 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-310b71ae-c12c-4d91-b532-f640fabb0eba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:54:40.723384 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 1178/2371] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jul 14 10:54:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:54:40.738226 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced79ded-a8d9-4a14-84ca-7d1566751915 admin admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:54:40.739681 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-ced79ded-a8d9-4a14-84ca-7d1566751915 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:54:40.864292 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced79ded-a8d9-4a14-84ca-7d1566751915 admin admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:54:40.870165 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7c428b-4c30-4a70-a9f0-c57bba42dcdc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dddf93691844886982c91fea974385d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59391272ecbe48b0aa736cb43807be1d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:54:40.871416 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7c428b-4c30-4a70-a9f0-c57bba42dcdc service neutron] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:40.871711 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7c428b-4c30-4a70-a9f0-c57bba42dcdc service neutron] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:40.871993 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7c428b-4c30-4a70-a9f0-c57bba42dcdc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:40.885100 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7c428b-4c30-4a70-a9f0-c57bba42dcdc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:54:40.887812 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7c428b-4c30-4a70-a9f0-c57bba42dcdc service neutron] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:54:40.904733 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 1194/2372] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jul 14 10:54:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:54:41.598313 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310b71ae-c12c-4d91-b532-f640fabb0eba None None] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:54:41.599759 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-310b71ae-c12c-4d91-b532-f640fabb0eba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:54:41.620750 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310b71ae-c12c-4d91-b532-f640fabb0eba None None] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:54:41.632241 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59044fb0-b87b-4a86-b593-493444349c95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:54:41.633365 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59044fb0-b87b-4a86-b593-493444349c95 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:41.633708 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59044fb0-b87b-4a86-b593-493444349c95 admin admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:41.634334 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59044fb0-b87b-4a86-b593-493444349c95 admin admin] PATH_INFO: `/v3/projects/3ad2261344634b5db40fb0e29915fe1d` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:41.636926 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59044fb0-b87b-4a86-b593-493444349c95 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3ad2261344634b5db40fb0e29915fe1d)` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:54:41.640958 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59044fb0-b87b-4a86-b593-493444349c95 admin admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:54:41.718490 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-59044fb0-b87b-4a86-b593-493444349c95 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3ad2261344634b5db40fb0e29915fe1d', 'request_id': 'req-59044fb0-b87b-4a86-b593-493444349c95'} {{(pid=86656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:54:41.729864 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-59044fb0-b87b-4a86-b593-493444349c95 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3ad2261344634b5db40fb0e29915fe1d', 'request_id': 'req-59044fb0-b87b-4a86-b593-493444349c95'} {{(pid=86656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:54:41.739372 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-59044fb0-b87b-4a86-b593-493444349c95 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3ad2261344634b5db40fb0e29915fe1d', 'request_id': 'req-59044fb0-b87b-4a86-b593-493444349c95'} {{(pid=86656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:54:41.757259 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-59044fb0-b87b-4a86-b593-493444349c95 admin admin] The token cache is being invalidate because project 3ad2261344634b5db40fb0e29915fe1d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86656) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 10:54:41.757759 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-59044fb0-b87b-4a86-b593-493444349c95 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:54:41.758618 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-59044fb0-b87b-4a86-b593-493444349c95 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:54:41.760739 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 1179/2373] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Jul 14 10:54:41 2022] DELETE /identity/v3/projects/3ad2261344634b5db40fb0e29915fe1d => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:54:41.766006 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2c63c1-f794-4752-b57d-f0a24f4833a4 None None] REQUEST_METHOD: `POST` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:41.766533 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2c63c1-f794-4752-b57d-f0a24f4833a4 None None] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:41.766533 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2c63c1-f794-4752-b57d-f0a24f4833a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:41.787743 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.auth.core [None req-2d2c63c1-f794-4752-b57d-f0a24f4833a4 None None] MFA Rules not processed for user `ae4bcdd8106d4bebbdcae96be33505bc`. Rule list: `[]` (Enabled: `True`). {{(pid=86655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:54:41.789024 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-2d2c63c1-f794-4752-b57d-f0a24f4833a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:54:41.930100 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbb494b-363b-45ad-9307-fdfc94a9e64f None None] REQUEST_METHOD: `POST` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:41.930530 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbb494b-363b-45ad-9307-fdfc94a9e64f None None] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:41.930949 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbb494b-363b-45ad-9307-fdfc94a9e64f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:41.935897 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 1195/2374] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jul 14 10:54:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:54:41.963088 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.auth.core [None req-0dbb494b-363b-45ad-9307-fdfc94a9e64f None None] MFA Rules not processed for user `ae4bcdd8106d4bebbdcae96be33505bc`. Rule list: `[]` (Enabled: `True`). {{(pid=86656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:54:41.964972 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-0dbb494b-363b-45ad-9307-fdfc94a9e64f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:54:41.982152 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 1180/2375] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jul 14 10:54:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 10:54:41.984563 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2c63c1-f794-4752-b57d-f0a24f4833a4 None None] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:54:42.011345 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2c63c1-f794-4752-b57d-f0a24f4833a4 None None] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:54:42.026260 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48e2b7c-fbd5-45dc-b4c0-01983e9c30c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:54:42.034898 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48e2b7c-fbd5-45dc-b4c0-01983e9c30c3 admin admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:42.035401 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48e2b7c-fbd5-45dc-b4c0-01983e9c30c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:42.036007 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48e2b7c-fbd5-45dc-b4c0-01983e9c30c3 admin admin] PATH_INFO: `/v3/domains` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:42.037229 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48e2b7c-fbd5-45dc-b4c0-01983e9c30c3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:54:42.037799 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48e2b7c-fbd5-45dc-b4c0-01983e9c30c3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:54:42.039858 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48e2b7c-fbd5-45dc-b4c0-01983e9c30c3 admin admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:54:42.042035 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:54:42.074913 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 1196/2376] 10.222.0.16 () {58 vars in 1152 bytes} [Thu Jul 14 10:54:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:54:42.080231 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbb494b-363b-45ad-9307-fdfc94a9e64f None None] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:54:42.103868 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbb494b-363b-45ad-9307-fdfc94a9e64f None None] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:54:42.111125 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8491a9a-6898-4896-be5b-b82099281121 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:54:42.114236 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8491a9a-6898-4896-be5b-b82099281121 admin admin] REQUEST_METHOD: `POST` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:42.115387 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8491a9a-6898-4896-be5b-b82099281121 admin admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:42.116327 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8491a9a-6898-4896-be5b-b82099281121 admin admin] PATH_INFO: `/v3/projects` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:42.117606 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8491a9a-6898-4896-be5b-b82099281121 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:54:42.125399 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8491a9a-6898-4896-be5b-b82099281121 admin admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:54:42.173247 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 1181/2377] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Jul 14 10:54:42 2022] POST /identity/v3/projects => generated 377 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:54:42.177027 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48e2b7c-fbd5-45dc-b4c0-01983e9c30c3 admin admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:54:42.194273 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48e2b7c-fbd5-45dc-b4c0-01983e9c30c3 admin admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:54:42.292959 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7759ad3b-e4a5-41ca-a3ce-ced5b7225d36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:54:42.294052 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7759ad3b-e4a5-41ca-a3ce-ced5b7225d36 admin admin] REQUEST_METHOD: `POST` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:42.294451 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7759ad3b-e4a5-41ca-a3ce-ced5b7225d36 admin admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:42.294923 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7759ad3b-e4a5-41ca-a3ce-ced5b7225d36 admin admin] PATH_INFO: `/v3/users` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:42.295910 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7759ad3b-e4a5-41ca-a3ce-ced5b7225d36 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:54:42.299266 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7759ad3b-e4a5-41ca-a3ce-ced5b7225d36 admin admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:54:42.327792 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 1197/2378] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Jul 14 10:54:42 2022] POST /identity/v3/users => generated 289 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:54:42.331831 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8491a9a-6898-4896-be5b-b82099281121 admin admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:54:42.334407 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116e13e9-c336-4d9e-a115-bb0d31978b4a None None] REQUEST_METHOD: `POST` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:42.334703 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116e13e9-c336-4d9e-a115-bb0d31978b4a None None] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:42.335005 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116e13e9-c336-4d9e-a115-bb0d31978b4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:42.337795 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:54:42.353877 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8491a9a-6898-4896-be5b-b82099281121 admin admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:54:42.362658 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb139a2-6dd5-4ae3-ad1e-167c7e79a340 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:54:42.363813 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb139a2-6dd5-4ae3-ad1e-167c7e79a340 admin admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:42.363973 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb139a2-6dd5-4ae3-ad1e-167c7e79a340 admin admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:42.364427 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb139a2-6dd5-4ae3-ad1e-167c7e79a340 admin admin] PATH_INFO: `/v3/roles` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:42.364877 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.auth.core [None req-116e13e9-c336-4d9e-a115-bb0d31978b4a None None] MFA Rules not processed for user `fae8e5bd232344cca09294651f4cd93e`. Rule list: `[]` (Enabled: `True`). {{(pid=86655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:54:42.365768 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb139a2-6dd5-4ae3-ad1e-167c7e79a340 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:54:42.366795 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-116e13e9-c336-4d9e-a115-bb0d31978b4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:54:42.368563 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb139a2-6dd5-4ae3-ad1e-167c7e79a340 admin admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:54:42.389842 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 1182/2379] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jul 14 10:54:42 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:54:42.392280 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb139a2-6dd5-4ae3-ad1e-167c7e79a340 admin admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:54:42.410260 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb139a2-6dd5-4ae3-ad1e-167c7e79a340 admin admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:54:42.415855 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec218c45-7183-4b60-8393-87bed9092257 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:54:42.419431 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec218c45-7183-4b60-8393-87bed9092257 admin admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:42.419786 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec218c45-7183-4b60-8393-87bed9092257 admin admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:42.420028 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec218c45-7183-4b60-8393-87bed9092257 admin admin] PATH_INFO: `/v3/roles` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:42.420996 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec218c45-7183-4b60-8393-87bed9092257 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:54:42.422762 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec218c45-7183-4b60-8393-87bed9092257 admin admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:54:42.437939 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 1183/2380] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jul 14 10:54:42 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 10:54:42.441665 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec218c45-7183-4b60-8393-87bed9092257 admin admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:54:42.455809 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec218c45-7183-4b60-8393-87bed9092257 admin admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:54:42.457078 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 1198/2381] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jul 14 10:54:42 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:54:42.476158 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efba8c3-c284-4ee1-8422-8acd49c12a22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:54:42.481164 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efba8c3-c284-4ee1-8422-8acd49c12a22 admin admin] REQUEST_METHOD: `PUT` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:42.481703 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efba8c3-c284-4ee1-8422-8acd49c12a22 admin admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:42.482087 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efba8c3-c284-4ee1-8422-8acd49c12a22 admin admin] PATH_INFO: `/v3/projects/f2551532fc494e27b2f453a7d69b56df/users/104ed994cf8d4391b6eb68a77c62644d/roles/0da46c267d354cce81495dfdd56c1ec2` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:42.511596 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0efba8c3-c284-4ee1-8422-8acd49c12a22 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f2551532fc494e27b2f453a7d69b56df, user_id=104ed994cf8d4391b6eb68a77c62644d, role_id=0da46c267d354cce81495dfdd56c1ec2)` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:54:42.514631 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0efba8c3-c284-4ee1-8422-8acd49c12a22 admin admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:54:42.535692 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 1184/2382] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Jul 14 10:54:42 2022] PUT /identity/v3/projects/f2551532fc494e27b2f453a7d69b56df/users/104ed994cf8d4391b6eb68a77c62644d/roles/0da46c267d354cce81495dfdd56c1ec2 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 10:54:42.610789 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bf874f-2015-46eb-94dd-026313bb8926 None None] REQUEST_METHOD: `POST` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:42.611097 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bf874f-2015-46eb-94dd-026313bb8926 None None] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:42.611386 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bf874f-2015-46eb-94dd-026313bb8926 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:42.648267 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.auth.core [None req-d2bf874f-2015-46eb-94dd-026313bb8926 None None] MFA Rules not processed for user `104ed994cf8d4391b6eb68a77c62644d`. Rule list: `[]` (Enabled: `True`). {{(pid=86655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:54:42.662034 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-d2bf874f-2015-46eb-94dd-026313bb8926 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:54:42.771084 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 1199/2383] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jul 14 10:54:42 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:54:42.775562 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efba8c3-c284-4ee1-8422-8acd49c12a22 admin admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:54:42.875006 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efba8c3-c284-4ee1-8422-8acd49c12a22 admin admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:54:42.880608 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab9b974-ebdc-480e-94e2-caefb2c37214 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:54:42.881580 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab9b974-ebdc-480e-94e2-caefb2c37214 admin admin] REQUEST_METHOD: `POST` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:42.881913 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab9b974-ebdc-480e-94e2-caefb2c37214 admin admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:42.882208 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab9b974-ebdc-480e-94e2-caefb2c37214 admin admin] PATH_INFO: `/v3/projects` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:42.883019 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab9b974-ebdc-480e-94e2-caefb2c37214 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:54:42.885264 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab9b974-ebdc-480e-94e2-caefb2c37214 admin admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:54:42.968248 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 1185/2384] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Jul 14 10:54:42 2022] POST /identity/v3/projects => generated 377 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:54:42.980945 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2bf874f-2015-46eb-94dd-026313bb8926 None None] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:54:43.019239 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2bf874f-2015-46eb-94dd-026313bb8926 None None] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:54:43.049592 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:54:43.163582 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905c1221-0149-4779-964c-391cbdc6862a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:54:43.165956 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905c1221-0149-4779-964c-391cbdc6862a admin admin] REQUEST_METHOD: `POST` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:43.166323 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905c1221-0149-4779-964c-391cbdc6862a admin admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:43.166678 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905c1221-0149-4779-964c-391cbdc6862a admin admin] PATH_INFO: `/v3/users` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:43.168508 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905c1221-0149-4779-964c-391cbdc6862a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:54:43.171849 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905c1221-0149-4779-964c-391cbdc6862a admin admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:54:43.212090 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 1200/2385] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Jul 14 10:54:42 2022] POST /identity/v3/users => generated 289 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:54:43.217859 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab9b974-ebdc-480e-94e2-caefb2c37214 admin admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:54:43.232137 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab9b974-ebdc-480e-94e2-caefb2c37214 admin admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:54:43.249645 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2360059c-6245-4e13-822a-e482ec4280fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:54:43.250406 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2360059c-6245-4e13-822a-e482ec4280fd admin admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:43.250829 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2360059c-6245-4e13-822a-e482ec4280fd admin admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:43.251116 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2360059c-6245-4e13-822a-e482ec4280fd admin admin] PATH_INFO: `/v3/roles` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:43.251871 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2360059c-6245-4e13-822a-e482ec4280fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:54:43.253532 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2360059c-6245-4e13-822a-e482ec4280fd admin admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:54:43.275746 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 1186/2386] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jul 14 10:54:43 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:54:43.281323 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905c1221-0149-4779-964c-391cbdc6862a admin admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:54:43.299530 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905c1221-0149-4779-964c-391cbdc6862a admin admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:54:43.312515 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819b465a-5454-490f-a6dc-25b1b48eba73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:54:43.313179 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819b465a-5454-490f-a6dc-25b1b48eba73 admin admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:43.313476 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819b465a-5454-490f-a6dc-25b1b48eba73 admin admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:43.313756 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819b465a-5454-490f-a6dc-25b1b48eba73 admin admin] PATH_INFO: `/v3/roles` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:43.315095 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819b465a-5454-490f-a6dc-25b1b48eba73 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:54:43.316912 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819b465a-5454-490f-a6dc-25b1b48eba73 admin admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:54:43.337260 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 1201/2387] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jul 14 10:54:43 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:54:43.338500 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2360059c-6245-4e13-822a-e482ec4280fd admin admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:54:43.351570 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2360059c-6245-4e13-822a-e482ec4280fd admin admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:54:43.370221 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a8be3e-4efe-4dcc-9894-86ca1c546a72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:54:43.371972 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a8be3e-4efe-4dcc-9894-86ca1c546a72 admin admin] REQUEST_METHOD: `PUT` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:43.372427 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a8be3e-4efe-4dcc-9894-86ca1c546a72 admin admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:43.372918 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a8be3e-4efe-4dcc-9894-86ca1c546a72 admin admin] PATH_INFO: `/v3/projects/37f9d433633946fbbe2f196a291e4f49/users/a19496f981224353b953c2c660761cfe/roles/0da46c267d354cce81495dfdd56c1ec2` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:43.393771 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a8be3e-4efe-4dcc-9894-86ca1c546a72 admin admin] RBAC: Authorizing `identity:create_grant(project_id=37f9d433633946fbbe2f196a291e4f49, user_id=a19496f981224353b953c2c660761cfe, role_id=0da46c267d354cce81495dfdd56c1ec2)` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:54:43.396626 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a8be3e-4efe-4dcc-9894-86ca1c546a72 admin admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:54:43.415625 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 1187/2388] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Jul 14 10:54:43 2022] PUT /identity/v3/projects/37f9d433633946fbbe2f196a291e4f49/users/a19496f981224353b953c2c660761cfe/roles/0da46c267d354cce81495dfdd56c1ec2 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:54:43.427916 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1273a0af-2a62-48b4-99f0-9a02cc0a74f3 None None] REQUEST_METHOD: `POST` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:43.428213 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1273a0af-2a62-48b4-99f0-9a02cc0a74f3 None None] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:43.428614 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1273a0af-2a62-48b4-99f0-9a02cc0a74f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:43.466572 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.auth.core [None req-1273a0af-2a62-48b4-99f0-9a02cc0a74f3 None None] MFA Rules not processed for user `a19496f981224353b953c2c660761cfe`. Rule list: `[]` (Enabled: `True`). {{(pid=86655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:54:43.467909 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-1273a0af-2a62-48b4-99f0-9a02cc0a74f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:54:43.578603 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 1202/2389] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jul 14 10:54:43 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:54:43.583328 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a8be3e-4efe-4dcc-9894-86ca1c546a72 admin admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:54:43.694632 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a8be3e-4efe-4dcc-9894-86ca1c546a72 admin admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:54:43.701669 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfda8a78-e2fd-4c08-a17b-8cd0e24930a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:54:43.703031 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfda8a78-e2fd-4c08-a17b-8cd0e24930a6 admin admin] REQUEST_METHOD: `POST` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:43.703665 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfda8a78-e2fd-4c08-a17b-8cd0e24930a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:43.704355 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfda8a78-e2fd-4c08-a17b-8cd0e24930a6 admin admin] PATH_INFO: `/v3/projects` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:43.705636 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfda8a78-e2fd-4c08-a17b-8cd0e24930a6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:54:43.713035 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfda8a78-e2fd-4c08-a17b-8cd0e24930a6 admin admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:54:43.728938 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:54:43.766136 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1273a0af-2a62-48b4-99f0-9a02cc0a74f3 None None] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:54:43.773422 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 1188/2390] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Jul 14 10:54:43 2022] POST /identity/v3/projects => generated 375 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:54:43.782838 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1273a0af-2a62-48b4-99f0-9a02cc0a74f3 None None] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:54:43.880050 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f9e243-b4f1-4295-9059-8c0ecf61561b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:54:43.880829 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f9e243-b4f1-4295-9059-8c0ecf61561b admin admin] REQUEST_METHOD: `POST` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:43.881131 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f9e243-b4f1-4295-9059-8c0ecf61561b admin admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:43.881386 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f9e243-b4f1-4295-9059-8c0ecf61561b admin admin] PATH_INFO: `/v3/users` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:43.882253 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f9e243-b4f1-4295-9059-8c0ecf61561b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:54:43.884479 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f9e243-b4f1-4295-9059-8c0ecf61561b admin admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:54:43.916552 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfda8a78-e2fd-4c08-a17b-8cd0e24930a6 admin admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:54:43.925255 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 1203/2391] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Jul 14 10:54:43 2022] POST /identity/v3/users => generated 294 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:54:43.929491 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfda8a78-e2fd-4c08-a17b-8cd0e24930a6 admin admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:54:43.936315 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b784c96a-1e9c-46b2-b34d-5be862e8da39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:54:43.936989 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b784c96a-1e9c-46b2-b34d-5be862e8da39 admin admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:43.937305 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b784c96a-1e9c-46b2-b34d-5be862e8da39 admin admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:43.938031 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b784c96a-1e9c-46b2-b34d-5be862e8da39 admin admin] PATH_INFO: `/v3/roles` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:43.938805 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b784c96a-1e9c-46b2-b34d-5be862e8da39 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:54:43.940577 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b784c96a-1e9c-46b2-b34d-5be862e8da39 admin admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:54:43.958433 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 1189/2392] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jul 14 10:54:43 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:54:43.962871 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f9e243-b4f1-4295-9059-8c0ecf61561b admin admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:54:43.974570 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f9e243-b4f1-4295-9059-8c0ecf61561b admin admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:54:43.984083 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79117a9a-34ef-41d8-b06e-2bd0233542f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:54:43.986273 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79117a9a-34ef-41d8-b06e-2bd0233542f1 admin admin] REQUEST_METHOD: `PUT` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:43.986975 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79117a9a-34ef-41d8-b06e-2bd0233542f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:43.987975 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79117a9a-34ef-41d8-b06e-2bd0233542f1 admin admin] PATH_INFO: `/v3/projects/7e939249031e48d8bd5256d7c54a9751/users/59d203f1657a45cb8ed661ee33bc191c/roles/153539819e5542df99269d2913bbecfb` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:44.012622 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:54:44.023361 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79117a9a-34ef-41d8-b06e-2bd0233542f1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7e939249031e48d8bd5256d7c54a9751, user_id=59d203f1657a45cb8ed661ee33bc191c, role_id=153539819e5542df99269d2913bbecfb)` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:54:44.026625 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79117a9a-34ef-41d8-b06e-2bd0233542f1 admin admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:54:44.074308 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 1204/2393] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Jul 14 10:54:43 2022] PUT /identity/v3/projects/7e939249031e48d8bd5256d7c54a9751/users/59d203f1657a45cb8ed661ee33bc191c/roles/153539819e5542df99269d2913bbecfb => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:54:44.078531 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b784c96a-1e9c-46b2-b34d-5be862e8da39 admin admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:54:44.093960 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b784c96a-1e9c-46b2-b34d-5be862e8da39 admin admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:54:44.237640 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2a17fc-a007-44c0-802c-6c0c3369c0b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:54:44.238346 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2a17fc-a007-44c0-802c-6c0c3369c0b6 admin admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:44.238620 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2a17fc-a007-44c0-802c-6c0c3369c0b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:44.238897 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2a17fc-a007-44c0-802c-6c0c3369c0b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:44.239649 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2a17fc-a007-44c0-802c-6c0c3369c0b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:54:44.241305 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2a17fc-a007-44c0-802c-6c0c3369c0b6 admin admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:54:44.270173 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 1190/2394] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jul 14 10:54:44 2022] GET /identity/v3/roles => generated 1420 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:54:44.271428 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79117a9a-34ef-41d8-b06e-2bd0233542f1 admin admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:54:44.284726 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79117a9a-34ef-41d8-b06e-2bd0233542f1 admin admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:54:44.292144 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0223bc4a-2ed4-470f-92be-8b19e39cf90b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:54:44.294707 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0223bc4a-2ed4-470f-92be-8b19e39cf90b admin admin] REQUEST_METHOD: `PUT` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:44.295104 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0223bc4a-2ed4-470f-92be-8b19e39cf90b admin admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:44.295389 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0223bc4a-2ed4-470f-92be-8b19e39cf90b admin admin] PATH_INFO: `/v3/projects/7e939249031e48d8bd5256d7c54a9751/users/59d203f1657a45cb8ed661ee33bc191c/roles/153539819e5542df99269d2913bbecfb` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:44.300065 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0223bc4a-2ed4-470f-92be-8b19e39cf90b admin admin] RBAC: Authorizing `identity:create_grant(project_id=7e939249031e48d8bd5256d7c54a9751, user_id=59d203f1657a45cb8ed661ee33bc191c, role_id=153539819e5542df99269d2913bbecfb)` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:54:44.303004 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0223bc4a-2ed4-470f-92be-8b19e39cf90b admin admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:54:44.340546 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 1205/2395] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Jul 14 10:54:44 2022] PUT /identity/v3/projects/7e939249031e48d8bd5256d7c54a9751/users/59d203f1657a45cb8ed661ee33bc191c/roles/153539819e5542df99269d2913bbecfb => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:54:44.355408 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8328bfa-d55f-459d-a903-8e100553611c None None] REQUEST_METHOD: `POST` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:44.355987 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8328bfa-d55f-459d-a903-8e100553611c None None] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:44.356578 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8328bfa-d55f-459d-a903-8e100553611c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:44.392870 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.auth.core [None req-d8328bfa-d55f-459d-a903-8e100553611c None None] MFA Rules not processed for user `59d203f1657a45cb8ed661ee33bc191c`. Rule list: `[]` (Enabled: `True`). {{(pid=86656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:54:44.394404 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-d8328bfa-d55f-459d-a903-8e100553611c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:54:44.520542 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 1191/2396] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jul 14 10:54:44 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:54:44.527702 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0223bc4a-2ed4-470f-92be-8b19e39cf90b admin admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:54:44.530459 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-0223bc4a-2ed4-470f-92be-8b19e39cf90b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:54:44.616387 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0223bc4a-2ed4-470f-92be-8b19e39cf90b admin admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:54:44.621387 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af40ec9-deaf-4639-b450-d2bfb8242bb6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68382432147a48c3b62271fd2a2eab04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59391272ecbe48b0aa736cb43807be1d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:54:44.629554 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af40ec9-deaf-4639-b450-d2bfb8242bb6 service cinder] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:44.630053 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af40ec9-deaf-4639-b450-d2bfb8242bb6 service cinder] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:44.630528 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af40ec9-deaf-4639-b450-d2bfb8242bb6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:44.711204 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af40ec9-deaf-4639-b450-d2bfb8242bb6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:54:44.713160 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af40ec9-deaf-4639-b450-d2bfb8242bb6 service cinder] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:54:44.728229 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 1206/2397] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jul 14 10:54:44 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 10:54:46.637808 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8328bfa-d55f-459d-a903-8e100553611c None None] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:54:46.640635 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-d8328bfa-d55f-459d-a903-8e100553611c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:54:46.656569 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8328bfa-d55f-459d-a903-8e100553611c None None] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:54:46.661815 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bab3eeb-2850-4ab6-8c4c-ddba67651adf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68382432147a48c3b62271fd2a2eab04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59391272ecbe48b0aa736cb43807be1d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:54:46.662476 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bab3eeb-2850-4ab6-8c4c-ddba67651adf service cinder] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:46.662765 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bab3eeb-2850-4ab6-8c4c-ddba67651adf service cinder] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:46.663048 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bab3eeb-2850-4ab6-8c4c-ddba67651adf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:46.743618 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bab3eeb-2850-4ab6-8c4c-ddba67651adf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:54:46.745106 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bab3eeb-2850-4ab6-8c4c-ddba67651adf service cinder] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:54:46.751721 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:54:46.760955 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 1192/2398] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jul 14 10:54:46 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:54:47.740216 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af40ec9-deaf-4639-b450-d2bfb8242bb6 service cinder] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:54:47.754688 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af40ec9-deaf-4639-b450-d2bfb8242bb6 service cinder] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:54:47.766048 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff3f942-d515-4ba7-8982-d1d24816de24 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68382432147a48c3b62271fd2a2eab04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59391272ecbe48b0aa736cb43807be1d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:54:47.767078 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff3f942-d515-4ba7-8982-d1d24816de24 service cinder] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:47.767606 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff3f942-d515-4ba7-8982-d1d24816de24 service cinder] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:47.768119 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff3f942-d515-4ba7-8982-d1d24816de24 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:47.814699 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff3f942-d515-4ba7-8982-d1d24816de24 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:54:47.816689 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff3f942-d515-4ba7-8982-d1d24816de24 service cinder] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:54:47.832061 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 1207/2399] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jul 14 10:54:47 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:54:49.208825 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bab3eeb-2850-4ab6-8c4c-ddba67651adf service cinder] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:54:49.212885 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-0bab3eeb-2850-4ab6-8c4c-ddba67651adf service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:54:49.352235 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bab3eeb-2850-4ab6-8c4c-ddba67651adf service cinder] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:54:49.359413 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ad8129-1a81-49f7-aafa-28e316a1f271 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:54:49.360913 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ad8129-1a81-49f7-aafa-28e316a1f271 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:49.361357 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ad8129-1a81-49f7-aafa-28e316a1f271 admin admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:49.361996 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ad8129-1a81-49f7-aafa-28e316a1f271 admin admin] PATH_INFO: `/v3/users/d8d1c8a2e1a94ebbbb44e8fb61b4c180` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:49.363749 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ad8129-1a81-49f7-aafa-28e316a1f271 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d8d1c8a2e1a94ebbbb44e8fb61b4c180)` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:54:49.366317 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ad8129-1a81-49f7-aafa-28e316a1f271 admin admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:54:49.455467 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-08ad8129-1a81-49f7-aafa-28e316a1f271 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd8d1c8a2e1a94ebbbb44e8fb61b4c180'} {{(pid=86656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:54:49.469448 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-08ad8129-1a81-49f7-aafa-28e316a1f271 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd8d1c8a2e1a94ebbbb44e8fb61b4c180'} {{(pid=86656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:54:49.470721 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-08ad8129-1a81-49f7-aafa-28e316a1f271 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd8d1c8a2e1a94ebbbb44e8fb61b4c180'} {{(pid=86656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:54:49.484555 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-08ad8129-1a81-49f7-aafa-28e316a1f271 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd8d1c8a2e1a94ebbbb44e8fb61b4c180'} {{(pid=86656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:54:49.485431 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-08ad8129-1a81-49f7-aafa-28e316a1f271 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd8d1c8a2e1a94ebbbb44e8fb61b4c180'} {{(pid=86656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:54:49.523228 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 1193/2400] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Jul 14 10:54:49 2022] DELETE /identity/v3/users/d8d1c8a2e1a94ebbbb44e8fb61b4c180 => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:54:49.528122 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b010a9-097b-4915-89cd-2e54dc6f6cb3 None None] REQUEST_METHOD: `POST` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:49.528642 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b010a9-097b-4915-89cd-2e54dc6f6cb3 None None] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:49.528736 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b010a9-097b-4915-89cd-2e54dc6f6cb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:49.566758 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.auth.core [None req-f5b010a9-097b-4915-89cd-2e54dc6f6cb3 None None] MFA Rules not processed for user `ae4bcdd8106d4bebbdcae96be33505bc`. Rule list: `[]` (Enabled: `True`). {{(pid=86655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:54:49.568948 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-f5b010a9-097b-4915-89cd-2e54dc6f6cb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:54:49.658368 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 1208/2401] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jul 14 10:54:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:54:49.671150 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ad8129-1a81-49f7-aafa-28e316a1f271 admin admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:54:49.674030 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-08ad8129-1a81-49f7-aafa-28e316a1f271 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:54:49.767318 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ad8129-1a81-49f7-aafa-28e316a1f271 admin admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:54:49.772186 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8c70aa-9b41-466b-b5df-ab7c6bd4e6bb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dddf93691844886982c91fea974385d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59391272ecbe48b0aa736cb43807be1d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:54:49.773185 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8c70aa-9b41-466b-b5df-ab7c6bd4e6bb service neutron] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:49.773635 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8c70aa-9b41-466b-b5df-ab7c6bd4e6bb service neutron] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:49.773972 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8c70aa-9b41-466b-b5df-ab7c6bd4e6bb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:49.788580 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8c70aa-9b41-466b-b5df-ab7c6bd4e6bb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:54:49.790988 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8c70aa-9b41-466b-b5df-ab7c6bd4e6bb service neutron] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:54:49.804017 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 1194/2402] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jul 14 10:54:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:54:50.126775 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b010a9-097b-4915-89cd-2e54dc6f6cb3 None None] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:54:50.128930 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-f5b010a9-097b-4915-89cd-2e54dc6f6cb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:54:50.144488 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b010a9-097b-4915-89cd-2e54dc6f6cb3 None None] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:54:50.150072 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7407dd09-7c0b-480c-8acd-df01ffdd5c9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:54:50.151076 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7407dd09-7c0b-480c-8acd-df01ffdd5c9e admin admin] REQUEST_METHOD: `DELETE` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:50.151464 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7407dd09-7c0b-480c-8acd-df01ffdd5c9e admin admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:50.151929 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7407dd09-7c0b-480c-8acd-df01ffdd5c9e admin admin] PATH_INFO: `/v3/projects/5c1608af4e6b468c898482fc78655ed3` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:50.153562 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7407dd09-7c0b-480c-8acd-df01ffdd5c9e admin admin] RBAC: Authorizing `identity:delete_project(project_id=5c1608af4e6b468c898482fc78655ed3)` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:54:50.155606 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7407dd09-7c0b-480c-8acd-df01ffdd5c9e admin admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:54:50.183445 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:54:50.222956 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-7407dd09-7c0b-480c-8acd-df01ffdd5c9e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5c1608af4e6b468c898482fc78655ed3', 'request_id': 'req-7407dd09-7c0b-480c-8acd-df01ffdd5c9e'} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:54:50.229006 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-7407dd09-7c0b-480c-8acd-df01ffdd5c9e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5c1608af4e6b468c898482fc78655ed3', 'request_id': 'req-7407dd09-7c0b-480c-8acd-df01ffdd5c9e'} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:54:50.237350 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-7407dd09-7c0b-480c-8acd-df01ffdd5c9e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5c1608af4e6b468c898482fc78655ed3', 'request_id': 'req-7407dd09-7c0b-480c-8acd-df01ffdd5c9e'} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:54:50.250810 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-7407dd09-7c0b-480c-8acd-df01ffdd5c9e admin admin] The token cache is being invalidate because project 5c1608af4e6b468c898482fc78655ed3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86655) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 10:54:50.251231 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-7407dd09-7c0b-480c-8acd-df01ffdd5c9e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:54:50.251936 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-7407dd09-7c0b-480c-8acd-df01ffdd5c9e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:54:50.253622 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 1209/2403] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Jul 14 10:54:50 2022] DELETE /identity/v3/projects/5c1608af4e6b468c898482fc78655ed3 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:54:50.259563 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a40c48-7763-4a65-904c-868542bf5149 None None] REQUEST_METHOD: `POST` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:50.260066 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a40c48-7763-4a65-904c-868542bf5149 None None] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:50.260446 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a40c48-7763-4a65-904c-868542bf5149 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:50.285711 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.auth.core [None req-91a40c48-7763-4a65-904c-868542bf5149 None None] MFA Rules not processed for user `ae4bcdd8106d4bebbdcae96be33505bc`. Rule list: `[]` (Enabled: `True`). {{(pid=86656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:54:50.287203 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-91a40c48-7763-4a65-904c-868542bf5149 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:54:50.307443 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:54:50.360996 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 1195/2404] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jul 14 10:54:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:54:50.365795 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ec45be-c129-4fd1-9d56-b7f7244cc6b1 None None] REQUEST_METHOD: `POST` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:50.366349 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ec45be-c129-4fd1-9d56-b7f7244cc6b1 None None] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:50.366476 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ec45be-c129-4fd1-9d56-b7f7244cc6b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:50.389185 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.auth.core [None req-d7ec45be-c129-4fd1-9d56-b7f7244cc6b1 None None] MFA Rules not processed for user `ae4bcdd8106d4bebbdcae96be33505bc`. Rule list: `[]` (Enabled: `True`). {{(pid=86655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:54:50.390719 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-d7ec45be-c129-4fd1-9d56-b7f7244cc6b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:54:50.399402 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 1210/2405] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jul 14 10:54:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:54:50.404474 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a40c48-7763-4a65-904c-868542bf5149 None None] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:54:50.414628 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a40c48-7763-4a65-904c-868542bf5149 None None] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:54:50.421148 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617b7359-1393-42ef-b0f4-caf4d78df330 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:54:50.422126 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617b7359-1393-42ef-b0f4-caf4d78df330 admin admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:50.425217 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617b7359-1393-42ef-b0f4-caf4d78df330 admin admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:50.425217 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617b7359-1393-42ef-b0f4-caf4d78df330 admin admin] PATH_INFO: `/v3/domains` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:50.425217 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617b7359-1393-42ef-b0f4-caf4d78df330 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:54:50.425217 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617b7359-1393-42ef-b0f4-caf4d78df330 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:54:50.427862 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617b7359-1393-42ef-b0f4-caf4d78df330 admin admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:54:50.449253 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 1196/2406] 10.222.0.16 () {58 vars in 1152 bytes} [Thu Jul 14 10:54:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 10:54:50.454076 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ec45be-c129-4fd1-9d56-b7f7244cc6b1 None None] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:54:50.485938 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ec45be-c129-4fd1-9d56-b7f7244cc6b1 None None] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:54:50.501058 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930e66e9-ca97-4adc-8ccd-5cbcd98494d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:54:50.502102 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930e66e9-ca97-4adc-8ccd-5cbcd98494d0 admin admin] REQUEST_METHOD: `POST` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:50.502519 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930e66e9-ca97-4adc-8ccd-5cbcd98494d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:50.503043 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930e66e9-ca97-4adc-8ccd-5cbcd98494d0 admin admin] PATH_INFO: `/v3/projects` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:50.504218 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930e66e9-ca97-4adc-8ccd-5cbcd98494d0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:54:50.507929 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930e66e9-ca97-4adc-8ccd-5cbcd98494d0 admin admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:54:50.568404 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 1211/2407] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Jul 14 10:54:50 2022] POST /identity/v3/projects => generated 391 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:54:50.578613 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617b7359-1393-42ef-b0f4-caf4d78df330 admin admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:54:50.587369 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617b7359-1393-42ef-b0f4-caf4d78df330 admin admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:54:50.657439 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2474e2aa-7d33-474d-a53f-ce487dc83d21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:54:50.658293 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2474e2aa-7d33-474d-a53f-ce487dc83d21 admin admin] REQUEST_METHOD: `POST` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:50.658644 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2474e2aa-7d33-474d-a53f-ce487dc83d21 admin admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:50.658950 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2474e2aa-7d33-474d-a53f-ce487dc83d21 admin admin] PATH_INFO: `/v3/users` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:50.659945 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2474e2aa-7d33-474d-a53f-ce487dc83d21 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:54:50.662658 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2474e2aa-7d33-474d-a53f-ce487dc83d21 admin admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:54:50.696003 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 1197/2408] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Jul 14 10:54:50 2022] POST /identity/v3/users => generated 296 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:54:50.701308 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930e66e9-ca97-4adc-8ccd-5cbcd98494d0 admin admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:54:50.717643 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930e66e9-ca97-4adc-8ccd-5cbcd98494d0 admin admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:54:50.722829 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de9f7fe-2560-422c-bf76-cca513ecd8f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:54:50.723531 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de9f7fe-2560-422c-bf76-cca513ecd8f5 admin admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:50.723816 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de9f7fe-2560-422c-bf76-cca513ecd8f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:50.724098 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de9f7fe-2560-422c-bf76-cca513ecd8f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:50.725136 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de9f7fe-2560-422c-bf76-cca513ecd8f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:54:50.727351 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de9f7fe-2560-422c-bf76-cca513ecd8f5 admin admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:54:50.756090 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 1212/2409] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jul 14 10:54:50 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 10:54:50.760317 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2474e2aa-7d33-474d-a53f-ce487dc83d21 admin admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:54:50.776493 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2474e2aa-7d33-474d-a53f-ce487dc83d21 admin admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:54:50.783382 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a96094-3c82-479e-8a2b-3a07c4c5cb20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:54:50.784332 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a96094-3c82-479e-8a2b-3a07c4c5cb20 admin admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:50.784581 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a96094-3c82-479e-8a2b-3a07c4c5cb20 admin admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:50.785745 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a96094-3c82-479e-8a2b-3a07c4c5cb20 admin admin] PATH_INFO: `/v3/roles` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:50.786608 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a96094-3c82-479e-8a2b-3a07c4c5cb20 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:54:50.788719 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a96094-3c82-479e-8a2b-3a07c4c5cb20 admin admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:54:50.804031 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 1198/2410] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jul 14 10:54:50 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:54:50.814051 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de9f7fe-2560-422c-bf76-cca513ecd8f5 admin admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:54:50.831738 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de9f7fe-2560-422c-bf76-cca513ecd8f5 admin admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:54:50.837169 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf1c62d-d58d-4f6b-a1d9-78a39dbb7c57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:54:50.838869 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf1c62d-d58d-4f6b-a1d9-78a39dbb7c57 admin admin] REQUEST_METHOD: `PUT` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:50.839373 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf1c62d-d58d-4f6b-a1d9-78a39dbb7c57 admin admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:50.839750 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf1c62d-d58d-4f6b-a1d9-78a39dbb7c57 admin admin] PATH_INFO: `/v3/projects/fe2864f38cb14a44a86137f1f1a9219b/users/51d5efcf8bda4eb1ab54fec1a7097b4a/roles/0da46c267d354cce81495dfdd56c1ec2` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:50.865537 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf1c62d-d58d-4f6b-a1d9-78a39dbb7c57 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fe2864f38cb14a44a86137f1f1a9219b, user_id=51d5efcf8bda4eb1ab54fec1a7097b4a, role_id=0da46c267d354cce81495dfdd56c1ec2)` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:54:50.868516 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf1c62d-d58d-4f6b-a1d9-78a39dbb7c57 admin admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:54:50.899177 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 1213/2411] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Jul 14 10:54:50 2022] PUT /identity/v3/projects/fe2864f38cb14a44a86137f1f1a9219b/users/51d5efcf8bda4eb1ab54fec1a7097b4a/roles/0da46c267d354cce81495dfdd56c1ec2 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 10:54:50.901445 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dde15c4-954c-41b7-ab41-221695a8e8ab None None] REQUEST_METHOD: `POST` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:50.901632 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dde15c4-954c-41b7-ab41-221695a8e8ab None None] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:50.902556 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dde15c4-954c-41b7-ab41-221695a8e8ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:50.944469 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.auth.core [None req-2dde15c4-954c-41b7-ab41-221695a8e8ab None None] MFA Rules not processed for user `51d5efcf8bda4eb1ab54fec1a7097b4a`. Rule list: `[]` (Enabled: `True`). {{(pid=86656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:54:50.947706 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-2dde15c4-954c-41b7-ab41-221695a8e8ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:54:51.056596 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 1199/2412] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jul 14 10:54:50 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:54:51.068362 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf1c62d-d58d-4f6b-a1d9-78a39dbb7c57 admin admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:54:51.070741 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-7cf1c62d-d58d-4f6b-a1d9-78a39dbb7c57 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:54:51.141137 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf1c62d-d58d-4f6b-a1d9-78a39dbb7c57 admin admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:54:51.144858 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c313d9-9c5b-4f94-845b-e5a001e8e345 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68382432147a48c3b62271fd2a2eab04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59391272ecbe48b0aa736cb43807be1d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:54:51.145515 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c313d9-9c5b-4f94-845b-e5a001e8e345 service cinder] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:51.145804 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c313d9-9c5b-4f94-845b-e5a001e8e345 service cinder] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:51.146086 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c313d9-9c5b-4f94-845b-e5a001e8e345 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:51.158363 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c313d9-9c5b-4f94-845b-e5a001e8e345 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:54:51.159878 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c313d9-9c5b-4f94-845b-e5a001e8e345 service cinder] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:54:51.170574 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 1214/2413] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jul 14 10:54:51 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:54:52.142271 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dde15c4-954c-41b7-ab41-221695a8e8ab None None] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:54:52.143831 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-2dde15c4-954c-41b7-ab41-221695a8e8ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:54:52.187076 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:54:52.254149 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dde15c4-954c-41b7-ab41-221695a8e8ab None None] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:54:52.259432 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8666641-00c6-4d72-aeb4-97535006069d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:54:52.260703 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8666641-00c6-4d72-aeb4-97535006069d admin admin] REQUEST_METHOD: `DELETE` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:52.261946 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8666641-00c6-4d72-aeb4-97535006069d admin admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:52.262485 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8666641-00c6-4d72-aeb4-97535006069d admin admin] PATH_INFO: `/v3/users/104ed994cf8d4391b6eb68a77c62644d` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:52.264267 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8666641-00c6-4d72-aeb4-97535006069d admin admin] RBAC: Authorizing `identity:delete_user(user_id=104ed994cf8d4391b6eb68a77c62644d)` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:54:52.266779 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8666641-00c6-4d72-aeb4-97535006069d admin admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:54:52.337439 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-b8666641-00c6-4d72-aeb4-97535006069d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '104ed994cf8d4391b6eb68a77c62644d'} {{(pid=86656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:54:52.354337 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-b8666641-00c6-4d72-aeb4-97535006069d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '104ed994cf8d4391b6eb68a77c62644d'} {{(pid=86656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:54:52.356380 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-b8666641-00c6-4d72-aeb4-97535006069d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '104ed994cf8d4391b6eb68a77c62644d'} {{(pid=86656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:54:52.369536 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-b8666641-00c6-4d72-aeb4-97535006069d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '104ed994cf8d4391b6eb68a77c62644d'} {{(pid=86656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:54:52.371228 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-b8666641-00c6-4d72-aeb4-97535006069d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '104ed994cf8d4391b6eb68a77c62644d'} {{(pid=86656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:54:52.395447 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 1200/2414] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Jul 14 10:54:52 2022] DELETE /identity/v3/users/104ed994cf8d4391b6eb68a77c62644d => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:54:52.399774 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f953464a-8026-4797-9c1d-36b776251574 None None] REQUEST_METHOD: `POST` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:52.400334 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f953464a-8026-4797-9c1d-36b776251574 None None] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:52.400539 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f953464a-8026-4797-9c1d-36b776251574 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:52.420389 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.auth.core [None req-f953464a-8026-4797-9c1d-36b776251574 None None] MFA Rules not processed for user `ae4bcdd8106d4bebbdcae96be33505bc`. Rule list: `[]` (Enabled: `True`). {{(pid=86655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:54:52.422105 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-f953464a-8026-4797-9c1d-36b776251574 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:54:52.487602 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:54:52.542451 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 1215/2415] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jul 14 10:54:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:54:52.552887 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8666641-00c6-4d72-aeb4-97535006069d admin admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:54:52.558644 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-b8666641-00c6-4d72-aeb4-97535006069d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:54:52.653411 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8666641-00c6-4d72-aeb4-97535006069d admin admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:54:52.658743 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93190c1-1180-4317-8e64-909ea9d736d7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dddf93691844886982c91fea974385d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59391272ecbe48b0aa736cb43807be1d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:54:52.659504 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93190c1-1180-4317-8e64-909ea9d736d7 service neutron] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:52.659790 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93190c1-1180-4317-8e64-909ea9d736d7 service neutron] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:52.660112 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93190c1-1180-4317-8e64-909ea9d736d7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:52.681561 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93190c1-1180-4317-8e64-909ea9d736d7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:54:52.683904 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93190c1-1180-4317-8e64-909ea9d736d7 service neutron] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:54:52.700297 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 1201/2416] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jul 14 10:54:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:54:53.061721 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f953464a-8026-4797-9c1d-36b776251574 None None] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:54:53.064392 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-f953464a-8026-4797-9c1d-36b776251574 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:54:53.084977 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f953464a-8026-4797-9c1d-36b776251574 None None] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:54:53.089839 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6023d390-89d4-4778-a9ce-984c77c303b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:54:53.090724 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6023d390-89d4-4778-a9ce-984c77c303b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:53.091057 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6023d390-89d4-4778-a9ce-984c77c303b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:53.091353 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6023d390-89d4-4778-a9ce-984c77c303b6 admin admin] PATH_INFO: `/v3/projects/f2551532fc494e27b2f453a7d69b56df` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:53.092575 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6023d390-89d4-4778-a9ce-984c77c303b6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f2551532fc494e27b2f453a7d69b56df)` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:54:53.094571 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6023d390-89d4-4778-a9ce-984c77c303b6 admin admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:54:53.178776 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-6023d390-89d4-4778-a9ce-984c77c303b6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f2551532fc494e27b2f453a7d69b56df', 'request_id': 'req-6023d390-89d4-4778-a9ce-984c77c303b6'} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:54:53.192279 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-6023d390-89d4-4778-a9ce-984c77c303b6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f2551532fc494e27b2f453a7d69b56df', 'request_id': 'req-6023d390-89d4-4778-a9ce-984c77c303b6'} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:54:53.203531 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-6023d390-89d4-4778-a9ce-984c77c303b6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f2551532fc494e27b2f453a7d69b56df', 'request_id': 'req-6023d390-89d4-4778-a9ce-984c77c303b6'} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:54:53.223761 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-6023d390-89d4-4778-a9ce-984c77c303b6 admin admin] The token cache is being invalidate because project f2551532fc494e27b2f453a7d69b56df was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86655) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 10:54:53.224038 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-6023d390-89d4-4778-a9ce-984c77c303b6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:54:53.224720 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-6023d390-89d4-4778-a9ce-984c77c303b6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:54:53.226374 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 1216/2417] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Jul 14 10:54:53 2022] DELETE /identity/v3/projects/f2551532fc494e27b2f453a7d69b56df => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:54:53.232118 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93190c1-1180-4317-8e64-909ea9d736d7 service neutron] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:54:53.245425 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93190c1-1180-4317-8e64-909ea9d736d7 service neutron] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:54:53.322283 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:54:53.362575 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ae39e1-51e2-4b5f-a232-a3f7e4b07c66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:54:53.364021 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ae39e1-51e2-4b5f-a232-a3f7e4b07c66 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:53.364444 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ae39e1-51e2-4b5f-a232-a3f7e4b07c66 admin admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:53.364731 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ae39e1-51e2-4b5f-a232-a3f7e4b07c66 admin admin] PATH_INFO: `/v3/users/a19496f981224353b953c2c660761cfe` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:53.367654 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ae39e1-51e2-4b5f-a232-a3f7e4b07c66 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a19496f981224353b953c2c660761cfe)` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:54:53.371148 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ae39e1-51e2-4b5f-a232-a3f7e4b07c66 admin admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:54:53.450860 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-90ae39e1-51e2-4b5f-a232-a3f7e4b07c66 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a19496f981224353b953c2c660761cfe'} {{(pid=86656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:54:53.460094 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-90ae39e1-51e2-4b5f-a232-a3f7e4b07c66 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a19496f981224353b953c2c660761cfe'} {{(pid=86656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:54:53.460967 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-90ae39e1-51e2-4b5f-a232-a3f7e4b07c66 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a19496f981224353b953c2c660761cfe'} {{(pid=86656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:54:53.475072 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-90ae39e1-51e2-4b5f-a232-a3f7e4b07c66 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a19496f981224353b953c2c660761cfe'} {{(pid=86656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:54:53.476174 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-90ae39e1-51e2-4b5f-a232-a3f7e4b07c66 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a19496f981224353b953c2c660761cfe'} {{(pid=86656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:54:53.502827 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 1202/2418] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Jul 14 10:54:53 2022] DELETE /identity/v3/users/a19496f981224353b953c2c660761cfe => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 10:54:53.902500 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6023d390-89d4-4778-a9ce-984c77c303b6 admin admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:54:53.905652 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-6023d390-89d4-4778-a9ce-984c77c303b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:54:53.944417 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6023d390-89d4-4778-a9ce-984c77c303b6 admin admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:54:54.031887 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469c1894-149f-42e0-9277-3c683edc3ba9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:54:54.033230 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469c1894-149f-42e0-9277-3c683edc3ba9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:54.034553 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469c1894-149f-42e0-9277-3c683edc3ba9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:54.034798 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469c1894-149f-42e0-9277-3c683edc3ba9 admin admin] PATH_INFO: `/v3/projects/37f9d433633946fbbe2f196a291e4f49` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:54.036206 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469c1894-149f-42e0-9277-3c683edc3ba9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=37f9d433633946fbbe2f196a291e4f49)` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:54:54.038839 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469c1894-149f-42e0-9277-3c683edc3ba9 admin admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:54:54.127475 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-469c1894-149f-42e0-9277-3c683edc3ba9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '37f9d433633946fbbe2f196a291e4f49', 'request_id': 'req-469c1894-149f-42e0-9277-3c683edc3ba9'} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:54:54.133151 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-469c1894-149f-42e0-9277-3c683edc3ba9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '37f9d433633946fbbe2f196a291e4f49', 'request_id': 'req-469c1894-149f-42e0-9277-3c683edc3ba9'} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:54:54.141317 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-469c1894-149f-42e0-9277-3c683edc3ba9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '37f9d433633946fbbe2f196a291e4f49', 'request_id': 'req-469c1894-149f-42e0-9277-3c683edc3ba9'} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:54:54.143388 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:54:54.155117 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-469c1894-149f-42e0-9277-3c683edc3ba9 admin admin] The token cache is being invalidate because project 37f9d433633946fbbe2f196a291e4f49 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86655) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 10:54:54.155407 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-469c1894-149f-42e0-9277-3c683edc3ba9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:54:54.157041 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-469c1894-149f-42e0-9277-3c683edc3ba9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:54:54.160132 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 1217/2419] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Jul 14 10:54:53 2022] DELETE /identity/v3/projects/37f9d433633946fbbe2f196a291e4f49 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:54:54.163921 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ae39e1-51e2-4b5f-a232-a3f7e4b07c66 admin admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:54:54.165512 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-90ae39e1-51e2-4b5f-a232-a3f7e4b07c66 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:54:54.179052 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ae39e1-51e2-4b5f-a232-a3f7e4b07c66 admin admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:54:54.242017 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4306651d-1ce5-4c00-9515-9c9d1f56484e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:54:54.243087 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4306651d-1ce5-4c00-9515-9c9d1f56484e admin admin] REQUEST_METHOD: `DELETE` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:54.243377 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4306651d-1ce5-4c00-9515-9c9d1f56484e admin admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:54.243657 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4306651d-1ce5-4c00-9515-9c9d1f56484e admin admin] PATH_INFO: `/v3/users/59d203f1657a45cb8ed661ee33bc191c` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:54.245018 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4306651d-1ce5-4c00-9515-9c9d1f56484e admin admin] RBAC: Authorizing `identity:delete_user(user_id=59d203f1657a45cb8ed661ee33bc191c)` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:54:54.247066 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4306651d-1ce5-4c00-9515-9c9d1f56484e admin admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:54:54.327388 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-4306651d-1ce5-4c00-9515-9c9d1f56484e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '59d203f1657a45cb8ed661ee33bc191c'} {{(pid=86656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:54:54.336761 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-4306651d-1ce5-4c00-9515-9c9d1f56484e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '59d203f1657a45cb8ed661ee33bc191c'} {{(pid=86656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:54:54.337541 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-4306651d-1ce5-4c00-9515-9c9d1f56484e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '59d203f1657a45cb8ed661ee33bc191c'} {{(pid=86656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:54:54.345124 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=80,keystone:DELETE=18,keystone:INSERT=2 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:54:54.348278 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-4306651d-1ce5-4c00-9515-9c9d1f56484e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '59d203f1657a45cb8ed661ee33bc191c'} {{(pid=86656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:54:54.349406 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-4306651d-1ce5-4c00-9515-9c9d1f56484e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '59d203f1657a45cb8ed661ee33bc191c'} {{(pid=86656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:54:54.371605 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 1203/2420] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Jul 14 10:54:54 2022] DELETE /identity/v3/users/59d203f1657a45cb8ed661ee33bc191c => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 10:54:54.722814 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469c1894-149f-42e0-9277-3c683edc3ba9 admin admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:54:54.724400 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-469c1894-149f-42e0-9277-3c683edc3ba9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:54:54.748664 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469c1894-149f-42e0-9277-3c683edc3ba9 admin admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:54:54.818694 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e18b2e-1b7a-4d67-a1a1-62c23c66a0f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:54:54.819609 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e18b2e-1b7a-4d67-a1a1-62c23c66a0f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:54.819894 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e18b2e-1b7a-4d67-a1a1-62c23c66a0f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:54.820188 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e18b2e-1b7a-4d67-a1a1-62c23c66a0f4 admin admin] PATH_INFO: `/v3/projects/7e939249031e48d8bd5256d7c54a9751` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:54.821568 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e18b2e-1b7a-4d67-a1a1-62c23c66a0f4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7e939249031e48d8bd5256d7c54a9751)` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:54:54.824119 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e18b2e-1b7a-4d67-a1a1-62c23c66a0f4 admin admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:54:54.885388 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-94e18b2e-1b7a-4d67-a1a1-62c23c66a0f4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7e939249031e48d8bd5256d7c54a9751', 'request_id': 'req-94e18b2e-1b7a-4d67-a1a1-62c23c66a0f4'} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:54:54.893526 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-94e18b2e-1b7a-4d67-a1a1-62c23c66a0f4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7e939249031e48d8bd5256d7c54a9751', 'request_id': 'req-94e18b2e-1b7a-4d67-a1a1-62c23c66a0f4'} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:54:54.902423 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-94e18b2e-1b7a-4d67-a1a1-62c23c66a0f4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7e939249031e48d8bd5256d7c54a9751', 'request_id': 'req-94e18b2e-1b7a-4d67-a1a1-62c23c66a0f4'} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:54:54.916228 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-94e18b2e-1b7a-4d67-a1a1-62c23c66a0f4 admin admin] The token cache is being invalidate because project 7e939249031e48d8bd5256d7c54a9751 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86655) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 10:54:54.916907 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-94e18b2e-1b7a-4d67-a1a1-62c23c66a0f4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:54:54.917417 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-94e18b2e-1b7a-4d67-a1a1-62c23c66a0f4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:54:54.922497 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 1218/2421] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Jul 14 10:54:54 2022] DELETE /identity/v3/projects/7e939249031e48d8bd5256d7c54a9751 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:54:54.924382 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb64d7a-6d56-46b3-9085-89bc370ee709 None None] REQUEST_METHOD: `POST` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:54.924874 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb64d7a-6d56-46b3-9085-89bc370ee709 None None] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:54.925328 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb64d7a-6d56-46b3-9085-89bc370ee709 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:54.946899 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.auth.core [None req-bfb64d7a-6d56-46b3-9085-89bc370ee709 None None] MFA Rules not processed for user `ae4bcdd8106d4bebbdcae96be33505bc`. Rule list: `[]` (Enabled: `True`). {{(pid=86656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:54:54.948985 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-bfb64d7a-6d56-46b3-9085-89bc370ee709 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:54:55.019383 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 1204/2422] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jul 14 10:54:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:54:55.030887 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682f7e44-735e-4604-87b3-c08de0d41f4a None None] REQUEST_METHOD: `POST` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:55.031182 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682f7e44-735e-4604-87b3-c08de0d41f4a None None] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:55.031726 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682f7e44-735e-4604-87b3-c08de0d41f4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:55.056591 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.auth.core [None req-682f7e44-735e-4604-87b3-c08de0d41f4a None None] MFA Rules not processed for user `ae4bcdd8106d4bebbdcae96be33505bc`. Rule list: `[]` (Enabled: `True`). {{(pid=86655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:54:55.058358 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-682f7e44-735e-4604-87b3-c08de0d41f4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:54:55.070083 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 1219/2423] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jul 14 10:54:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:54:55.075471 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb64d7a-6d56-46b3-9085-89bc370ee709 None None] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:54:55.088673 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb64d7a-6d56-46b3-9085-89bc370ee709 None None] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:54:55.094721 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be02a740-6c70-44ad-b102-285416830c5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:54:55.095408 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be02a740-6c70-44ad-b102-285416830c5d admin admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:55.095836 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be02a740-6c70-44ad-b102-285416830c5d admin admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:55.096127 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be02a740-6c70-44ad-b102-285416830c5d admin admin] PATH_INFO: `/v3/domains` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:55.097084 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be02a740-6c70-44ad-b102-285416830c5d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:54:55.097248 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be02a740-6c70-44ad-b102-285416830c5d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:54:55.098959 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be02a740-6c70-44ad-b102-285416830c5d admin admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:54:55.113433 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 1205/2424] 10.222.0.16 () {58 vars in 1152 bytes} [Thu Jul 14 10:54:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:54:55.117901 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682f7e44-735e-4604-87b3-c08de0d41f4a None None] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:54:55.130899 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682f7e44-735e-4604-87b3-c08de0d41f4a None None] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:54:55.139961 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d018e2-7969-412a-b7c8-1fd9941be5e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:54:55.141122 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d018e2-7969-412a-b7c8-1fd9941be5e1 admin admin] REQUEST_METHOD: `POST` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:55.141733 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d018e2-7969-412a-b7c8-1fd9941be5e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:55.142148 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d018e2-7969-412a-b7c8-1fd9941be5e1 admin admin] PATH_INFO: `/v3/projects` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:55.143430 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d018e2-7969-412a-b7c8-1fd9941be5e1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:54:55.146074 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d018e2-7969-412a-b7c8-1fd9941be5e1 admin admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:54:55.196324 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 1220/2425] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Jul 14 10:54:55 2022] POST /identity/v3/projects => generated 361 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:54:55.201487 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be02a740-6c70-44ad-b102-285416830c5d admin admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:54:55.217188 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be02a740-6c70-44ad-b102-285416830c5d admin admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:54:55.297314 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7f8bf9-a312-4fa2-b0ad-69b50c93f1c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:54:55.298075 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7f8bf9-a312-4fa2-b0ad-69b50c93f1c2 admin admin] REQUEST_METHOD: `POST` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:55.298376 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7f8bf9-a312-4fa2-b0ad-69b50c93f1c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:55.298748 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7f8bf9-a312-4fa2-b0ad-69b50c93f1c2 admin admin] PATH_INFO: `/v3/users` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:55.299488 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7f8bf9-a312-4fa2-b0ad-69b50c93f1c2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:54:55.301880 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7f8bf9-a312-4fa2-b0ad-69b50c93f1c2 admin admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:54:55.332048 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 1206/2426] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Jul 14 10:54:55 2022] POST /identity/v3/users => generated 281 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 10:54:55.333280 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d018e2-7969-412a-b7c8-1fd9941be5e1 admin admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:54:55.360516 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d018e2-7969-412a-b7c8-1fd9941be5e1 admin admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:54:55.379758 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9424da-3046-4c8f-bd7d-301df2a67b89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:54:55.380691 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9424da-3046-4c8f-bd7d-301df2a67b89 admin admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:55.381295 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9424da-3046-4c8f-bd7d-301df2a67b89 admin admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:55.381511 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9424da-3046-4c8f-bd7d-301df2a67b89 admin admin] PATH_INFO: `/v3/roles` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:55.382561 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9424da-3046-4c8f-bd7d-301df2a67b89 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:54:55.384501 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9424da-3046-4c8f-bd7d-301df2a67b89 admin admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:54:55.434927 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 1221/2427] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jul 14 10:54:55 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:54:55.438925 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7f8bf9-a312-4fa2-b0ad-69b50c93f1c2 admin admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:54:55.451003 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7f8bf9-a312-4fa2-b0ad-69b50c93f1c2 admin admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:54:55.457678 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462946d6-80d8-4e5d-904d-cd6edad1d3e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:54:55.458624 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462946d6-80d8-4e5d-904d-cd6edad1d3e5 admin admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:55.459046 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462946d6-80d8-4e5d-904d-cd6edad1d3e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:55.459422 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462946d6-80d8-4e5d-904d-cd6edad1d3e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:55.460718 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462946d6-80d8-4e5d-904d-cd6edad1d3e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:54:55.462844 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462946d6-80d8-4e5d-904d-cd6edad1d3e5 admin admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:54:55.483715 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9424da-3046-4c8f-bd7d-301df2a67b89 admin admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:54:55.489520 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 1207/2428] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jul 14 10:54:55 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:54:55.496502 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9424da-3046-4c8f-bd7d-301df2a67b89 admin admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:54:55.502253 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fa4d6c-0cd9-4930-b6c5-e918596c7184 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:54:55.503278 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fa4d6c-0cd9-4930-b6c5-e918596c7184 admin admin] REQUEST_METHOD: `PUT` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:55.503666 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fa4d6c-0cd9-4930-b6c5-e918596c7184 admin admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:55.504040 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fa4d6c-0cd9-4930-b6c5-e918596c7184 admin admin] PATH_INFO: `/v3/projects/46f0e9452f0a4c7e8c16014bebd6b3b6/users/1305db51ffde44f6bd97b2b918bdbca7/roles/0da46c267d354cce81495dfdd56c1ec2` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:55.521592 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30fa4d6c-0cd9-4930-b6c5-e918596c7184 admin admin] RBAC: Authorizing `identity:create_grant(project_id=46f0e9452f0a4c7e8c16014bebd6b3b6, user_id=1305db51ffde44f6bd97b2b918bdbca7, role_id=0da46c267d354cce81495dfdd56c1ec2)` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:54:55.524714 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30fa4d6c-0cd9-4930-b6c5-e918596c7184 admin admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:54:55.550923 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 1222/2429] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Jul 14 10:54:55 2022] PUT /identity/v3/projects/46f0e9452f0a4c7e8c16014bebd6b3b6/users/1305db51ffde44f6bd97b2b918bdbca7/roles/0da46c267d354cce81495dfdd56c1ec2 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:54:55.552878 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5582c3ec-604d-47bc-869d-9a4703693848 None None] REQUEST_METHOD: `POST` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:55.553663 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5582c3ec-604d-47bc-869d-9a4703693848 None None] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:55.554044 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5582c3ec-604d-47bc-869d-9a4703693848 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:55.587826 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.auth.core [None req-5582c3ec-604d-47bc-869d-9a4703693848 None None] MFA Rules not processed for user `1305db51ffde44f6bd97b2b918bdbca7`. Rule list: `[]` (Enabled: `True`). {{(pid=86656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:54:55.590255 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-5582c3ec-604d-47bc-869d-9a4703693848 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:54:55.635336 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:54:55.701547 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 1208/2430] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jul 14 10:54:55 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 10:54:55.713103 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fa4d6c-0cd9-4930-b6c5-e918596c7184 admin admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:54:55.716408 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-30fa4d6c-0cd9-4930-b6c5-e918596c7184 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:54:55.744165 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:54:55.787766 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fa4d6c-0cd9-4930-b6c5-e918596c7184 admin admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:54:55.792798 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea51a16-4229-478e-8a90-91ec7b79207b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68382432147a48c3b62271fd2a2eab04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59391272ecbe48b0aa736cb43807be1d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:54:55.793609 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea51a16-4229-478e-8a90-91ec7b79207b service cinder] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:54:55.794026 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea51a16-4229-478e-8a90-91ec7b79207b service cinder] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:54:55.794479 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea51a16-4229-478e-8a90-91ec7b79207b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:54:55.805276 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea51a16-4229-478e-8a90-91ec7b79207b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:54:55.807663 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea51a16-4229-478e-8a90-91ec7b79207b service cinder] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:54:55.819631 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 1223/2431] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jul 14 10:54:55 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:55:00.262633 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d640f65b-3be9-4679-881c-1c6a35d89549 None None] REQUEST_METHOD: `POST` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:55:00.263233 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d640f65b-3be9-4679-881c-1c6a35d89549 None None] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:55:00.263233 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d640f65b-3be9-4679-881c-1c6a35d89549 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:55:00.285438 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.auth.core [None req-d640f65b-3be9-4679-881c-1c6a35d89549 None None] MFA Rules not processed for user `0dfc7cd9c05e4f268d2ce316d531c4bd`. Rule list: `[]` (Enabled: `True`). {{(pid=86656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:55:00.287023 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-d640f65b-3be9-4679-881c-1c6a35d89549 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:55:00.365471 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 1209/2432] 10.222.0.16 () {58 vars in 967 bytes} [Thu Jul 14 10:55:00 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 10:55:00.380973 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea51a16-4229-478e-8a90-91ec7b79207b service cinder] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:55:00.382999 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-8ea51a16-4229-478e-8a90-91ec7b79207b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:55:00.475702 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea51a16-4229-478e-8a90-91ec7b79207b service cinder] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:55:00.484028 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb46ab8-4aa9-493c-b16f-10ab7de81e37 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a23de49b80643eaab7a212f2884d62e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59391272ecbe48b0aa736cb43807be1d', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:55:00.485307 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb46ab8-4aa9-493c-b16f-10ab7de81e37 service swift] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:55:00.485307 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb46ab8-4aa9-493c-b16f-10ab7de81e37 service swift] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:55:00.485824 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb46ab8-4aa9-493c-b16f-10ab7de81e37 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:55:00.495147 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb46ab8-4aa9-493c-b16f-10ab7de81e37 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:55:00.497536 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb46ab8-4aa9-493c-b16f-10ab7de81e37 service swift] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:55:00.506954 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 1224/2433] 10.222.0.16 () {60 vars in 1384 bytes} [Thu Jul 14 10:55:00 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 14 10:55:01.836635 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d640f65b-3be9-4679-881c-1c6a35d89549 None None] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:55:01.838223 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-d640f65b-3be9-4679-881c-1c6a35d89549 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:55:01.907991 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d640f65b-3be9-4679-881c-1c6a35d89549 None None] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:55:01.912649 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adcfa7ed-b4bd-4425-8a10-0bb9caef05e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:55:01.913596 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcfa7ed-b4bd-4425-8a10-0bb9caef05e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:55:01.914009 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcfa7ed-b4bd-4425-8a10-0bb9caef05e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:55:01.914336 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcfa7ed-b4bd-4425-8a10-0bb9caef05e3 admin admin] PATH_INFO: `/v3/users/51d5efcf8bda4eb1ab54fec1a7097b4a` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:55:01.915996 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adcfa7ed-b4bd-4425-8a10-0bb9caef05e3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=51d5efcf8bda4eb1ab54fec1a7097b4a)` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:55:01.919041 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adcfa7ed-b4bd-4425-8a10-0bb9caef05e3 admin admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:55:01.967857 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-adcfa7ed-b4bd-4425-8a10-0bb9caef05e3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '51d5efcf8bda4eb1ab54fec1a7097b4a'} {{(pid=86656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:55:01.977411 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-adcfa7ed-b4bd-4425-8a10-0bb9caef05e3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '51d5efcf8bda4eb1ab54fec1a7097b4a'} {{(pid=86656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:55:01.978044 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-adcfa7ed-b4bd-4425-8a10-0bb9caef05e3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '51d5efcf8bda4eb1ab54fec1a7097b4a'} {{(pid=86656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:55:01.986488 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-adcfa7ed-b4bd-4425-8a10-0bb9caef05e3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '51d5efcf8bda4eb1ab54fec1a7097b4a'} {{(pid=86656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:55:01.987152 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-adcfa7ed-b4bd-4425-8a10-0bb9caef05e3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '51d5efcf8bda4eb1ab54fec1a7097b4a'} {{(pid=86656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:55:02.001146 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:55:02.007474 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 1210/2434] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Jul 14 10:55:01 2022] DELETE /identity/v3/users/51d5efcf8bda4eb1ab54fec1a7097b4a => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:55:02.012177 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94aa08bf-5505-485f-9910-dfda075335a0 None None] REQUEST_METHOD: `POST` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:55:02.012667 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94aa08bf-5505-485f-9910-dfda075335a0 None None] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:55:02.012796 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94aa08bf-5505-485f-9910-dfda075335a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:55:02.030251 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.auth.core [None req-94aa08bf-5505-485f-9910-dfda075335a0 None None] MFA Rules not processed for user `ae4bcdd8106d4bebbdcae96be33505bc`. Rule list: `[]` (Enabled: `True`). {{(pid=86655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:55:02.031449 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-94aa08bf-5505-485f-9910-dfda075335a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:55:02.092264 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 1225/2435] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jul 14 10:55:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:55:02.104274 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adcfa7ed-b4bd-4425-8a10-0bb9caef05e3 admin admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:55:02.107752 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-adcfa7ed-b4bd-4425-8a10-0bb9caef05e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:55:02.168830 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adcfa7ed-b4bd-4425-8a10-0bb9caef05e3 admin admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:55:02.172504 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5f301b-3c67-46cd-8dc8-963e36f32424 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dddf93691844886982c91fea974385d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59391272ecbe48b0aa736cb43807be1d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:55:02.173195 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5f301b-3c67-46cd-8dc8-963e36f32424 service neutron] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:55:02.173489 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5f301b-3c67-46cd-8dc8-963e36f32424 service neutron] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:55:02.173763 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5f301b-3c67-46cd-8dc8-963e36f32424 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:55:02.184104 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5f301b-3c67-46cd-8dc8-963e36f32424 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:55:02.185618 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5f301b-3c67-46cd-8dc8-963e36f32424 service neutron] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:55:02.196075 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 1211/2436] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jul 14 10:55:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:55:02.821770 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94aa08bf-5505-485f-9910-dfda075335a0 None None] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:55:02.823405 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-94aa08bf-5505-485f-9910-dfda075335a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:55:02.841554 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94aa08bf-5505-485f-9910-dfda075335a0 None None] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:55:02.847772 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0becf81-6350-4f46-80b0-7295e8a8be77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:55:02.849255 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0becf81-6350-4f46-80b0-7295e8a8be77 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:55:02.849763 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0becf81-6350-4f46-80b0-7295e8a8be77 admin admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:55:02.850502 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0becf81-6350-4f46-80b0-7295e8a8be77 admin admin] PATH_INFO: `/v3/projects/fe2864f38cb14a44a86137f1f1a9219b` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:55:02.852237 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0becf81-6350-4f46-80b0-7295e8a8be77 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fe2864f38cb14a44a86137f1f1a9219b)` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:55:02.855457 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0becf81-6350-4f46-80b0-7295e8a8be77 admin admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:55:02.923588 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-d0becf81-6350-4f46-80b0-7295e8a8be77 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fe2864f38cb14a44a86137f1f1a9219b', 'request_id': 'req-d0becf81-6350-4f46-80b0-7295e8a8be77'} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:55:02.929606 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:55:02.939843 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-d0becf81-6350-4f46-80b0-7295e8a8be77 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fe2864f38cb14a44a86137f1f1a9219b', 'request_id': 'req-d0becf81-6350-4f46-80b0-7295e8a8be77'} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:55:02.951534 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-d0becf81-6350-4f46-80b0-7295e8a8be77 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fe2864f38cb14a44a86137f1f1a9219b', 'request_id': 'req-d0becf81-6350-4f46-80b0-7295e8a8be77'} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:55:02.967628 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-d0becf81-6350-4f46-80b0-7295e8a8be77 admin admin] The token cache is being invalidate because project fe2864f38cb14a44a86137f1f1a9219b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86655) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 10:55:02.967943 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-d0becf81-6350-4f46-80b0-7295e8a8be77 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:55:02.968734 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-d0becf81-6350-4f46-80b0-7295e8a8be77 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:55:02.973689 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 1226/2437] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Jul 14 10:55:02 2022] DELETE /identity/v3/projects/fe2864f38cb14a44a86137f1f1a9219b => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 10:55:02.984382 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13e07b6-4395-4212-95d6-031434ebf6bd None None] REQUEST_METHOD: `POST` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:55:02.984885 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13e07b6-4395-4212-95d6-031434ebf6bd None None] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:55:02.985035 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13e07b6-4395-4212-95d6-031434ebf6bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:55:03.007583 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.auth.core [None req-f13e07b6-4395-4212-95d6-031434ebf6bd None None] MFA Rules not processed for user `ae4bcdd8106d4bebbdcae96be33505bc`. Rule list: `[]` (Enabled: `True`). {{(pid=86656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:55:03.009576 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-f13e07b6-4395-4212-95d6-031434ebf6bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:55:03.011915 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0becf81-6350-4f46-80b0-7295e8a8be77 admin admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:55:03.013357 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-d0becf81-6350-4f46-80b0-7295e8a8be77 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:55:03.101774 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 1212/2438] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jul 14 10:55:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:55:03.103088 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0becf81-6350-4f46-80b0-7295e8a8be77 admin admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:55:03.108734 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba335e39-7530-43f3-8235-16535490d655 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:55:03.109714 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba335e39-7530-43f3-8235-16535490d655 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:55:03.110401 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba335e39-7530-43f3-8235-16535490d655 admin admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:55:03.110786 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba335e39-7530-43f3-8235-16535490d655 admin admin] PATH_INFO: `/v3/users/e67b2b8b1f154708ac2d3d70fa24d6d0` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:55:03.111639 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa15d55-8b6a-4e42-9fdb-d925b16e85ff None None] REQUEST_METHOD: `POST` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:55:03.111933 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa15d55-8b6a-4e42-9fdb-d925b16e85ff None None] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:55:03.112348 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa15d55-8b6a-4e42-9fdb-d925b16e85ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:55:03.112554 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba335e39-7530-43f3-8235-16535490d655 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e67b2b8b1f154708ac2d3d70fa24d6d0)` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:55:03.114798 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba335e39-7530-43f3-8235-16535490d655 admin admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:55:03.145573 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.auth.core [None req-0aa15d55-8b6a-4e42-9fdb-d925b16e85ff None None] MFA Rules not processed for user `ae4bcdd8106d4bebbdcae96be33505bc`. Rule list: `[]` (Enabled: `True`). {{(pid=86656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:55:03.145573 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-0aa15d55-8b6a-4e42-9fdb-d925b16e85ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:55:03.160747 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 1213/2439] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jul 14 10:55:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 10:55:03.161714 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa15d55-8b6a-4e42-9fdb-d925b16e85ff None None] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:55:03.173670 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa15d55-8b6a-4e42-9fdb-d925b16e85ff None None] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:55:03.178993 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef22979e-06ab-47d5-804a-626da1ce87c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:55:03.179675 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef22979e-06ab-47d5-804a-626da1ce87c5 admin admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:55:03.179982 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef22979e-06ab-47d5-804a-626da1ce87c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:55:03.180241 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef22979e-06ab-47d5-804a-626da1ce87c5 admin admin] PATH_INFO: `/v3/domains` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:55:03.182140 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef22979e-06ab-47d5-804a-626da1ce87c5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:55:03.183545 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef22979e-06ab-47d5-804a-626da1ce87c5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:55:03.185757 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef22979e-06ab-47d5-804a-626da1ce87c5 admin admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:55:03.200009 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-ba335e39-7530-43f3-8235-16535490d655 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e67b2b8b1f154708ac2d3d70fa24d6d0'} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:55:03.217825 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 1214/2440] 10.222.0.16 () {58 vars in 1152 bytes} [Thu Jul 14 10:55:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:55:03.217825 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef22979e-06ab-47d5-804a-626da1ce87c5 admin admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:55:03.219336 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-ba335e39-7530-43f3-8235-16535490d655 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e67b2b8b1f154708ac2d3d70fa24d6d0'} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:55:03.220183 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-ba335e39-7530-43f3-8235-16535490d655 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e67b2b8b1f154708ac2d3d70fa24d6d0'} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:55:03.229128 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-ba335e39-7530-43f3-8235-16535490d655 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e67b2b8b1f154708ac2d3d70fa24d6d0'} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:55:03.231088 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef22979e-06ab-47d5-804a-626da1ce87c5 admin admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:55:03.231213 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-ba335e39-7530-43f3-8235-16535490d655 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e67b2b8b1f154708ac2d3d70fa24d6d0'} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:55:03.238089 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c019c594-6f40-4eff-a7ac-7701cd085b07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:55:03.238808 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c019c594-6f40-4eff-a7ac-7701cd085b07 admin admin] REQUEST_METHOD: `POST` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:55:03.239102 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c019c594-6f40-4eff-a7ac-7701cd085b07 admin admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:55:03.239384 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c019c594-6f40-4eff-a7ac-7701cd085b07 admin admin] PATH_INFO: `/v3/projects` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:55:03.240389 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c019c594-6f40-4eff-a7ac-7701cd085b07 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:55:03.242608 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c019c594-6f40-4eff-a7ac-7701cd085b07 admin admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:55:03.251463 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 1227/2441] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Jul 14 10:55:03 2022] DELETE /identity/v3/users/e67b2b8b1f154708ac2d3d70fa24d6d0 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 10:55:03.272438 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 1215/2442] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Jul 14 10:55:03 2022] POST /identity/v3/projects => generated 373 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 10:55:03.277943 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba335e39-7530-43f3-8235-16535490d655 admin admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:55:03.279439 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-ba335e39-7530-43f3-8235-16535490d655 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:55:03.345906 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:DELETE=13,keystone:SELECT=85,keystone:INSERT=2 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:55:03.349741 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba335e39-7530-43f3-8235-16535490d655 admin admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:55:03.411480 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0c01ef-30e2-4ffc-aa8d-1ef2a7c4a850 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:55:03.412276 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0c01ef-30e2-4ffc-aa8d-1ef2a7c4a850 admin admin] REQUEST_METHOD: `POST` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:55:03.412565 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0c01ef-30e2-4ffc-aa8d-1ef2a7c4a850 admin admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:55:03.412880 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0c01ef-30e2-4ffc-aa8d-1ef2a7c4a850 admin admin] PATH_INFO: `/v3/users` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:55:03.413949 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0c01ef-30e2-4ffc-aa8d-1ef2a7c4a850 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:55:03.419976 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0c01ef-30e2-4ffc-aa8d-1ef2a7c4a850 admin admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:55:03.446643 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 1228/2443] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Jul 14 10:55:03 2022] POST /identity/v3/users => generated 287 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:55:03.447887 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0c01ef-30e2-4ffc-aa8d-1ef2a7c4a850 admin admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:55:03.448688 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c019c594-6f40-4eff-a7ac-7701cd085b07 admin admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:55:03.450643 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-c019c594-6f40-4eff-a7ac-7701cd085b07 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:55:03.459082 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0c01ef-30e2-4ffc-aa8d-1ef2a7c4a850 admin admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:55:03.465215 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a1343f-3c70-47f8-9a5c-c45306e318eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:55:03.465930 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a1343f-3c70-47f8-9a5c-c45306e318eb admin admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:55:03.466227 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c019c594-6f40-4eff-a7ac-7701cd085b07 admin admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:55:03.466340 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a1343f-3c70-47f8-9a5c-c45306e318eb admin admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:55:03.466669 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a1343f-3c70-47f8-9a5c-c45306e318eb admin admin] PATH_INFO: `/v3/roles` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:55:03.467424 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a1343f-3c70-47f8-9a5c-c45306e318eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:55:03.469287 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a1343f-3c70-47f8-9a5c-c45306e318eb admin admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:55:03.471565 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f24b69a-cf72-4ee0-be5a-0c141360843d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:55:03.472430 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f24b69a-cf72-4ee0-be5a-0c141360843d admin admin] REQUEST_METHOD: `DELETE` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:55:03.472865 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f24b69a-cf72-4ee0-be5a-0c141360843d admin admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:55:03.473159 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f24b69a-cf72-4ee0-be5a-0c141360843d admin admin] PATH_INFO: `/v3/projects/39a9ec52c5dd4e7487d9b1f778e5c901` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:55:03.474395 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f24b69a-cf72-4ee0-be5a-0c141360843d admin admin] RBAC: Authorizing `identity:delete_project(project_id=39a9ec52c5dd4e7487d9b1f778e5c901)` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:55:03.476308 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f24b69a-cf72-4ee0-be5a-0c141360843d admin admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:55:03.484576 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 1229/2444] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jul 14 10:55:03 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:55:03.485370 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a1343f-3c70-47f8-9a5c-c45306e318eb admin admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:55:03.496856 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a1343f-3c70-47f8-9a5c-c45306e318eb admin admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:55:03.501782 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b1eb62-6dba-4982-91f3-3f12b712d5aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:55:03.502525 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b1eb62-6dba-4982-91f3-3f12b712d5aa admin admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:55:03.502878 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b1eb62-6dba-4982-91f3-3f12b712d5aa admin admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:55:03.503170 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b1eb62-6dba-4982-91f3-3f12b712d5aa admin admin] PATH_INFO: `/v3/roles` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:55:03.503903 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b1eb62-6dba-4982-91f3-3f12b712d5aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:55:03.505857 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b1eb62-6dba-4982-91f3-3f12b712d5aa admin admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:55:03.518416 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 1230/2445] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jul 14 10:55:03 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 10:55:03.522857 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b1eb62-6dba-4982-91f3-3f12b712d5aa admin admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:55:03.535485 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b1eb62-6dba-4982-91f3-3f12b712d5aa admin admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:55:03.537881 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-5f24b69a-cf72-4ee0-be5a-0c141360843d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '39a9ec52c5dd4e7487d9b1f778e5c901', 'request_id': 'req-5f24b69a-cf72-4ee0-be5a-0c141360843d'} {{(pid=86656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:55:03.542739 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=93,keystone:INSERT=2,keystone:DELETE=5 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:55:03.548548 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-5f24b69a-cf72-4ee0-be5a-0c141360843d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '39a9ec52c5dd4e7487d9b1f778e5c901', 'request_id': 'req-5f24b69a-cf72-4ee0-be5a-0c141360843d'} {{(pid=86656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:55:03.556444 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-5f24b69a-cf72-4ee0-be5a-0c141360843d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '39a9ec52c5dd4e7487d9b1f778e5c901', 'request_id': 'req-5f24b69a-cf72-4ee0-be5a-0c141360843d'} {{(pid=86656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:55:03.569533 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-5f24b69a-cf72-4ee0-be5a-0c141360843d admin admin] The token cache is being invalidate because project 39a9ec52c5dd4e7487d9b1f778e5c901 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86656) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 10:55:03.569827 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-5f24b69a-cf72-4ee0-be5a-0c141360843d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:55:03.570747 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-5f24b69a-cf72-4ee0-be5a-0c141360843d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:55:03.572710 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 1216/2446] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Jul 14 10:55:03 2022] DELETE /identity/v3/projects/39a9ec52c5dd4e7487d9b1f778e5c901 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:55:03.578147 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13600cc-91b9-4177-a115-4767a6d78bb2 None None] REQUEST_METHOD: `POST` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:55:03.578438 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13600cc-91b9-4177-a115-4767a6d78bb2 None None] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:55:03.578748 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13600cc-91b9-4177-a115-4767a6d78bb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:55:03.598550 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.auth.core [None req-f13600cc-91b9-4177-a115-4767a6d78bb2 None None] MFA Rules not processed for user `ae4bcdd8106d4bebbdcae96be33505bc`. Rule list: `[]` (Enabled: `True`). {{(pid=86656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:55:03.599834 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-f13600cc-91b9-4177-a115-4767a6d78bb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:55:03.600300 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f738c21e-26bb-401f-99ca-135397b04ccd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:55:03.601219 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f738c21e-26bb-401f-99ca-135397b04ccd admin admin] REQUEST_METHOD: `PUT` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:55:03.601505 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f738c21e-26bb-401f-99ca-135397b04ccd admin admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:55:03.601779 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f738c21e-26bb-401f-99ca-135397b04ccd admin admin] PATH_INFO: `/v3/projects/52d2f7529880413a8fc9312aae833ea2/users/219b9dabdb904973b7bd4c23d944ca92/roles/0da46c267d354cce81495dfdd56c1ec2` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:55:03.608859 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 1217/2447] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jul 14 10:55:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 10:55:03.617107 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5c6309-ef09-431f-9ba3-0a1de6baa325 None None] REQUEST_METHOD: `POST` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:55:03.617289 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f738c21e-26bb-401f-99ca-135397b04ccd admin admin] RBAC: Authorizing `identity:create_grant(project_id=52d2f7529880413a8fc9312aae833ea2, user_id=219b9dabdb904973b7bd4c23d944ca92, role_id=0da46c267d354cce81495dfdd56c1ec2)` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:55:03.617602 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5c6309-ef09-431f-9ba3-0a1de6baa325 None None] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:55:03.617694 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5c6309-ef09-431f-9ba3-0a1de6baa325 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:55:03.620683 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f738c21e-26bb-401f-99ca-135397b04ccd admin admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:55:03.634954 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 1231/2448] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Jul 14 10:55:03 2022] PUT /identity/v3/projects/52d2f7529880413a8fc9312aae833ea2/users/219b9dabdb904973b7bd4c23d944ca92/roles/0da46c267d354cce81495dfdd56c1ec2 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:55:03.638357 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.auth.core [None req-0e5c6309-ef09-431f-9ba3-0a1de6baa325 None None] MFA Rules not processed for user `ae4bcdd8106d4bebbdcae96be33505bc`. Rule list: `[]` (Enabled: `True`). {{(pid=86656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:55:03.639629 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-0e5c6309-ef09-431f-9ba3-0a1de6baa325 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:55:03.640108 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491dcd43-bc5f-4fa4-8750-2bfc14d573b1 None None] REQUEST_METHOD: `POST` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:55:03.640497 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491dcd43-bc5f-4fa4-8750-2bfc14d573b1 None None] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:55:03.640881 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491dcd43-bc5f-4fa4-8750-2bfc14d573b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:55:03.659267 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.auth.core [None req-491dcd43-bc5f-4fa4-8750-2bfc14d573b1 None None] MFA Rules not processed for user `ae4bcdd8106d4bebbdcae96be33505bc`. Rule list: `[]` (Enabled: `True`). {{(pid=86655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:55:03.660488 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-491dcd43-bc5f-4fa4-8750-2bfc14d573b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:55:03.709840 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 1218/2449] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jul 14 10:55:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 10:55:03.714698 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5c6309-ef09-431f-9ba3-0a1de6baa325 None None] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:55:03.716995 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:55:03.725533 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5c6309-ef09-431f-9ba3-0a1de6baa325 None None] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:55:03.730883 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b43d52-a848-4570-8e31-63b084fed243 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:55:03.731295 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 1232/2450] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jul 14 10:55:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 10:55:03.731628 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b43d52-a848-4570-8e31-63b084fed243 admin admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:55:03.731976 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b43d52-a848-4570-8e31-63b084fed243 admin admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:55:03.732260 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b43d52-a848-4570-8e31-63b084fed243 admin admin] PATH_INFO: `/v3/domains` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:55:03.733026 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b43d52-a848-4570-8e31-63b084fed243 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:55:03.733336 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b43d52-a848-4570-8e31-63b084fed243 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:55:03.735075 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b43d52-a848-4570-8e31-63b084fed243 admin admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:55:03.740727 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491dcd43-bc5f-4fa4-8750-2bfc14d573b1 None None] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:55:03.742220 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-491dcd43-bc5f-4fa4-8750-2bfc14d573b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:55:03.748808 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 1219/2451] 10.222.0.16 () {58 vars in 1152 bytes} [Thu Jul 14 10:55:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 10:55:03.751461 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b43d52-a848-4570-8e31-63b084fed243 admin admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:55:03.761453 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b43d52-a848-4570-8e31-63b084fed243 admin admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:55:03.769127 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2a3ed9-746f-4356-90b1-0876c85fd4c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:55:03.769804 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2a3ed9-746f-4356-90b1-0876c85fd4c6 admin admin] REQUEST_METHOD: `POST` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:55:03.770092 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2a3ed9-746f-4356-90b1-0876c85fd4c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:55:03.770374 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2a3ed9-746f-4356-90b1-0876c85fd4c6 admin admin] PATH_INFO: `/v3/projects` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:55:03.771052 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2a3ed9-746f-4356-90b1-0876c85fd4c6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:55:03.772992 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2a3ed9-746f-4356-90b1-0876c85fd4c6 admin admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:55:03.811385 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 1220/2452] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Jul 14 10:55:03 2022] POST /identity/v3/projects => generated 369 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 10:55:03.812460 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2a3ed9-746f-4356-90b1-0876c85fd4c6 admin admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:55:03.814439 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491dcd43-bc5f-4fa4-8750-2bfc14d573b1 None None] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:55:03.869382 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca80c54-7cd0-4a0b-b907-d192e4b1535a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dddf93691844886982c91fea974385d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59391272ecbe48b0aa736cb43807be1d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:55:03.870213 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca80c54-7cd0-4a0b-b907-d192e4b1535a service neutron] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:55:03.870625 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca80c54-7cd0-4a0b-b907-d192e4b1535a service neutron] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:55:03.870961 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca80c54-7cd0-4a0b-b907-d192e4b1535a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:55:03.887972 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2a3ed9-746f-4356-90b1-0876c85fd4c6 admin admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:55:03.893698 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07d604d-038f-4ca8-8f39-d10f7b8327af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:55:03.894375 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07d604d-038f-4ca8-8f39-d10f7b8327af admin admin] REQUEST_METHOD: `POST` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:55:03.894681 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07d604d-038f-4ca8-8f39-d10f7b8327af admin admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:55:03.894944 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07d604d-038f-4ca8-8f39-d10f7b8327af admin admin] PATH_INFO: `/v3/users` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:55:03.895654 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07d604d-038f-4ca8-8f39-d10f7b8327af admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:55:03.897599 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07d604d-038f-4ca8-8f39-d10f7b8327af admin admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:55:03.924932 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 1221/2453] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Jul 14 10:55:03 2022] POST /identity/v3/users => generated 285 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:55:03.929331 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07d604d-038f-4ca8-8f39-d10f7b8327af admin admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:55:03.941024 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07d604d-038f-4ca8-8f39-d10f7b8327af admin admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:55:03.945457 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca80c54-7cd0-4a0b-b907-d192e4b1535a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:55:03.946658 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d2cb65-45b0-4207-9c05-55a9539e83e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:55:03.947377 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca80c54-7cd0-4a0b-b907-d192e4b1535a service neutron] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:55:03.947494 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d2cb65-45b0-4207-9c05-55a9539e83e5 admin admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:55:03.947575 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d2cb65-45b0-4207-9c05-55a9539e83e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:55:03.947859 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d2cb65-45b0-4207-9c05-55a9539e83e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:55:03.949307 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d2cb65-45b0-4207-9c05-55a9539e83e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:55:03.950898 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d2cb65-45b0-4207-9c05-55a9539e83e5 admin admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:55:03.958895 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 1233/2454] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jul 14 10:55:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 10:55:03.966242 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 1222/2455] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jul 14 10:55:03 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:55:03.970515 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca80c54-7cd0-4a0b-b907-d192e4b1535a service neutron] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:55:03.983052 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca80c54-7cd0-4a0b-b907-d192e4b1535a service neutron] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:55:03.989528 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c48f67b-c1eb-4db6-96fc-42a29d3b0007 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:55:03.990369 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c48f67b-c1eb-4db6-96fc-42a29d3b0007 admin admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:55:03.990729 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c48f67b-c1eb-4db6-96fc-42a29d3b0007 admin admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:55:03.991268 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c48f67b-c1eb-4db6-96fc-42a29d3b0007 admin admin] PATH_INFO: `/v3/roles` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:55:03.992283 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c48f67b-c1eb-4db6-96fc-42a29d3b0007 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:55:03.994394 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c48f67b-c1eb-4db6-96fc-42a29d3b0007 admin admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:55:04.009452 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 1234/2456] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jul 14 10:55:03 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:55:04.011806 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d2cb65-45b0-4207-9c05-55a9539e83e5 admin admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:55:04.023339 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d2cb65-45b0-4207-9c05-55a9539e83e5 admin admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:55:04.029419 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3183345c-ac51-4c02-8286-3d921c228464 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:55:04.030502 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3183345c-ac51-4c02-8286-3d921c228464 admin admin] REQUEST_METHOD: `PUT` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:55:04.030917 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3183345c-ac51-4c02-8286-3d921c228464 admin admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:55:04.031320 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3183345c-ac51-4c02-8286-3d921c228464 admin admin] PATH_INFO: `/v3/projects/ca72f95fef9f41e1be93a1bc518a342a/users/80edcdce4b264191ab47cd1f7f59acf0/roles/0da46c267d354cce81495dfdd56c1ec2` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:55:04.051944 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3183345c-ac51-4c02-8286-3d921c228464 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ca72f95fef9f41e1be93a1bc518a342a, user_id=80edcdce4b264191ab47cd1f7f59acf0, role_id=0da46c267d354cce81495dfdd56c1ec2)` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:55:04.055404 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3183345c-ac51-4c02-8286-3d921c228464 admin admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:55:04.063968 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=93,keystone:DELETE=2,keystone:INSERT=5 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:55:04.079968 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 1223/2457] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Jul 14 10:55:04 2022] PUT /identity/v3/projects/ca72f95fef9f41e1be93a1bc518a342a/users/80edcdce4b264191ab47cd1f7f59acf0/roles/0da46c267d354cce81495dfdd56c1ec2 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:55:04.091318 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acc82e7-0b28-4e36-8f69-68045c7b9036 None None] REQUEST_METHOD: `POST` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:55:04.091840 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acc82e7-0b28-4e36-8f69-68045c7b9036 None None] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:55:04.091932 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acc82e7-0b28-4e36-8f69-68045c7b9036 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:55:04.124929 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.auth.core [None req-0acc82e7-0b28-4e36-8f69-68045c7b9036 None None] MFA Rules not processed for user `80edcdce4b264191ab47cd1f7f59acf0`. Rule list: `[]` (Enabled: `True`). {{(pid=86655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:55:04.126395 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-0acc82e7-0b28-4e36-8f69-68045c7b9036 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:55:04.182109 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=100 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:55:04.221026 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 1235/2458] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jul 14 10:55:04 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:55:04.232866 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3183345c-ac51-4c02-8286-3d921c228464 admin admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:55:04.234768 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-3183345c-ac51-4c02-8286-3d921c228464 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:55:04.308757 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3183345c-ac51-4c02-8286-3d921c228464 admin admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:55:04.312800 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002b53b5-20f3-45a5-bd21-f2684233c98b service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cb877bf3f8241dcb2ecbb612c7f4f69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59391272ecbe48b0aa736cb43807be1d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:55:04.317130 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002b53b5-20f3-45a5-bd21-f2684233c98b service glance] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:55:04.317939 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002b53b5-20f3-45a5-bd21-f2684233c98b service glance] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:55:04.318244 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002b53b5-20f3-45a5-bd21-f2684233c98b service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:55:04.335459 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002b53b5-20f3-45a5-bd21-f2684233c98b service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:55:04.336969 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002b53b5-20f3-45a5-bd21-f2684233c98b service glance] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:55:04.352660 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 1224/2459] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jul 14 10:55:04 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:55:08.579456 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4ed11e-1715-4b49-8b88-0a43e33b902b None None] REQUEST_METHOD: `POST` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:55:08.579935 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4ed11e-1715-4b49-8b88-0a43e33b902b None None] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:55:08.580114 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4ed11e-1715-4b49-8b88-0a43e33b902b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:55:08.610913 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.auth.core [None req-7c4ed11e-1715-4b49-8b88-0a43e33b902b None None] MFA Rules not processed for user `219b9dabdb904973b7bd4c23d944ca92`. Rule list: `[]` (Enabled: `True`). {{(pid=86655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:55:08.612002 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-7c4ed11e-1715-4b49-8b88-0a43e33b902b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:55:08.697204 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 1236/2460] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jul 14 10:55:08 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:55:08.701686 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002b53b5-20f3-45a5-bd21-f2684233c98b service glance] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:55:08.703175 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-002b53b5-20f3-45a5-bd21-f2684233c98b service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:55:08.790790 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002b53b5-20f3-45a5-bd21-f2684233c98b service glance] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:55:08.797230 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f052bba7-1d4c-4de7-accd-22af918c68e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:55:08.797947 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f052bba7-1d4c-4de7-accd-22af918c68e3 admin admin] REQUEST_METHOD: `POST` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:55:08.798196 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f052bba7-1d4c-4de7-accd-22af918c68e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:55:08.798471 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f052bba7-1d4c-4de7-accd-22af918c68e3 admin admin] PATH_INFO: `/v3/projects` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:55:08.799191 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f052bba7-1d4c-4de7-accd-22af918c68e3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:55:08.801137 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f052bba7-1d4c-4de7-accd-22af918c68e3 admin admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:55:08.838057 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 1225/2461] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Jul 14 10:55:08 2022] POST /identity/v3/projects => generated 373 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:55:08.843319 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4ed11e-1715-4b49-8b88-0a43e33b902b None None] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:55:08.857797 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4ed11e-1715-4b49-8b88-0a43e33b902b None None] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:55:08.934317 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783bdabd-9714-42ff-815c-49a52aa448de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:55:08.934317 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783bdabd-9714-42ff-815c-49a52aa448de admin admin] REQUEST_METHOD: `POST` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:55:08.934317 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783bdabd-9714-42ff-815c-49a52aa448de admin admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:55:08.934317 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783bdabd-9714-42ff-815c-49a52aa448de admin admin] PATH_INFO: `/v3/users` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:55:08.935260 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783bdabd-9714-42ff-815c-49a52aa448de admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:55:08.935260 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783bdabd-9714-42ff-815c-49a52aa448de admin admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:55:08.962358 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 1237/2462] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Jul 14 10:55:08 2022] POST /identity/v3/users => generated 293 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:55:08.964463 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f052bba7-1d4c-4de7-accd-22af918c68e3 admin admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:55:08.976628 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f052bba7-1d4c-4de7-accd-22af918c68e3 admin admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:55:08.983287 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66383af7-16dd-4e11-a544-45e3139dbcbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:55:08.986246 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66383af7-16dd-4e11-a544-45e3139dbcbf admin admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:55:08.986436 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66383af7-16dd-4e11-a544-45e3139dbcbf admin admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:55:08.986718 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66383af7-16dd-4e11-a544-45e3139dbcbf admin admin] PATH_INFO: `/v3/roles` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:55:08.987463 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66383af7-16dd-4e11-a544-45e3139dbcbf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:55:08.989421 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66383af7-16dd-4e11-a544-45e3139dbcbf admin admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:55:09.013211 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 1226/2463] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jul 14 10:55:08 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:55:09.014600 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783bdabd-9714-42ff-815c-49a52aa448de admin admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:55:09.030939 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783bdabd-9714-42ff-815c-49a52aa448de admin admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:55:09.042692 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32efba7-75c8-481d-8591-2875c57af8f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:55:09.043610 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32efba7-75c8-481d-8591-2875c57af8f2 admin admin] REQUEST_METHOD: `PUT` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:55:09.043896 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32efba7-75c8-481d-8591-2875c57af8f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:55:09.044173 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32efba7-75c8-481d-8591-2875c57af8f2 admin admin] PATH_INFO: `/v3/projects/bab3887a35ef49f2bacea8469c6b1ede/users/fd475a9b058a45df87e5cfaabbe5594e/roles/153539819e5542df99269d2913bbecfb` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:55:09.063753 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32efba7-75c8-481d-8591-2875c57af8f2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bab3887a35ef49f2bacea8469c6b1ede, user_id=fd475a9b058a45df87e5cfaabbe5594e, role_id=153539819e5542df99269d2913bbecfb)` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:55:09.066853 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32efba7-75c8-481d-8591-2875c57af8f2 admin admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:55:09.101561 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 1238/2464] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Jul 14 10:55:09 2022] PUT /identity/v3/projects/bab3887a35ef49f2bacea8469c6b1ede/users/fd475a9b058a45df87e5cfaabbe5594e/roles/153539819e5542df99269d2913bbecfb => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:55:09.105906 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66383af7-16dd-4e11-a544-45e3139dbcbf admin admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:55:09.117075 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66383af7-16dd-4e11-a544-45e3139dbcbf admin admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:55:09.180232 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663c6c5d-f95e-47c3-8304-f6afec7f2f78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:55:09.180952 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663c6c5d-f95e-47c3-8304-f6afec7f2f78 admin admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:55:09.181252 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663c6c5d-f95e-47c3-8304-f6afec7f2f78 admin admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:55:09.181529 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663c6c5d-f95e-47c3-8304-f6afec7f2f78 admin admin] PATH_INFO: `/v3/roles` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:55:09.182302 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663c6c5d-f95e-47c3-8304-f6afec7f2f78 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:55:09.183922 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663c6c5d-f95e-47c3-8304-f6afec7f2f78 admin admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:55:09.195408 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 1227/2465] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jul 14 10:55:09 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:55:09.200258 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32efba7-75c8-481d-8591-2875c57af8f2 admin admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:55:09.211076 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32efba7-75c8-481d-8591-2875c57af8f2 admin admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:55:09.216570 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31f803f-544a-438e-adda-5df24195dd3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:55:09.217510 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31f803f-544a-438e-adda-5df24195dd3f admin admin] REQUEST_METHOD: `PUT` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:55:09.217799 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31f803f-544a-438e-adda-5df24195dd3f admin admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:55:09.218080 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31f803f-544a-438e-adda-5df24195dd3f admin admin] PATH_INFO: `/v3/projects/bab3887a35ef49f2bacea8469c6b1ede/users/fd475a9b058a45df87e5cfaabbe5594e/roles/153539819e5542df99269d2913bbecfb` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:55:09.220080 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31f803f-544a-438e-adda-5df24195dd3f admin admin] RBAC: Authorizing `identity:create_grant(project_id=bab3887a35ef49f2bacea8469c6b1ede, user_id=fd475a9b058a45df87e5cfaabbe5594e, role_id=153539819e5542df99269d2913bbecfb)` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:55:09.222778 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31f803f-544a-438e-adda-5df24195dd3f admin admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:55:09.235170 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 1239/2466] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Jul 14 10:55:09 2022] PUT /identity/v3/projects/bab3887a35ef49f2bacea8469c6b1ede/users/fd475a9b058a45df87e5cfaabbe5594e/roles/153539819e5542df99269d2913bbecfb => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:55:14.092271 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24f9547-c478-459a-9362-9363c088e6af None None] REQUEST_METHOD: `POST` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:55:14.092811 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24f9547-c478-459a-9362-9363c088e6af None None] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:55:14.092811 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24f9547-c478-459a-9362-9363c088e6af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:55:14.112124 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:55:14.123248 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.auth.core [None req-b24f9547-c478-459a-9362-9363c088e6af None None] MFA Rules not processed for user `fd475a9b058a45df87e5cfaabbe5594e`. Rule list: `[]` (Enabled: `True`). {{(pid=86656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:55:14.124576 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-b24f9547-c478-459a-9362-9363c088e6af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:55:14.203485 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 1228/2467] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jul 14 10:55:14 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:55:14.222499 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31f803f-544a-438e-adda-5df24195dd3f admin admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:55:14.225569 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-c31f803f-544a-438e-adda-5df24195dd3f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:55:14.255117 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:55:14.308326 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31f803f-544a-438e-adda-5df24195dd3f admin admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:55:14.315005 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41ed143-3d82-4bb4-9f1a-516e68e6c550 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26aa294c913c408499a913ec25bb677d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59391272ecbe48b0aa736cb43807be1d', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:55:14.315604 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41ed143-3d82-4bb4-9f1a-516e68e6c550 service nova] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:55:14.315895 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41ed143-3d82-4bb4-9f1a-516e68e6c550 service nova] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:55:14.316162 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41ed143-3d82-4bb4-9f1a-516e68e6c550 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:55:14.385084 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41ed143-3d82-4bb4-9f1a-516e68e6c550 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:55:14.387001 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41ed143-3d82-4bb4-9f1a-516e68e6c550 service nova] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:55:14.396874 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 1240/2468] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jul 14 10:55:14 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:55:15.661914 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addfdea5-3e62-43ee-bbc2-5a1b1ec84c6f None None] REQUEST_METHOD: `POST` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:55:15.662824 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addfdea5-3e62-43ee-bbc2-5a1b1ec84c6f None None] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:55:15.663310 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addfdea5-3e62-43ee-bbc2-5a1b1ec84c6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:55:15.684898 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.auth.core [None req-addfdea5-3e62-43ee-bbc2-5a1b1ec84c6f None None] MFA Rules not processed for user `219b9dabdb904973b7bd4c23d944ca92`. Rule list: `[]` (Enabled: `True`). {{(pid=86656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:55:15.685919 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-addfdea5-3e62-43ee-bbc2-5a1b1ec84c6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:55:15.693070 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 1229/2469] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jul 14 10:55:15 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:55:22.133782 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d3c754-30ae-4d44-a7b1-3ebd322620ab None None] REQUEST_METHOD: `POST` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:55:22.134288 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d3c754-30ae-4d44-a7b1-3ebd322620ab None None] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:55:22.134420 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d3c754-30ae-4d44-a7b1-3ebd322620ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:55:22.153183 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.auth.core [None req-f9d3c754-30ae-4d44-a7b1-3ebd322620ab None None] MFA Rules not processed for user `ae4bcdd8106d4bebbdcae96be33505bc`. Rule list: `[]` (Enabled: `True`). {{(pid=86655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:55:22.154381 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-f9d3c754-30ae-4d44-a7b1-3ebd322620ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:55:22.215720 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 1241/2470] 10.222.0.73 () {58 vars in 1016 bytes} [Thu Jul 14 10:55:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:55:22.234443 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addfdea5-3e62-43ee-bbc2-5a1b1ec84c6f None None] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:55:22.249459 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addfdea5-3e62-43ee-bbc2-5a1b1ec84c6f None None] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:55:22.254828 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62131a8-259b-47ce-b918-e5d6df00bad3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26aa294c913c408499a913ec25bb677d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59391272ecbe48b0aa736cb43807be1d', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:55:22.255981 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62131a8-259b-47ce-b918-e5d6df00bad3 service nova] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:55:22.256266 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62131a8-259b-47ce-b918-e5d6df00bad3 service nova] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:55:22.256542 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62131a8-259b-47ce-b918-e5d6df00bad3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:55:22.267830 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62131a8-259b-47ce-b918-e5d6df00bad3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:55:22.269463 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62131a8-259b-47ce-b918-e5d6df00bad3 service nova] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:55:22.278882 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 1230/2471] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jul 14 10:55:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:55:27.214288 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba438a4-8ab9-4f07-87ea-0185438b5821 None None] REQUEST_METHOD: `POST` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:55:27.214948 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba438a4-8ab9-4f07-87ea-0185438b5821 None None] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:55:27.214948 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba438a4-8ab9-4f07-87ea-0185438b5821 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:55:27.233480 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.auth.core [None req-aba438a4-8ab9-4f07-87ea-0185438b5821 None None] MFA Rules not processed for user `ae4bcdd8106d4bebbdcae96be33505bc`. Rule list: `[]` (Enabled: `True`). {{(pid=86655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:55:27.234668 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-aba438a4-8ab9-4f07-87ea-0185438b5821 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:55:27.242388 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 1242/2472] 10.222.0.73 () {58 vars in 1016 bytes} [Thu Jul 14 10:55:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 10:55:27.258681 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62131a8-259b-47ce-b918-e5d6df00bad3 service nova] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:55:27.260208 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-a62131a8-259b-47ce-b918-e5d6df00bad3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:55:27.274991 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62131a8-259b-47ce-b918-e5d6df00bad3 service nova] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:55:27.280405 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b11243e-5dca-47bd-bba5-7d0b6fb468a3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26aa294c913c408499a913ec25bb677d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59391272ecbe48b0aa736cb43807be1d', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:55:27.281081 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b11243e-5dca-47bd-bba5-7d0b6fb468a3 service nova] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:55:27.281369 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b11243e-5dca-47bd-bba5-7d0b6fb468a3 service nova] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:55:27.281650 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b11243e-5dca-47bd-bba5-7d0b6fb468a3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:55:27.289710 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b11243e-5dca-47bd-bba5-7d0b6fb468a3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:55:27.291856 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b11243e-5dca-47bd-bba5-7d0b6fb468a3 service nova] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:55:27.302573 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 1231/2473] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jul 14 10:55:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:55:31.479724 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257a269c-4017-481a-aa65-8769fc46d08c None None] REQUEST_METHOD: `POST` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:55:31.480286 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257a269c-4017-481a-aa65-8769fc46d08c None None] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:55:31.480286 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257a269c-4017-481a-aa65-8769fc46d08c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:55:31.499302 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.auth.core [None req-257a269c-4017-481a-aa65-8769fc46d08c None None] MFA Rules not processed for user `ae4bcdd8106d4bebbdcae96be33505bc`. Rule list: `[]` (Enabled: `True`). {{(pid=86655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:55:31.500553 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-257a269c-4017-481a-aa65-8769fc46d08c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:55:31.511509 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 1243/2474] 10.222.0.73 () {58 vars in 1016 bytes} [Thu Jul 14 10:55:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:55:31.528398 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b11243e-5dca-47bd-bba5-7d0b6fb468a3 service nova] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:55:31.539608 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b11243e-5dca-47bd-bba5-7d0b6fb468a3 service nova] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:55:31.545935 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1270ddc0-0c35-44fe-8002-7ab7404cec6e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26aa294c913c408499a913ec25bb677d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59391272ecbe48b0aa736cb43807be1d', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:55:31.546577 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1270ddc0-0c35-44fe-8002-7ab7404cec6e service nova] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:55:31.546862 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1270ddc0-0c35-44fe-8002-7ab7404cec6e service nova] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:55:31.547144 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1270ddc0-0c35-44fe-8002-7ab7404cec6e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:55:31.555185 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1270ddc0-0c35-44fe-8002-7ab7404cec6e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:55:31.556904 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1270ddc0-0c35-44fe-8002-7ab7404cec6e service nova] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:55:31.566270 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 1232/2475] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jul 14 10:55:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:55:36.607244 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4d761f-af68-433f-b8b1-8067ff0f4449 None None] REQUEST_METHOD: `POST` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:55:36.607749 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4d761f-af68-433f-b8b1-8067ff0f4449 None None] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:55:36.607873 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4d761f-af68-433f-b8b1-8067ff0f4449 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:55:36.627072 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.auth.core [None req-1b4d761f-af68-433f-b8b1-8067ff0f4449 None None] MFA Rules not processed for user `ae4bcdd8106d4bebbdcae96be33505bc`. Rule list: `[]` (Enabled: `True`). {{(pid=86655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:55:36.628282 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-1b4d761f-af68-433f-b8b1-8067ff0f4449 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:55:36.636785 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 1244/2476] 10.222.0.73 () {58 vars in 1016 bytes} [Thu Jul 14 10:55:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:55:36.655534 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1270ddc0-0c35-44fe-8002-7ab7404cec6e service nova] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:55:36.670909 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1270ddc0-0c35-44fe-8002-7ab7404cec6e service nova] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:55:36.678315 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb26b37c-b300-4003-9137-a510f87db67e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26aa294c913c408499a913ec25bb677d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59391272ecbe48b0aa736cb43807be1d', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:55:36.678986 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb26b37c-b300-4003-9137-a510f87db67e service nova] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:55:36.679268 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb26b37c-b300-4003-9137-a510f87db67e service nova] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:55:36.679544 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb26b37c-b300-4003-9137-a510f87db67e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:55:36.689156 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb26b37c-b300-4003-9137-a510f87db67e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:55:36.690739 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb26b37c-b300-4003-9137-a510f87db67e service nova] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:55:36.701042 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 1233/2477] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jul 14 10:55:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:55:42.840895 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c3f9b4-aeaf-476d-a3df-883da88aba8c None None] REQUEST_METHOD: `POST` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:55:42.841382 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c3f9b4-aeaf-476d-a3df-883da88aba8c None None] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:55:42.841498 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c3f9b4-aeaf-476d-a3df-883da88aba8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:55:42.861185 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.auth.core [None req-22c3f9b4-aeaf-476d-a3df-883da88aba8c None None] MFA Rules not processed for user `ae4bcdd8106d4bebbdcae96be33505bc`. Rule list: `[]` (Enabled: `True`). {{(pid=86655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:55:42.862472 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-22c3f9b4-aeaf-476d-a3df-883da88aba8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:55:42.870937 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 1245/2478] 10.222.0.73 () {58 vars in 1016 bytes} [Thu Jul 14 10:55:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:55:42.910771 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb26b37c-b300-4003-9137-a510f87db67e service nova] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:55:42.922138 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb26b37c-b300-4003-9137-a510f87db67e service nova] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:55:42.927588 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7face9ef-7418-4186-bb44-660a55f73a0d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26aa294c913c408499a913ec25bb677d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59391272ecbe48b0aa736cb43807be1d', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:55:42.928233 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7face9ef-7418-4186-bb44-660a55f73a0d service nova] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:55:42.928526 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7face9ef-7418-4186-bb44-660a55f73a0d service nova] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:55:42.928880 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7face9ef-7418-4186-bb44-660a55f73a0d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:55:42.937714 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7face9ef-7418-4186-bb44-660a55f73a0d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:55:42.939296 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7face9ef-7418-4186-bb44-660a55f73a0d service nova] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:55:42.950108 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 1234/2479] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jul 14 10:55:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:55:47.049238 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed03be1-4ec7-4427-87eb-db135e9d56c7 None None] REQUEST_METHOD: `POST` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:55:47.049764 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed03be1-4ec7-4427-87eb-db135e9d56c7 None None] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:55:47.049857 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed03be1-4ec7-4427-87eb-db135e9d56c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:55:47.056111 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=86 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:55:47.068803 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.auth.core [None req-6ed03be1-4ec7-4427-87eb-db135e9d56c7 None None] MFA Rules not processed for user `ae4bcdd8106d4bebbdcae96be33505bc`. Rule list: `[]` (Enabled: `True`). {{(pid=86655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:55:47.069997 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-6ed03be1-4ec7-4427-87eb-db135e9d56c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:55:47.077991 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 1246/2480] 10.222.0.73 () {58 vars in 1016 bytes} [Thu Jul 14 10:55:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:55:47.097281 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7face9ef-7418-4186-bb44-660a55f73a0d service nova] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:55:47.103059 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=64 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:55:47.109832 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7face9ef-7418-4186-bb44-660a55f73a0d service nova] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:55:47.116211 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6451fbf8-473f-4743-b8c6-9da138e16449 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26aa294c913c408499a913ec25bb677d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59391272ecbe48b0aa736cb43807be1d', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:55:47.116880 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6451fbf8-473f-4743-b8c6-9da138e16449 service nova] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:55:47.117169 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6451fbf8-473f-4743-b8c6-9da138e16449 service nova] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:55:47.117450 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6451fbf8-473f-4743-b8c6-9da138e16449 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:55:47.126114 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6451fbf8-473f-4743-b8c6-9da138e16449 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:55:47.127699 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6451fbf8-473f-4743-b8c6-9da138e16449 service nova] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:55:47.137150 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 1235/2481] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jul 14 10:55:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:55:50.457007 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed03be1-4ec7-4427-87eb-db135e9d56c7 None None] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:55:50.458609 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-6ed03be1-4ec7-4427-87eb-db135e9d56c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:55:50.541617 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed03be1-4ec7-4427-87eb-db135e9d56c7 None None] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:55:50.547025 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f210557-f1ef-47f4-a898-e6fcfb1dad4c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16846111ee2a42dd99c3052d40980f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59391272ecbe48b0aa736cb43807be1d', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:55:50.547689 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f210557-f1ef-47f4-a898-e6fcfb1dad4c service placement] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:55:50.547979 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f210557-f1ef-47f4-a898-e6fcfb1dad4c service placement] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:55:50.548263 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f210557-f1ef-47f4-a898-e6fcfb1dad4c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:55:50.550049 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-3f210557-f1ef-47f4-a898-e6fcfb1dad4c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:55:50.561780 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f210557-f1ef-47f4-a898-e6fcfb1dad4c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:55:50.563397 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f210557-f1ef-47f4-a898-e6fcfb1dad4c service placement] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:55:50.574587 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 1247/2482] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jul 14 10:55:50 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:55:51.020629 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6451fbf8-473f-4743-b8c6-9da138e16449 service nova] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:55:51.022305 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-6451fbf8-473f-4743-b8c6-9da138e16449 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:55:51.037087 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6451fbf8-473f-4743-b8c6-9da138e16449 service nova] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:55:51.042475 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747d2f61-ddbb-4171-bbed-d20b05e16c88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:55:51.043368 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747d2f61-ddbb-4171-bbed-d20b05e16c88 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:55:51.043809 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747d2f61-ddbb-4171-bbed-d20b05e16c88 admin admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:55:51.044098 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747d2f61-ddbb-4171-bbed-d20b05e16c88 admin admin] PATH_INFO: `/v3/users/1305db51ffde44f6bd97b2b918bdbca7` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:55:51.045370 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747d2f61-ddbb-4171-bbed-d20b05e16c88 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1305db51ffde44f6bd97b2b918bdbca7)` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:55:51.047396 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747d2f61-ddbb-4171-bbed-d20b05e16c88 admin admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:55:51.098858 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-747d2f61-ddbb-4171-bbed-d20b05e16c88 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1305db51ffde44f6bd97b2b918bdbca7'} {{(pid=86656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:55:51.109682 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-747d2f61-ddbb-4171-bbed-d20b05e16c88 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1305db51ffde44f6bd97b2b918bdbca7'} {{(pid=86656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:55:51.110843 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-747d2f61-ddbb-4171-bbed-d20b05e16c88 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1305db51ffde44f6bd97b2b918bdbca7'} {{(pid=86656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:55:51.120912 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-747d2f61-ddbb-4171-bbed-d20b05e16c88 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1305db51ffde44f6bd97b2b918bdbca7'} {{(pid=86656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:55:51.121700 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-747d2f61-ddbb-4171-bbed-d20b05e16c88 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1305db51ffde44f6bd97b2b918bdbca7'} {{(pid=86656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:55:51.147565 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 1236/2483] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Jul 14 10:55:51 2022] DELETE /identity/v3/users/1305db51ffde44f6bd97b2b918bdbca7 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:55:51.153319 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482475d8-b41e-473b-b6b0-8cff94d6606e None None] REQUEST_METHOD: `POST` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:55:51.153975 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482475d8-b41e-473b-b6b0-8cff94d6606e None None] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:55:51.154556 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482475d8-b41e-473b-b6b0-8cff94d6606e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:55:51.177452 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.auth.core [None req-482475d8-b41e-473b-b6b0-8cff94d6606e None None] MFA Rules not processed for user `ae4bcdd8106d4bebbdcae96be33505bc`. Rule list: `[]` (Enabled: `True`). {{(pid=86655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:55:51.179661 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-482475d8-b41e-473b-b6b0-8cff94d6606e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:55:51.255731 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 1248/2484] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jul 14 10:55:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:55:51.265854 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747d2f61-ddbb-4171-bbed-d20b05e16c88 admin admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:55:51.267271 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-747d2f61-ddbb-4171-bbed-d20b05e16c88 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:55:51.333707 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747d2f61-ddbb-4171-bbed-d20b05e16c88 admin admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:55:51.337963 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4587b75-24e6-490b-92a9-a9a787d7a40a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dddf93691844886982c91fea974385d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59391272ecbe48b0aa736cb43807be1d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:55:51.338898 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4587b75-24e6-490b-92a9-a9a787d7a40a service neutron] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:55:51.339189 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4587b75-24e6-490b-92a9-a9a787d7a40a service neutron] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:55:51.339501 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4587b75-24e6-490b-92a9-a9a787d7a40a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:55:51.349668 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4587b75-24e6-490b-92a9-a9a787d7a40a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:55:51.351110 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4587b75-24e6-490b-92a9-a9a787d7a40a service neutron] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:55:51.361510 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 1237/2485] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jul 14 10:55:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:55:51.657648 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482475d8-b41e-473b-b6b0-8cff94d6606e None None] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:55:51.659172 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-482475d8-b41e-473b-b6b0-8cff94d6606e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:55:51.674423 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482475d8-b41e-473b-b6b0-8cff94d6606e None None] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:55:51.682234 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f559174-1dcb-4129-a8a0-199fa0f6531c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:55:51.683661 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f559174-1dcb-4129-a8a0-199fa0f6531c admin admin] REQUEST_METHOD: `DELETE` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:55:51.684018 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f559174-1dcb-4129-a8a0-199fa0f6531c admin admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:55:51.684305 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f559174-1dcb-4129-a8a0-199fa0f6531c admin admin] PATH_INFO: `/v3/projects/46f0e9452f0a4c7e8c16014bebd6b3b6` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:55:51.685606 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f559174-1dcb-4129-a8a0-199fa0f6531c admin admin] RBAC: Authorizing `identity:delete_project(project_id=46f0e9452f0a4c7e8c16014bebd6b3b6)` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:55:51.687625 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f559174-1dcb-4129-a8a0-199fa0f6531c admin admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:55:51.736959 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-9f559174-1dcb-4129-a8a0-199fa0f6531c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '46f0e9452f0a4c7e8c16014bebd6b3b6', 'request_id': 'req-9f559174-1dcb-4129-a8a0-199fa0f6531c'} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:55:51.742369 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-9f559174-1dcb-4129-a8a0-199fa0f6531c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '46f0e9452f0a4c7e8c16014bebd6b3b6', 'request_id': 'req-9f559174-1dcb-4129-a8a0-199fa0f6531c'} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:55:51.750523 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-9f559174-1dcb-4129-a8a0-199fa0f6531c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '46f0e9452f0a4c7e8c16014bebd6b3b6', 'request_id': 'req-9f559174-1dcb-4129-a8a0-199fa0f6531c'} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:55:51.762478 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-9f559174-1dcb-4129-a8a0-199fa0f6531c admin admin] The token cache is being invalidate because project 46f0e9452f0a4c7e8c16014bebd6b3b6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86655) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 10:55:51.762769 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-9f559174-1dcb-4129-a8a0-199fa0f6531c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:55:51.763419 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-9f559174-1dcb-4129-a8a0-199fa0f6531c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:55:51.765006 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 1249/2486] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Jul 14 10:55:51 2022] DELETE /identity/v3/projects/46f0e9452f0a4c7e8c16014bebd6b3b6 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:55:58.351818 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4587b75-24e6-490b-92a9-a9a787d7a40a service neutron] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:55:58.353921 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-e4587b75-24e6-490b-92a9-a9a787d7a40a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:55:58.367351 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4587b75-24e6-490b-92a9-a9a787d7a40a service neutron] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:55:58.442972 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edc59fd-98b7-492a-bb1e-a9b01416d27f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:55:58.444265 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edc59fd-98b7-492a-bb1e-a9b01416d27f admin admin] REQUEST_METHOD: `DELETE` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:55:58.444418 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edc59fd-98b7-492a-bb1e-a9b01416d27f admin admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:55:58.444697 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edc59fd-98b7-492a-bb1e-a9b01416d27f admin admin] PATH_INFO: `/v3/users/80edcdce4b264191ab47cd1f7f59acf0` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:55:58.446128 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4edc59fd-98b7-492a-bb1e-a9b01416d27f admin admin] RBAC: Authorizing `identity:delete_user(user_id=80edcdce4b264191ab47cd1f7f59acf0)` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:55:58.450758 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4edc59fd-98b7-492a-bb1e-a9b01416d27f admin admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:55:58.454085 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:55:58.510022 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-4edc59fd-98b7-492a-bb1e-a9b01416d27f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '80edcdce4b264191ab47cd1f7f59acf0'} {{(pid=86656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:55:58.519403 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-4edc59fd-98b7-492a-bb1e-a9b01416d27f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '80edcdce4b264191ab47cd1f7f59acf0'} {{(pid=86656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:55:58.520308 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-4edc59fd-98b7-492a-bb1e-a9b01416d27f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '80edcdce4b264191ab47cd1f7f59acf0'} {{(pid=86656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:55:58.527817 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-4edc59fd-98b7-492a-bb1e-a9b01416d27f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '80edcdce4b264191ab47cd1f7f59acf0'} {{(pid=86656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:55:58.528516 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-4edc59fd-98b7-492a-bb1e-a9b01416d27f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '80edcdce4b264191ab47cd1f7f59acf0'} {{(pid=86656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:55:58.549930 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 1238/2487] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Jul 14 10:55:58 2022] DELETE /identity/v3/users/80edcdce4b264191ab47cd1f7f59acf0 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:55:58.554514 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26014088-0abf-40a6-870b-6747d81dc704 None None] REQUEST_METHOD: `POST` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:55:58.555046 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26014088-0abf-40a6-870b-6747d81dc704 None None] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:55:58.555148 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26014088-0abf-40a6-870b-6747d81dc704 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:55:58.581561 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.auth.core [None req-26014088-0abf-40a6-870b-6747d81dc704 None None] MFA Rules not processed for user `ae4bcdd8106d4bebbdcae96be33505bc`. Rule list: `[]` (Enabled: `True`). {{(pid=86655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:55:58.581561 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-26014088-0abf-40a6-870b-6747d81dc704 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:55:58.585212 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:55:58.645001 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 1250/2488] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jul 14 10:55:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:55:58.654842 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edc59fd-98b7-492a-bb1e-a9b01416d27f admin admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:55:58.656406 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-4edc59fd-98b7-492a-bb1e-a9b01416d27f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:55:58.717600 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edc59fd-98b7-492a-bb1e-a9b01416d27f admin admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:55:58.721276 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75086a9-7812-42ea-97a9-17be4e1c6bad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dddf93691844886982c91fea974385d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59391272ecbe48b0aa736cb43807be1d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:55:58.721935 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75086a9-7812-42ea-97a9-17be4e1c6bad service neutron] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:55:58.722225 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75086a9-7812-42ea-97a9-17be4e1c6bad service neutron] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:55:58.722534 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75086a9-7812-42ea-97a9-17be4e1c6bad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:55:58.732538 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75086a9-7812-42ea-97a9-17be4e1c6bad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:55:58.734011 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75086a9-7812-42ea-97a9-17be4e1c6bad service neutron] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:55:58.744137 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 1239/2489] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jul 14 10:55:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:55:59.021688 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26014088-0abf-40a6-870b-6747d81dc704 None None] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:55:59.023710 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-26014088-0abf-40a6-870b-6747d81dc704 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:55:59.037634 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26014088-0abf-40a6-870b-6747d81dc704 None None] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:55:59.042620 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae88fa7e-c047-4d18-a8a4-2a73cf4d6f44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:55:59.043576 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae88fa7e-c047-4d18-a8a4-2a73cf4d6f44 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:55:59.043862 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae88fa7e-c047-4d18-a8a4-2a73cf4d6f44 admin admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:55:59.044152 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae88fa7e-c047-4d18-a8a4-2a73cf4d6f44 admin admin] PATH_INFO: `/v3/projects/ca72f95fef9f41e1be93a1bc518a342a` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:55:59.045435 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae88fa7e-c047-4d18-a8a4-2a73cf4d6f44 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ca72f95fef9f41e1be93a1bc518a342a)` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:55:59.047361 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae88fa7e-c047-4d18-a8a4-2a73cf4d6f44 admin admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:55:59.097693 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-ae88fa7e-c047-4d18-a8a4-2a73cf4d6f44 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ca72f95fef9f41e1be93a1bc518a342a', 'request_id': 'req-ae88fa7e-c047-4d18-a8a4-2a73cf4d6f44'} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:55:59.107364 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-ae88fa7e-c047-4d18-a8a4-2a73cf4d6f44 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ca72f95fef9f41e1be93a1bc518a342a', 'request_id': 'req-ae88fa7e-c047-4d18-a8a4-2a73cf4d6f44'} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:55:59.121213 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-ae88fa7e-c047-4d18-a8a4-2a73cf4d6f44 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ca72f95fef9f41e1be93a1bc518a342a', 'request_id': 'req-ae88fa7e-c047-4d18-a8a4-2a73cf4d6f44'} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:55:59.131634 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-ae88fa7e-c047-4d18-a8a4-2a73cf4d6f44 admin admin] The token cache is being invalidate because project ca72f95fef9f41e1be93a1bc518a342a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86655) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 10:55:59.131933 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-ae88fa7e-c047-4d18-a8a4-2a73cf4d6f44 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:55:59.132659 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-ae88fa7e-c047-4d18-a8a4-2a73cf4d6f44 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:55:59.134847 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 1251/2490] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Jul 14 10:55:59 2022] DELETE /identity/v3/projects/ca72f95fef9f41e1be93a1bc518a342a => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:55:59.139641 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3457c60a-11df-46e5-a17d-3b17f4c5a328 None None] REQUEST_METHOD: `POST` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:55:59.139954 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3457c60a-11df-46e5-a17d-3b17f4c5a328 None None] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:55:59.140234 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3457c60a-11df-46e5-a17d-3b17f4c5a328 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:55:59.158736 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.auth.core [None req-3457c60a-11df-46e5-a17d-3b17f4c5a328 None None] MFA Rules not processed for user `ae4bcdd8106d4bebbdcae96be33505bc`. Rule list: `[]` (Enabled: `True`). {{(pid=86656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:55:59.159956 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-3457c60a-11df-46e5-a17d-3b17f4c5a328 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:55:59.238830 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 1240/2491] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jul 14 10:55:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:55:59.246635 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b81fb7e-e31b-4d58-a494-e98f4a6d783f None None] REQUEST_METHOD: `POST` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:55:59.247134 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b81fb7e-e31b-4d58-a494-e98f4a6d783f None None] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:55:59.247420 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b81fb7e-e31b-4d58-a494-e98f4a6d783f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:55:59.266878 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.auth.core [None req-4b81fb7e-e31b-4d58-a494-e98f4a6d783f None None] MFA Rules not processed for user `ae4bcdd8106d4bebbdcae96be33505bc`. Rule list: `[]` (Enabled: `True`). {{(pid=86655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:55:59.268245 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-4b81fb7e-e31b-4d58-a494-e98f4a6d783f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:55:59.278856 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 1252/2492] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jul 14 10:55:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:55:59.283004 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3457c60a-11df-46e5-a17d-3b17f4c5a328 None None] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:55:59.293952 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3457c60a-11df-46e5-a17d-3b17f4c5a328 None None] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:55:59.298681 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83bdf13-fae1-4e51-a428-e797253d0ebb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:55:59.299489 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83bdf13-fae1-4e51-a428-e797253d0ebb admin admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:55:59.299778 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83bdf13-fae1-4e51-a428-e797253d0ebb admin admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:55:59.300057 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83bdf13-fae1-4e51-a428-e797253d0ebb admin admin] PATH_INFO: `/v3/domains` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:55:59.300832 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83bdf13-fae1-4e51-a428-e797253d0ebb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:55:59.301149 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83bdf13-fae1-4e51-a428-e797253d0ebb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:55:59.303107 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83bdf13-fae1-4e51-a428-e797253d0ebb admin admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:55:59.322945 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 1241/2493] 10.222.0.16 () {58 vars in 1152 bytes} [Thu Jul 14 10:55:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:55:59.324114 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b81fb7e-e31b-4d58-a494-e98f4a6d783f None None] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:55:59.335124 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b81fb7e-e31b-4d58-a494-e98f4a6d783f None None] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:55:59.340707 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b603a51-f042-469e-a4c2-74a8ca055680 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:55:59.341511 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b603a51-f042-469e-a4c2-74a8ca055680 admin admin] REQUEST_METHOD: `POST` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:55:59.341862 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b603a51-f042-469e-a4c2-74a8ca055680 admin admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:55:59.342203 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b603a51-f042-469e-a4c2-74a8ca055680 admin admin] PATH_INFO: `/v3/projects` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:55:59.343061 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b603a51-f042-469e-a4c2-74a8ca055680 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:55:59.345373 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b603a51-f042-469e-a4c2-74a8ca055680 admin admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:55:59.376326 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 1253/2494] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Jul 14 10:55:59 2022] POST /identity/v3/projects => generated 385 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:55:59.377753 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83bdf13-fae1-4e51-a428-e797253d0ebb admin admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:55:59.389961 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83bdf13-fae1-4e51-a428-e797253d0ebb admin admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:55:59.403272 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:55:59.464420 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b98a80d-627f-46fb-afdc-7dc6ffe48f79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:55:59.465137 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b98a80d-627f-46fb-afdc-7dc6ffe48f79 admin admin] REQUEST_METHOD: `POST` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:55:59.465425 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b98a80d-627f-46fb-afdc-7dc6ffe48f79 admin admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:55:59.465707 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b98a80d-627f-46fb-afdc-7dc6ffe48f79 admin admin] PATH_INFO: `/v3/users` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:55:59.466406 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b98a80d-627f-46fb-afdc-7dc6ffe48f79 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:55:59.468382 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b98a80d-627f-46fb-afdc-7dc6ffe48f79 admin admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:55:59.491202 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 1242/2495] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Jul 14 10:55:59 2022] POST /identity/v3/users => generated 293 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:55:59.497042 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b603a51-f042-469e-a4c2-74a8ca055680 admin admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:55:59.508497 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b603a51-f042-469e-a4c2-74a8ca055680 admin admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:55:59.513576 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6900980-0323-4b9e-9609-ff90ddbd5646 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:55:59.522687 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6900980-0323-4b9e-9609-ff90ddbd5646 admin admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:55:59.522974 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6900980-0323-4b9e-9609-ff90ddbd5646 admin admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:55:59.523277 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6900980-0323-4b9e-9609-ff90ddbd5646 admin admin] PATH_INFO: `/v3/roles` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:55:59.524032 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6900980-0323-4b9e-9609-ff90ddbd5646 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:55:59.526023 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6900980-0323-4b9e-9609-ff90ddbd5646 admin admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:55:59.540640 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 1254/2496] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jul 14 10:55:59 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 10:55:59.542993 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b98a80d-627f-46fb-afdc-7dc6ffe48f79 admin admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:55:59.560402 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b98a80d-627f-46fb-afdc-7dc6ffe48f79 admin admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:55:59.565275 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f1a516-561b-4770-a5de-cd01ab6b74e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:55:59.565935 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f1a516-561b-4770-a5de-cd01ab6b74e1 admin admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:55:59.566227 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f1a516-561b-4770-a5de-cd01ab6b74e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:55:59.568018 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f1a516-561b-4770-a5de-cd01ab6b74e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:55:59.568018 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f1a516-561b-4770-a5de-cd01ab6b74e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:55:59.569107 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f1a516-561b-4770-a5de-cd01ab6b74e1 admin admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:55:59.580882 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 1243/2497] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jul 14 10:55:59 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:55:59.585652 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6900980-0323-4b9e-9609-ff90ddbd5646 admin admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:55:59.598624 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6900980-0323-4b9e-9609-ff90ddbd5646 admin admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:55:59.604611 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2f29ab-76d8-4194-9787-6794a5f51246 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:55:59.605739 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2f29ab-76d8-4194-9787-6794a5f51246 admin admin] REQUEST_METHOD: `PUT` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:55:59.606037 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2f29ab-76d8-4194-9787-6794a5f51246 admin admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:55:59.606322 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2f29ab-76d8-4194-9787-6794a5f51246 admin admin] PATH_INFO: `/v3/projects/724a4cb2d61047fe8f866fb1f1f7b3e1/users/41abb12144d8452e9d870fd84a59dbbd/roles/0da46c267d354cce81495dfdd56c1ec2` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:55:59.628319 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2f29ab-76d8-4194-9787-6794a5f51246 admin admin] RBAC: Authorizing `identity:create_grant(project_id=724a4cb2d61047fe8f866fb1f1f7b3e1, user_id=41abb12144d8452e9d870fd84a59dbbd, role_id=0da46c267d354cce81495dfdd56c1ec2)` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:55:59.632217 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2f29ab-76d8-4194-9787-6794a5f51246 admin admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:55:59.650280 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 1255/2498] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Jul 14 10:55:59 2022] PUT /identity/v3/projects/724a4cb2d61047fe8f866fb1f1f7b3e1/users/41abb12144d8452e9d870fd84a59dbbd/roles/0da46c267d354cce81495dfdd56c1ec2 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:55:59.660613 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f578924-6099-42de-bf35-2a04118c4476 None None] REQUEST_METHOD: `POST` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:55:59.660938 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f578924-6099-42de-bf35-2a04118c4476 None None] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:55:59.661241 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f578924-6099-42de-bf35-2a04118c4476 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:55:59.691290 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.auth.core [None req-8f578924-6099-42de-bf35-2a04118c4476 None None] MFA Rules not processed for user `41abb12144d8452e9d870fd84a59dbbd`. Rule list: `[]` (Enabled: `True`). {{(pid=86656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:55:59.692558 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-8f578924-6099-42de-bf35-2a04118c4476 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:55:59.796389 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 1244/2499] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jul 14 10:55:59 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:55:59.805231 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2f29ab-76d8-4194-9787-6794a5f51246 admin admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:55:59.807644 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-3a2f29ab-76d8-4194-9787-6794a5f51246 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:55:59.845158 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:55:59.877940 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2f29ab-76d8-4194-9787-6794a5f51246 admin admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:55:59.881750 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8355eefa-5a28-4f95-8f7e-5254c7cc9fc4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68382432147a48c3b62271fd2a2eab04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59391272ecbe48b0aa736cb43807be1d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:55:59.882405 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8355eefa-5a28-4f95-8f7e-5254c7cc9fc4 service cinder] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:55:59.882690 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8355eefa-5a28-4f95-8f7e-5254c7cc9fc4 service cinder] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:55:59.882964 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8355eefa-5a28-4f95-8f7e-5254c7cc9fc4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:55:59.892532 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8355eefa-5a28-4f95-8f7e-5254c7cc9fc4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:55:59.894028 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8355eefa-5a28-4f95-8f7e-5254c7cc9fc4 service cinder] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:55:59.914880 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 1256/2500] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jul 14 10:55:59 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:56:02.609687 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f578924-6099-42de-bf35-2a04118c4476 None None] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:56:02.671311 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f578924-6099-42de-bf35-2a04118c4476 None None] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:56:02.675827 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425f09ea-d11b-4369-aa50-d9b6c15b262b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:56:02.676698 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425f09ea-d11b-4369-aa50-d9b6c15b262b admin admin] REQUEST_METHOD: `DELETE` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:56:02.677018 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425f09ea-d11b-4369-aa50-d9b6c15b262b admin admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:56:02.677294 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425f09ea-d11b-4369-aa50-d9b6c15b262b admin admin] PATH_INFO: `/v3/users/41abb12144d8452e9d870fd84a59dbbd` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:56:02.678483 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425f09ea-d11b-4369-aa50-d9b6c15b262b admin admin] RBAC: Authorizing `identity:delete_user(user_id=41abb12144d8452e9d870fd84a59dbbd)` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:56:02.680405 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425f09ea-d11b-4369-aa50-d9b6c15b262b admin admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:56:02.703337 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=93,keystone:INSERT=3,keystone:DELETE=4 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:56:02.729385 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-425f09ea-d11b-4369-aa50-d9b6c15b262b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '41abb12144d8452e9d870fd84a59dbbd'} {{(pid=86656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:56:02.736384 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-425f09ea-d11b-4369-aa50-d9b6c15b262b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '41abb12144d8452e9d870fd84a59dbbd'} {{(pid=86656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:56:02.737051 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-425f09ea-d11b-4369-aa50-d9b6c15b262b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '41abb12144d8452e9d870fd84a59dbbd'} {{(pid=86656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:56:02.744795 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-425f09ea-d11b-4369-aa50-d9b6c15b262b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '41abb12144d8452e9d870fd84a59dbbd'} {{(pid=86656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:56:02.745427 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-425f09ea-d11b-4369-aa50-d9b6c15b262b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '41abb12144d8452e9d870fd84a59dbbd'} {{(pid=86656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:56:02.763648 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 1245/2501] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Jul 14 10:56:02 2022] DELETE /identity/v3/users/41abb12144d8452e9d870fd84a59dbbd => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:56:02.768186 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6652562-f645-4b61-beb5-0e41b9f653d1 None None] REQUEST_METHOD: `POST` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:56:02.768658 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6652562-f645-4b61-beb5-0e41b9f653d1 None None] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:56:02.768754 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6652562-f645-4b61-beb5-0e41b9f653d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:56:02.787097 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.auth.core [None req-b6652562-f645-4b61-beb5-0e41b9f653d1 None None] MFA Rules not processed for user `ae4bcdd8106d4bebbdcae96be33505bc`. Rule list: `[]` (Enabled: `True`). {{(pid=86655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:56:02.788318 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-b6652562-f645-4b61-beb5-0e41b9f653d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:56:02.848628 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 1257/2502] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jul 14 10:56:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:56:02.858580 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425f09ea-d11b-4369-aa50-d9b6c15b262b admin admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:56:02.860158 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-425f09ea-d11b-4369-aa50-d9b6c15b262b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:56:02.919352 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425f09ea-d11b-4369-aa50-d9b6c15b262b admin admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:56:02.922936 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6303e238-cf2f-42cf-9b13-6077739974eb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dddf93691844886982c91fea974385d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59391272ecbe48b0aa736cb43807be1d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:56:02.923582 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6303e238-cf2f-42cf-9b13-6077739974eb service neutron] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:56:02.923866 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6303e238-cf2f-42cf-9b13-6077739974eb service neutron] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:56:02.924143 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6303e238-cf2f-42cf-9b13-6077739974eb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:56:02.933484 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6303e238-cf2f-42cf-9b13-6077739974eb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:56:02.934892 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6303e238-cf2f-42cf-9b13-6077739974eb service neutron] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:56:02.944436 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 1246/2503] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jul 14 10:56:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:56:03.216278 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6652562-f645-4b61-beb5-0e41b9f653d1 None None] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:56:03.217868 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-b6652562-f645-4b61-beb5-0e41b9f653d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:56:03.231197 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6652562-f645-4b61-beb5-0e41b9f653d1 None None] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:56:03.235932 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce2e2fd-3ece-4cab-b23d-671a4e5d1c16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:56:03.236887 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce2e2fd-3ece-4cab-b23d-671a4e5d1c16 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:56:03.237323 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce2e2fd-3ece-4cab-b23d-671a4e5d1c16 admin admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:56:03.237616 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce2e2fd-3ece-4cab-b23d-671a4e5d1c16 admin admin] PATH_INFO: `/v3/projects/724a4cb2d61047fe8f866fb1f1f7b3e1` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:56:03.238835 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce2e2fd-3ece-4cab-b23d-671a4e5d1c16 admin admin] RBAC: Authorizing `identity:delete_project(project_id=724a4cb2d61047fe8f866fb1f1f7b3e1)` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:56:03.240751 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce2e2fd-3ece-4cab-b23d-671a4e5d1c16 admin admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:56:03.291403 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-4ce2e2fd-3ece-4cab-b23d-671a4e5d1c16 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '724a4cb2d61047fe8f866fb1f1f7b3e1', 'request_id': 'req-4ce2e2fd-3ece-4cab-b23d-671a4e5d1c16'} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:56:03.298102 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-4ce2e2fd-3ece-4cab-b23d-671a4e5d1c16 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '724a4cb2d61047fe8f866fb1f1f7b3e1', 'request_id': 'req-4ce2e2fd-3ece-4cab-b23d-671a4e5d1c16'} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:56:03.305383 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-4ce2e2fd-3ece-4cab-b23d-671a4e5d1c16 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '724a4cb2d61047fe8f866fb1f1f7b3e1', 'request_id': 'req-4ce2e2fd-3ece-4cab-b23d-671a4e5d1c16'} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:56:03.317023 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-4ce2e2fd-3ece-4cab-b23d-671a4e5d1c16 admin admin] The token cache is being invalidate because project 724a4cb2d61047fe8f866fb1f1f7b3e1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86655) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 10:56:03.317426 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-4ce2e2fd-3ece-4cab-b23d-671a4e5d1c16 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:56:03.318055 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-4ce2e2fd-3ece-4cab-b23d-671a4e5d1c16 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:56:03.319854 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 1258/2504] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Jul 14 10:56:03 2022] DELETE /identity/v3/projects/724a4cb2d61047fe8f866fb1f1f7b3e1 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:56:03.324804 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe6249c-012c-44a7-a153-52ee06a5e05f None None] REQUEST_METHOD: `POST` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:56:03.325108 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe6249c-012c-44a7-a153-52ee06a5e05f None None] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:56:03.325396 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe6249c-012c-44a7-a153-52ee06a5e05f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:56:03.348418 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.auth.core [None req-dbe6249c-012c-44a7-a153-52ee06a5e05f None None] MFA Rules not processed for user `ae4bcdd8106d4bebbdcae96be33505bc`. Rule list: `[]` (Enabled: `True`). {{(pid=86656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:56:03.349991 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-dbe6249c-012c-44a7-a153-52ee06a5e05f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:56:03.413261 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 1247/2505] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jul 14 10:56:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:56:03.422029 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd48ff07-e428-4bfa-ab6e-1fbb314601ab None None] REQUEST_METHOD: `POST` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:56:03.422321 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd48ff07-e428-4bfa-ab6e-1fbb314601ab None None] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:56:03.422631 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd48ff07-e428-4bfa-ab6e-1fbb314601ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:56:03.442438 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.auth.core [None req-fd48ff07-e428-4bfa-ab6e-1fbb314601ab None None] MFA Rules not processed for user `ae4bcdd8106d4bebbdcae96be33505bc`. Rule list: `[]` (Enabled: `True`). {{(pid=86655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:56:03.443375 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-fd48ff07-e428-4bfa-ab6e-1fbb314601ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:56:03.452929 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 1259/2506] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jul 14 10:56:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:56:03.457398 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe6249c-012c-44a7-a153-52ee06a5e05f None None] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:56:03.468074 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe6249c-012c-44a7-a153-52ee06a5e05f None None] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:56:03.476963 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7105060f-3747-46b7-9f76-2b77c0313255 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:56:03.478192 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7105060f-3747-46b7-9f76-2b77c0313255 admin admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:56:03.478477 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7105060f-3747-46b7-9f76-2b77c0313255 admin admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:56:03.478760 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7105060f-3747-46b7-9f76-2b77c0313255 admin admin] PATH_INFO: `/v3/domains` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:56:03.479512 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7105060f-3747-46b7-9f76-2b77c0313255 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:56:03.479948 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7105060f-3747-46b7-9f76-2b77c0313255 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:56:03.481685 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7105060f-3747-46b7-9f76-2b77c0313255 admin admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:56:03.504219 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 1248/2507] 10.222.0.16 () {58 vars in 1152 bytes} [Thu Jul 14 10:56:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:56:03.505246 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd48ff07-e428-4bfa-ab6e-1fbb314601ab None None] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:56:03.515100 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd48ff07-e428-4bfa-ab6e-1fbb314601ab None None] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:56:03.519966 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92feead-8c30-4b58-92ff-3967d424e94d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:56:03.520631 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92feead-8c30-4b58-92ff-3967d424e94d admin admin] REQUEST_METHOD: `POST` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:56:03.520952 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92feead-8c30-4b58-92ff-3967d424e94d admin admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:56:03.521292 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92feead-8c30-4b58-92ff-3967d424e94d admin admin] PATH_INFO: `/v3/projects` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:56:03.522002 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92feead-8c30-4b58-92ff-3967d424e94d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:56:03.523897 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92feead-8c30-4b58-92ff-3967d424e94d admin admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:56:03.552832 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 1260/2508] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Jul 14 10:56:03 2022] POST /identity/v3/projects => generated 383 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 10:56:03.554978 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7105060f-3747-46b7-9f76-2b77c0313255 admin admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:56:03.565284 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7105060f-3747-46b7-9f76-2b77c0313255 admin admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:56:03.596816 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:56:03.631182 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3103448-f5b0-48ed-a27e-0421b327f471 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:56:03.631861 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3103448-f5b0-48ed-a27e-0421b327f471 admin admin] REQUEST_METHOD: `POST` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:56:03.632143 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3103448-f5b0-48ed-a27e-0421b327f471 admin admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:56:03.632419 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3103448-f5b0-48ed-a27e-0421b327f471 admin admin] PATH_INFO: `/v3/users` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:56:03.633192 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3103448-f5b0-48ed-a27e-0421b327f471 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:56:03.635755 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3103448-f5b0-48ed-a27e-0421b327f471 admin admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:56:03.660826 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 1249/2509] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Jul 14 10:56:03 2022] POST /identity/v3/users => generated 292 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:56:03.662483 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92feead-8c30-4b58-92ff-3967d424e94d admin admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:56:03.673778 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92feead-8c30-4b58-92ff-3967d424e94d admin admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:56:03.679753 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed85387-92d4-4720-b51e-8837d10f90f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:56:03.681203 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed85387-92d4-4720-b51e-8837d10f90f9 admin admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:56:03.681494 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed85387-92d4-4720-b51e-8837d10f90f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:56:03.681905 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed85387-92d4-4720-b51e-8837d10f90f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:56:03.682995 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed85387-92d4-4720-b51e-8837d10f90f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:56:03.684699 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed85387-92d4-4720-b51e-8837d10f90f9 admin admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:56:03.699998 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 1261/2510] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jul 14 10:56:03 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:56:03.704033 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3103448-f5b0-48ed-a27e-0421b327f471 admin admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:56:03.714697 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3103448-f5b0-48ed-a27e-0421b327f471 admin admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:56:03.719474 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851ad252-a0f1-44b1-a1bc-2b48e1ca748f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:56:03.720144 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851ad252-a0f1-44b1-a1bc-2b48e1ca748f admin admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:56:03.720432 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851ad252-a0f1-44b1-a1bc-2b48e1ca748f admin admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:56:03.720712 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851ad252-a0f1-44b1-a1bc-2b48e1ca748f admin admin] PATH_INFO: `/v3/roles` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:56:03.721477 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851ad252-a0f1-44b1-a1bc-2b48e1ca748f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:56:03.723077 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851ad252-a0f1-44b1-a1bc-2b48e1ca748f admin admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:56:03.733553 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 1250/2511] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jul 14 10:56:03 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:56:03.737860 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed85387-92d4-4720-b51e-8837d10f90f9 admin admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:56:03.749138 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed85387-92d4-4720-b51e-8837d10f90f9 admin admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:56:03.755137 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3212136-7d9f-4e68-9fcf-83e001127f53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:56:03.756221 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3212136-7d9f-4e68-9fcf-83e001127f53 admin admin] REQUEST_METHOD: `PUT` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:56:03.756507 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3212136-7d9f-4e68-9fcf-83e001127f53 admin admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:56:03.757284 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3212136-7d9f-4e68-9fcf-83e001127f53 admin admin] PATH_INFO: `/v3/projects/a65ee1a2d63048f49e7884da3bba012e/users/1492156ccead49928ef9fbf3d9f9581b/roles/0da46c267d354cce81495dfdd56c1ec2` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:56:03.770009 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:56:03.773590 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3212136-7d9f-4e68-9fcf-83e001127f53 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a65ee1a2d63048f49e7884da3bba012e, user_id=1492156ccead49928ef9fbf3d9f9581b, role_id=0da46c267d354cce81495dfdd56c1ec2)` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:56:03.777562 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3212136-7d9f-4e68-9fcf-83e001127f53 admin admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:56:03.794418 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 1262/2512] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Jul 14 10:56:03 2022] PUT /identity/v3/projects/a65ee1a2d63048f49e7884da3bba012e/users/1492156ccead49928ef9fbf3d9f9581b/roles/0da46c267d354cce81495dfdd56c1ec2 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 10:56:03.799384 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f113b7af-27d0-4647-991e-6131b9c24004 None None] REQUEST_METHOD: `POST` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:56:03.799698 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f113b7af-27d0-4647-991e-6131b9c24004 None None] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:56:03.799976 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f113b7af-27d0-4647-991e-6131b9c24004 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:56:03.818861 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.auth.core [None req-f113b7af-27d0-4647-991e-6131b9c24004 None None] MFA Rules not processed for user `ae4bcdd8106d4bebbdcae96be33505bc`. Rule list: `[]` (Enabled: `True`). {{(pid=86656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:56:03.820077 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-f113b7af-27d0-4647-991e-6131b9c24004 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:56:03.878666 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 1251/2513] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jul 14 10:56:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:56:03.888194 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3212136-7d9f-4e68-9fcf-83e001127f53 admin admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:56:03.890233 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-f3212136-7d9f-4e68-9fcf-83e001127f53 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:56:03.947014 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3212136-7d9f-4e68-9fcf-83e001127f53 admin admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:56:03.950609 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2dbdb89-1175-4ec0-891b-1c9f3c5155ca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dddf93691844886982c91fea974385d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59391272ecbe48b0aa736cb43807be1d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:56:03.951251 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2dbdb89-1175-4ec0-891b-1c9f3c5155ca service neutron] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:56:03.951699 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2dbdb89-1175-4ec0-891b-1c9f3c5155ca service neutron] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:56:03.951980 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2dbdb89-1175-4ec0-891b-1c9f3c5155ca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:56:03.961031 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2dbdb89-1175-4ec0-891b-1c9f3c5155ca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:56:03.962463 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2dbdb89-1175-4ec0-891b-1c9f3c5155ca service neutron] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:56:03.972370 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 1263/2514] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jul 14 10:56:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:56:04.613215 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd8aa0c-5809-4083-976d-7473e857f39d None None] REQUEST_METHOD: `POST` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:56:04.613537 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd8aa0c-5809-4083-976d-7473e857f39d None None] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:56:04.613823 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd8aa0c-5809-4083-976d-7473e857f39d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:56:04.639106 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.auth.core [None req-cbd8aa0c-5809-4083-976d-7473e857f39d None None] MFA Rules not processed for user `a4034c8b54284229a38afc0c5210bc37`. Rule list: `[]` (Enabled: `True`). {{(pid=86656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:56:04.640410 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-cbd8aa0c-5809-4083-976d-7473e857f39d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:56:04.723823 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 1252/2515] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jul 14 10:56:04 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:56:10.039530 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea29e37-dd5e-4982-b277-c0b2fac26354 None None] REQUEST_METHOD: `POST` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:56:10.040156 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea29e37-dd5e-4982-b277-c0b2fac26354 None None] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:56:10.040156 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea29e37-dd5e-4982-b277-c0b2fac26354 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:56:10.090365 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.auth.core [None req-4ea29e37-dd5e-4982-b277-c0b2fac26354 None None] MFA Rules not processed for user `1492156ccead49928ef9fbf3d9f9581b`. Rule list: `[]` (Enabled: `True`). {{(pid=86655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:56:10.092107 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-4ea29e37-dd5e-4982-b277-c0b2fac26354 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:56:10.180617 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 1264/2516] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jul 14 10:56:10 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:56:10.184352 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd8aa0c-5809-4083-976d-7473e857f39d None None] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:56:10.203599 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd8aa0c-5809-4083-976d-7473e857f39d None None] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:56:10.209831 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b0011f-8baa-4e3b-ab92-7f715b7b48ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:56:10.210510 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b0011f-8baa-4e3b-ab92-7f715b7b48ad admin admin] REQUEST_METHOD: `POST` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:56:10.210792 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b0011f-8baa-4e3b-ab92-7f715b7b48ad admin admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:56:10.211070 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b0011f-8baa-4e3b-ab92-7f715b7b48ad admin admin] PATH_INFO: `/v3/projects` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:56:10.212367 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b0011f-8baa-4e3b-ab92-7f715b7b48ad admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:56:10.214332 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b0011f-8baa-4e3b-ab92-7f715b7b48ad admin admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:56:10.244928 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 1253/2517] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Jul 14 10:56:10 2022] POST /identity/v3/projects => generated 385 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:56:10.248408 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea29e37-dd5e-4982-b277-c0b2fac26354 None None] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:56:10.263495 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea29e37-dd5e-4982-b277-c0b2fac26354 None None] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:56:10.352014 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df6d2eb-c3f7-4149-962d-19b2e1a4f15b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:56:10.353784 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df6d2eb-c3f7-4149-962d-19b2e1a4f15b admin admin] REQUEST_METHOD: `POST` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:56:10.353784 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df6d2eb-c3f7-4149-962d-19b2e1a4f15b admin admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:56:10.354014 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df6d2eb-c3f7-4149-962d-19b2e1a4f15b admin admin] PATH_INFO: `/v3/users` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:56:10.354826 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df6d2eb-c3f7-4149-962d-19b2e1a4f15b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:56:10.357082 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df6d2eb-c3f7-4149-962d-19b2e1a4f15b admin admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:56:10.410682 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 1265/2518] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Jul 14 10:56:10 2022] POST /identity/v3/users => generated 299 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:56:10.411538 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b0011f-8baa-4e3b-ab92-7f715b7b48ad admin admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:56:10.422231 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b0011f-8baa-4e3b-ab92-7f715b7b48ad admin admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:56:10.440324 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7563647f-9041-4496-9949-d5f50f5daf3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:56:10.441072 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7563647f-9041-4496-9949-d5f50f5daf3f admin admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:56:10.441355 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7563647f-9041-4496-9949-d5f50f5daf3f admin admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:56:10.441644 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7563647f-9041-4496-9949-d5f50f5daf3f admin admin] PATH_INFO: `/v3/roles` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:56:10.443358 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7563647f-9041-4496-9949-d5f50f5daf3f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:56:10.444373 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7563647f-9041-4496-9949-d5f50f5daf3f admin admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:56:10.456858 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 1254/2519] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jul 14 10:56:10 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:56:10.460535 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df6d2eb-c3f7-4149-962d-19b2e1a4f15b admin admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:56:10.475791 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df6d2eb-c3f7-4149-962d-19b2e1a4f15b admin admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:56:10.481867 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277bebf3-57bf-4745-87b3-d2992fad6b0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:56:10.483092 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277bebf3-57bf-4745-87b3-d2992fad6b0e admin admin] REQUEST_METHOD: `PUT` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:56:10.483623 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277bebf3-57bf-4745-87b3-d2992fad6b0e admin admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:56:10.483999 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277bebf3-57bf-4745-87b3-d2992fad6b0e admin admin] PATH_INFO: `/v3/projects/44a6f7e232e342d7bcdbb4507f508ac7/users/2f907157cd2a49619d538f0c25d83f7e/roles/153539819e5542df99269d2913bbecfb` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:56:10.519055 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:56:10.535866 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277bebf3-57bf-4745-87b3-d2992fad6b0e admin admin] RBAC: Authorizing `identity:create_grant(project_id=44a6f7e232e342d7bcdbb4507f508ac7, user_id=2f907157cd2a49619d538f0c25d83f7e, role_id=153539819e5542df99269d2913bbecfb)` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:56:10.540513 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277bebf3-57bf-4745-87b3-d2992fad6b0e admin admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:56:10.584433 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 1266/2520] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Jul 14 10:56:10 2022] PUT /identity/v3/projects/44a6f7e232e342d7bcdbb4507f508ac7/users/2f907157cd2a49619d538f0c25d83f7e/roles/153539819e5542df99269d2913bbecfb => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 10:56:10.589285 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7563647f-9041-4496-9949-d5f50f5daf3f admin admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:56:10.601305 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7563647f-9041-4496-9949-d5f50f5daf3f admin admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:56:10.629177 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:56:10.686378 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bafe95-0198-4e59-b5c1-4311adc88f23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:56:10.687824 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bafe95-0198-4e59-b5c1-4311adc88f23 admin admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:56:10.688318 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bafe95-0198-4e59-b5c1-4311adc88f23 admin admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:56:10.689041 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bafe95-0198-4e59-b5c1-4311adc88f23 admin admin] PATH_INFO: `/v3/roles` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:56:10.690343 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99bafe95-0198-4e59-b5c1-4311adc88f23 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:56:10.692386 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99bafe95-0198-4e59-b5c1-4311adc88f23 admin admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:56:10.726688 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277bebf3-57bf-4745-87b3-d2992fad6b0e admin admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:56:10.728699 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 1255/2521] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jul 14 10:56:10 2022] GET /identity/v3/roles => generated 1420 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:56:10.740849 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277bebf3-57bf-4745-87b3-d2992fad6b0e admin admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:56:10.750689 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bafe95-0198-4e59-b5c1-4311adc88f23 admin admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:56:10.756095 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aeb2a0b-4f12-49a4-b940-b5fcf19c965d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:56:10.757748 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aeb2a0b-4f12-49a4-b940-b5fcf19c965d admin admin] REQUEST_METHOD: `PUT` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:56:10.758222 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aeb2a0b-4f12-49a4-b940-b5fcf19c965d admin admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:56:10.758862 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aeb2a0b-4f12-49a4-b940-b5fcf19c965d admin admin] PATH_INFO: `/v3/projects/44a6f7e232e342d7bcdbb4507f508ac7/users/2f907157cd2a49619d538f0c25d83f7e/roles/153539819e5542df99269d2913bbecfb` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:56:10.761793 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aeb2a0b-4f12-49a4-b940-b5fcf19c965d admin admin] RBAC: Authorizing `identity:create_grant(project_id=44a6f7e232e342d7bcdbb4507f508ac7, user_id=2f907157cd2a49619d538f0c25d83f7e, role_id=153539819e5542df99269d2913bbecfb)` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:56:10.765064 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aeb2a0b-4f12-49a4-b940-b5fcf19c965d admin admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:56:10.786270 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 1267/2522] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Jul 14 10:56:10 2022] PUT /identity/v3/projects/44a6f7e232e342d7bcdbb4507f508ac7/users/2f907157cd2a49619d538f0c25d83f7e/roles/153539819e5542df99269d2913bbecfb => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 10:56:10.854118 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bafe95-0198-4e59-b5c1-4311adc88f23 admin admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:56:10.955120 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73450cb6-eb81-4800-9db0-21166c2df009 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dddf93691844886982c91fea974385d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59391272ecbe48b0aa736cb43807be1d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:56:10.955880 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73450cb6-eb81-4800-9db0-21166c2df009 service neutron] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:56:10.956159 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73450cb6-eb81-4800-9db0-21166c2df009 service neutron] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:56:10.956444 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73450cb6-eb81-4800-9db0-21166c2df009 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:56:10.961421 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-73450cb6-eb81-4800-9db0-21166c2df009 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:56:11.079575 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73450cb6-eb81-4800-9db0-21166c2df009 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:56:11.083483 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73450cb6-eb81-4800-9db0-21166c2df009 service neutron] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:56:11.113152 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 1256/2523] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jul 14 10:56:10 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 10:56:16.557681 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0257a0-53cb-461c-8037-0ab0d52b5626 None None] REQUEST_METHOD: `POST` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:56:16.558217 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0257a0-53cb-461c-8037-0ab0d52b5626 None None] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:56:16.558366 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0257a0-53cb-461c-8037-0ab0d52b5626 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:56:16.588263 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.auth.core [None req-4d0257a0-53cb-461c-8037-0ab0d52b5626 None None] MFA Rules not processed for user `2f907157cd2a49619d538f0c25d83f7e`. Rule list: `[]` (Enabled: `True`). {{(pid=86655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:56:16.589608 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-4d0257a0-53cb-461c-8037-0ab0d52b5626 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:56:16.672472 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 1268/2524] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jul 14 10:56:16 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:56:16.684620 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73450cb6-eb81-4800-9db0-21166c2df009 service neutron] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:56:16.686073 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-73450cb6-eb81-4800-9db0-21166c2df009 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:56:16.719043 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=100 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:56:16.749119 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73450cb6-eb81-4800-9db0-21166c2df009 service neutron] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:56:16.752717 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8b171c-919d-4b0f-8303-27c49fa83fba service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cb877bf3f8241dcb2ecbb612c7f4f69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59391272ecbe48b0aa736cb43807be1d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:56:16.753396 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8b171c-919d-4b0f-8303-27c49fa83fba service glance] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:56:16.753682 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8b171c-919d-4b0f-8303-27c49fa83fba service glance] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:56:16.754015 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8b171c-919d-4b0f-8303-27c49fa83fba service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:56:16.826957 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8b171c-919d-4b0f-8303-27c49fa83fba service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:56:16.828506 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8b171c-919d-4b0f-8303-27c49fa83fba service glance] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:56:16.837958 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 1257/2525] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jul 14 10:56:16 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:56:16.937483 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d695d1-19ac-497d-9cf7-f437bb86fa75 None None] REQUEST_METHOD: `POST` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:56:16.937778 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d695d1-19ac-497d-9cf7-f437bb86fa75 None None] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:56:16.938079 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d695d1-19ac-497d-9cf7-f437bb86fa75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:56:16.959736 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.auth.core [None req-81d695d1-19ac-497d-9cf7-f437bb86fa75 None None] MFA Rules not processed for user `0dfc7cd9c05e4f268d2ce316d531c4bd`. Rule list: `[]` (Enabled: `True`). {{(pid=86655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:56:16.962406 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-81d695d1-19ac-497d-9cf7-f437bb86fa75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:56:17.027455 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 1269/2526] 10.222.0.16 () {58 vars in 1009 bytes} [Thu Jul 14 10:56:16 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:56:17.076182 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8b171c-919d-4b0f-8303-27c49fa83fba service glance] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:56:17.077667 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-ad8b171c-919d-4b0f-8303-27c49fa83fba service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:56:17.164334 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8b171c-919d-4b0f-8303-27c49fa83fba service glance] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:56:17.169314 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f645ed2-9553-4143-9a61-85d716c003d8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a23de49b80643eaab7a212f2884d62e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59391272ecbe48b0aa736cb43807be1d', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:56:17.169960 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f645ed2-9553-4143-9a61-85d716c003d8 service swift] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:56:17.170241 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f645ed2-9553-4143-9a61-85d716c003d8 service swift] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:56:17.170537 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f645ed2-9553-4143-9a61-85d716c003d8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:56:17.179110 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f645ed2-9553-4143-9a61-85d716c003d8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:56:17.181474 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f645ed2-9553-4143-9a61-85d716c003d8 service swift] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:56:17.190455 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 1258/2527] 10.222.0.16 () {60 vars in 1384 bytes} [Thu Jul 14 10:56:17 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 14 10:56:23.722877 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22d04a9-d1a0-4985-9d5b-c4fa0db26327 None None] REQUEST_METHOD: `POST` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:56:23.723508 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22d04a9-d1a0-4985-9d5b-c4fa0db26327 None None] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:56:23.723508 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22d04a9-d1a0-4985-9d5b-c4fa0db26327 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:56:23.744449 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.auth.core [None req-e22d04a9-d1a0-4985-9d5b-c4fa0db26327 None None] MFA Rules not processed for user `ae4bcdd8106d4bebbdcae96be33505bc`. Rule list: `[]` (Enabled: `True`). {{(pid=86655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:56:23.745709 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-e22d04a9-d1a0-4985-9d5b-c4fa0db26327 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:56:23.823912 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 1270/2528] 10.222.0.73 () {58 vars in 1016 bytes} [Thu Jul 14 10:56:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:56:23.841408 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f645ed2-9553-4143-9a61-85d716c003d8 service swift] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:56:23.843577 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-6f645ed2-9553-4143-9a61-85d716c003d8 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:56:23.929866 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f645ed2-9553-4143-9a61-85d716c003d8 service swift] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:56:23.936522 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9df64b2-8c96-4877-acd1-4b782b3bbf8d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26aa294c913c408499a913ec25bb677d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59391272ecbe48b0aa736cb43807be1d', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:56:23.937355 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9df64b2-8c96-4877-acd1-4b782b3bbf8d service nova] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:56:23.937733 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9df64b2-8c96-4877-acd1-4b782b3bbf8d service nova] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:56:23.938105 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9df64b2-8c96-4877-acd1-4b782b3bbf8d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:56:23.945030 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=100 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:56:23.950447 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9df64b2-8c96-4877-acd1-4b782b3bbf8d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:56:23.954601 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9df64b2-8c96-4877-acd1-4b782b3bbf8d service nova] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:56:23.966192 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 1259/2529] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jul 14 10:56:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:56:26.081443 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53027927-4960-4926-a9f1-5aa4760e8e18 None None] REQUEST_METHOD: `POST` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:56:26.081945 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53027927-4960-4926-a9f1-5aa4760e8e18 None None] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:56:26.082050 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53027927-4960-4926-a9f1-5aa4760e8e18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:56:26.094925 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:56:26.101802 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.auth.core [None req-53027927-4960-4926-a9f1-5aa4760e8e18 None None] MFA Rules not processed for user `1492156ccead49928ef9fbf3d9f9581b`. Rule list: `[]` (Enabled: `True`). {{(pid=86655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:56:26.103116 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-53027927-4960-4926-a9f1-5aa4760e8e18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:56:26.110089 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 1271/2530] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jul 14 10:56:26 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:56:27.934353 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84eb9719-1eaa-4f9a-a0a9-d618aa642aff None None] REQUEST_METHOD: `POST` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:56:27.934829 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84eb9719-1eaa-4f9a-a0a9-d618aa642aff None None] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:56:27.934947 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84eb9719-1eaa-4f9a-a0a9-d618aa642aff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:56:27.959779 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.auth.core [None req-84eb9719-1eaa-4f9a-a0a9-d618aa642aff None None] MFA Rules not processed for user `0dfc7cd9c05e4f268d2ce316d531c4bd`. Rule list: `[]` (Enabled: `True`). {{(pid=86656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:56:27.962542 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-84eb9719-1eaa-4f9a-a0a9-d618aa642aff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:56:27.974914 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 1260/2531] 10.222.0.16 () {58 vars in 1009 bytes} [Thu Jul 14 10:56:27 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:56:27.988501 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53027927-4960-4926-a9f1-5aa4760e8e18 None None] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:56:28.001923 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53027927-4960-4926-a9f1-5aa4760e8e18 None None] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:56:28.007099 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818a3fa7-2a7c-49c9-b5a0-a89a95fc5e2c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a23de49b80643eaab7a212f2884d62e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59391272ecbe48b0aa736cb43807be1d', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:56:28.007764 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818a3fa7-2a7c-49c9-b5a0-a89a95fc5e2c service swift] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:56:28.008615 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818a3fa7-2a7c-49c9-b5a0-a89a95fc5e2c service swift] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:56:28.009013 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818a3fa7-2a7c-49c9-b5a0-a89a95fc5e2c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:56:28.018024 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818a3fa7-2a7c-49c9-b5a0-a89a95fc5e2c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:56:28.019675 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818a3fa7-2a7c-49c9-b5a0-a89a95fc5e2c service swift] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:56:28.029111 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 1272/2532] 10.222.0.16 () {60 vars in 1384 bytes} [Thu Jul 14 10:56:27 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 14 10:56:28.067794 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da74dc49-f983-4a74-a4d1-1c69cd176500 None None] REQUEST_METHOD: `POST` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:56:28.068096 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da74dc49-f983-4a74-a4d1-1c69cd176500 None None] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:56:28.068626 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da74dc49-f983-4a74-a4d1-1c69cd176500 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:56:28.110601 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.auth.core [None req-da74dc49-f983-4a74-a4d1-1c69cd176500 None None] MFA Rules not processed for user `ae4bcdd8106d4bebbdcae96be33505bc`. Rule list: `[]` (Enabled: `True`). {{(pid=86656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:56:28.113322 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-da74dc49-f983-4a74-a4d1-1c69cd176500 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:56:28.124393 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 1261/2533] 10.222.0.73 () {58 vars in 1016 bytes} [Thu Jul 14 10:56:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:56:28.150555 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818a3fa7-2a7c-49c9-b5a0-a89a95fc5e2c service swift] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:56:28.152578 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-818a3fa7-2a7c-49c9-b5a0-a89a95fc5e2c service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:56:28.181467 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818a3fa7-2a7c-49c9-b5a0-a89a95fc5e2c service swift] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:56:28.190980 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfb476a-9cbf-4815-b3ed-57de24845615 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26aa294c913c408499a913ec25bb677d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59391272ecbe48b0aa736cb43807be1d', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:56:28.192095 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfb476a-9cbf-4815-b3ed-57de24845615 service nova] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:56:28.192960 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfb476a-9cbf-4815-b3ed-57de24845615 service nova] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:56:28.193685 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfb476a-9cbf-4815-b3ed-57de24845615 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:56:28.209532 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdfb476a-9cbf-4815-b3ed-57de24845615 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:56:28.212505 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdfb476a-9cbf-4815-b3ed-57de24845615 service nova] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:56:28.232125 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 1273/2534] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jul 14 10:56:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:56:38.089238 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=9 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:56:38.221477 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=12 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:56:48.637735 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769282d2-ae14-43a6-8097-82a3a9235a2f None None] REQUEST_METHOD: `POST` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:56:48.638266 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769282d2-ae14-43a6-8097-82a3a9235a2f None None] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:56:48.638266 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769282d2-ae14-43a6-8097-82a3a9235a2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:56:48.656401 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.auth.core [None req-769282d2-ae14-43a6-8097-82a3a9235a2f None None] MFA Rules not processed for user `ae4bcdd8106d4bebbdcae96be33505bc`. Rule list: `[]` (Enabled: `True`). {{(pid=86656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:56:48.657635 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-769282d2-ae14-43a6-8097-82a3a9235a2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:56:48.666178 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 1262/2535] 10.222.0.73 () {58 vars in 1016 bytes} [Thu Jul 14 10:56:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:56:48.681067 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfb476a-9cbf-4815-b3ed-57de24845615 service nova] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:56:48.692259 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfb476a-9cbf-4815-b3ed-57de24845615 service nova] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:56:48.697986 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ab3003-e47d-43d7-a147-4f719d18b202 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26aa294c913c408499a913ec25bb677d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59391272ecbe48b0aa736cb43807be1d', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:56:48.698623 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ab3003-e47d-43d7-a147-4f719d18b202 service nova] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:56:48.698909 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ab3003-e47d-43d7-a147-4f719d18b202 service nova] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:56:48.699227 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ab3003-e47d-43d7-a147-4f719d18b202 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:56:48.707349 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ab3003-e47d-43d7-a147-4f719d18b202 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:56:48.708954 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ab3003-e47d-43d7-a147-4f719d18b202 service nova] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:56:48.718822 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 1274/2536] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jul 14 10:56:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:56:53.873144 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e2d5b1-cf1f-486b-87b1-54873d47fe86 None None] REQUEST_METHOD: `POST` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:56:53.873657 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e2d5b1-cf1f-486b-87b1-54873d47fe86 None None] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:56:53.873800 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e2d5b1-cf1f-486b-87b1-54873d47fe86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:56:53.892469 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.auth.core [None req-19e2d5b1-cf1f-486b-87b1-54873d47fe86 None None] MFA Rules not processed for user `ae4bcdd8106d4bebbdcae96be33505bc`. Rule list: `[]` (Enabled: `True`). {{(pid=86656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:56:53.893758 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-19e2d5b1-cf1f-486b-87b1-54873d47fe86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:56:53.907861 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 1263/2537] 10.222.0.73 () {58 vars in 1016 bytes} [Thu Jul 14 10:56:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:56:53.924345 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ab3003-e47d-43d7-a147-4f719d18b202 service nova] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:56:53.936598 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ab3003-e47d-43d7-a147-4f719d18b202 service nova] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:56:53.942269 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18a5033-d967-45da-8fdd-61bfab5ae3b0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26aa294c913c408499a913ec25bb677d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59391272ecbe48b0aa736cb43807be1d', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:56:53.942920 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18a5033-d967-45da-8fdd-61bfab5ae3b0 service nova] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:56:53.943204 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18a5033-d967-45da-8fdd-61bfab5ae3b0 service nova] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:56:53.943825 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18a5033-d967-45da-8fdd-61bfab5ae3b0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:56:53.953236 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18a5033-d967-45da-8fdd-61bfab5ae3b0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:56:53.954901 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18a5033-d967-45da-8fdd-61bfab5ae3b0 service nova] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:56:53.965524 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 1275/2538] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jul 14 10:56:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 10:56:59.127647 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c3214a-e659-4e5e-9be3-626e51120db7 None None] REQUEST_METHOD: `POST` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:56:59.128152 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c3214a-e659-4e5e-9be3-626e51120db7 None None] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:56:59.128239 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c3214a-e659-4e5e-9be3-626e51120db7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:56:59.146852 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.auth.core [None req-69c3214a-e659-4e5e-9be3-626e51120db7 None None] MFA Rules not processed for user `ae4bcdd8106d4bebbdcae96be33505bc`. Rule list: `[]` (Enabled: `True`). {{(pid=86656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:56:59.148049 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-69c3214a-e659-4e5e-9be3-626e51120db7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:56:59.156217 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 1264/2539] 10.222.0.73 () {58 vars in 1016 bytes} [Thu Jul 14 10:56:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:56:59.170235 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18a5033-d967-45da-8fdd-61bfab5ae3b0 service nova] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:56:59.181841 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18a5033-d967-45da-8fdd-61bfab5ae3b0 service nova] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:56:59.187305 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728b4d46-62b0-4ba2-9e47-2cb3458a5004 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26aa294c913c408499a913ec25bb677d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59391272ecbe48b0aa736cb43807be1d', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:56:59.187942 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728b4d46-62b0-4ba2-9e47-2cb3458a5004 service nova] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:56:59.188229 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728b4d46-62b0-4ba2-9e47-2cb3458a5004 service nova] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:56:59.188510 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728b4d46-62b0-4ba2-9e47-2cb3458a5004 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:56:59.197537 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728b4d46-62b0-4ba2-9e47-2cb3458a5004 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:56:59.199103 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728b4d46-62b0-4ba2-9e47-2cb3458a5004 service nova] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:56:59.208521 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 1276/2540] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jul 14 10:56:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:57:03.793841 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c3214a-e659-4e5e-9be3-626e51120db7 None None] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:57:03.795496 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-69c3214a-e659-4e5e-9be3-626e51120db7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:57:03.809066 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c3214a-e659-4e5e-9be3-626e51120db7 None None] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:57:03.813339 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47067915-db86-4486-bb5b-91ce8c4bc981 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dddf93691844886982c91fea974385d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59391272ecbe48b0aa736cb43807be1d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:57:03.814036 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47067915-db86-4486-bb5b-91ce8c4bc981 service neutron] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:57:03.814318 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47067915-db86-4486-bb5b-91ce8c4bc981 service neutron] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:57:03.814755 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47067915-db86-4486-bb5b-91ce8c4bc981 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:57:03.826132 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47067915-db86-4486-bb5b-91ce8c4bc981 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:57:03.827641 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47067915-db86-4486-bb5b-91ce8c4bc981 service neutron] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:57:03.837600 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 1265/2541] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jul 14 10:57:03 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:57:09.204314 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=18 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:57:10.054613 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2db2a0-ef48-4bb1-aa05-bb53d212732c None None] REQUEST_METHOD: `POST` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:57:10.054913 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2db2a0-ef48-4bb1-aa05-bb53d212732c None None] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:57:10.055233 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2db2a0-ef48-4bb1-aa05-bb53d212732c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:57:10.074327 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.auth.core [None req-3b2db2a0-ef48-4bb1-aa05-bb53d212732c None None] MFA Rules not processed for user `fae8e5bd232344cca09294651f4cd93e`. Rule list: `[]` (Enabled: `True`). {{(pid=86655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:57:10.075542 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-3b2db2a0-ef48-4bb1-aa05-bb53d212732c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:57:10.129512 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 1277/2542] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jul 14 10:57:10 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:57:13.833255 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=15 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:57:19.095532 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0952fceb-5b04-4482-87a9-4d36926b865d None None] REQUEST_METHOD: `POST` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:57:19.096104 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0952fceb-5b04-4482-87a9-4d36926b865d None None] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:57:19.096104 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0952fceb-5b04-4482-87a9-4d36926b865d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:57:19.113910 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.auth.core [None req-0952fceb-5b04-4482-87a9-4d36926b865d None None] MFA Rules not processed for user `0dfc7cd9c05e4f268d2ce316d531c4bd`. Rule list: `[]` (Enabled: `True`). {{(pid=86656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:57:19.115163 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-0952fceb-5b04-4482-87a9-4d36926b865d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:57:19.123153 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 1266/2543] 10.222.0.16 () {58 vars in 1009 bytes} [Thu Jul 14 10:57:19 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:57:19.147388 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2db2a0-ef48-4bb1-aa05-bb53d212732c None None] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:57:19.160636 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2db2a0-ef48-4bb1-aa05-bb53d212732c None None] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:57:19.167123 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5742de8-1fd4-4b63-bd72-97345787f69a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a23de49b80643eaab7a212f2884d62e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59391272ecbe48b0aa736cb43807be1d', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:57:19.167788 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5742de8-1fd4-4b63-bd72-97345787f69a service swift] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:57:19.168073 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5742de8-1fd4-4b63-bd72-97345787f69a service swift] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:57:19.168351 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5742de8-1fd4-4b63-bd72-97345787f69a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:57:19.177847 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5742de8-1fd4-4b63-bd72-97345787f69a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:57:19.179518 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5742de8-1fd4-4b63-bd72-97345787f69a service swift] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:57:19.197321 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 1278/2544] 10.222.0.16 () {60 vars in 1384 bytes} [Thu Jul 14 10:57:19 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 14 10:57:29.108696 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=3 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:57:29.186732 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=31 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:57:33.114112 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be883a6c-897d-4d81-a1cb-dbc0a403e3cd None None] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:57:33.114687 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be883a6c-897d-4d81-a1cb-dbc0a403e3cd None None] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:57:33.114687 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be883a6c-897d-4d81-a1cb-dbc0a403e3cd None None] PATH_INFO: `/` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:57:33.116095 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 1267/2545] 10.222.0.16 () {54 vars in 921 bytes} [Thu Jul 14 10:57:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:57:33.122447 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ce7cfb-1b80-4933-b63b-278e217a8d38 None None] REQUEST_METHOD: `POST` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:57:33.122943 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ce7cfb-1b80-4933-b63b-278e217a8d38 None None] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:57:33.123151 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ce7cfb-1b80-4933-b63b-278e217a8d38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:57:33.145946 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.auth.core [None req-76ce7cfb-1b80-4933-b63b-278e217a8d38 None None] MFA Rules not processed for user `26aa294c913c408499a913ec25bb677d`. Rule list: `[]` (Enabled: `True`). {{(pid=86655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:57:33.147175 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-76ce7cfb-1b80-4933-b63b-278e217a8d38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:57:33.157852 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 1279/2546] 10.222.0.16 () {58 vars in 1018 bytes} [Thu Jul 14 10:57:33 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:57:33.169633 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be883a6c-897d-4d81-a1cb-dbc0a403e3cd None None] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:57:33.183866 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be883a6c-897d-4d81-a1cb-dbc0a403e3cd None None] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:57:33.187684 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c717a4b5-3b6e-41ab-8978-d16f16334a92 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cb877bf3f8241dcb2ecbb612c7f4f69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59391272ecbe48b0aa736cb43807be1d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:57:33.188357 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c717a4b5-3b6e-41ab-8978-d16f16334a92 service glance] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:57:33.188710 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c717a4b5-3b6e-41ab-8978-d16f16334a92 service glance] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:57:33.189018 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c717a4b5-3b6e-41ab-8978-d16f16334a92 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:57:33.200513 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c717a4b5-3b6e-41ab-8978-d16f16334a92 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:57:33.202095 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c717a4b5-3b6e-41ab-8978-d16f16334a92 service glance] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:57:33.213588 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 1268/2547] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jul 14 10:57:33 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:57:33.281934 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b758cb-a6aa-4b40-87bf-0e076cf51c95 None None] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:57:33.282286 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b758cb-a6aa-4b40-87bf-0e076cf51c95 None None] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:57:33.282610 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b758cb-a6aa-4b40-87bf-0e076cf51c95 None None] PATH_INFO: `/` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:57:33.284112 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 1280/2548] 10.222.0.16 () {54 vars in 921 bytes} [Thu Jul 14 10:57:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:57:33.289004 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12995f95-02d8-4771-9935-066eb572900f None None] REQUEST_METHOD: `POST` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:57:33.289326 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12995f95-02d8-4771-9935-066eb572900f None None] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:57:33.289608 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12995f95-02d8-4771-9935-066eb572900f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:57:33.307601 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.auth.core [None req-12995f95-02d8-4771-9935-066eb572900f None None] MFA Rules not processed for user `4dddf93691844886982c91fea974385d`. Rule list: `[]` (Enabled: `True`). {{(pid=86656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:57:33.308850 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-12995f95-02d8-4771-9935-066eb572900f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:57:33.315311 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 1269/2549] 10.222.0.16 () {58 vars in 1018 bytes} [Thu Jul 14 10:57:33 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:57:33.327772 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b758cb-a6aa-4b40-87bf-0e076cf51c95 None None] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:57:33.339327 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b758cb-a6aa-4b40-87bf-0e076cf51c95 None None] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:57:33.343005 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9724c951-0305-4c79-ad55-e7b4949a345b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dddf93691844886982c91fea974385d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59391272ecbe48b0aa736cb43807be1d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:57:33.343635 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9724c951-0305-4c79-ad55-e7b4949a345b service neutron] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:57:33.343918 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9724c951-0305-4c79-ad55-e7b4949a345b service neutron] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:57:33.344194 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9724c951-0305-4c79-ad55-e7b4949a345b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:57:33.351170 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9724c951-0305-4c79-ad55-e7b4949a345b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:57:33.352758 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9724c951-0305-4c79-ad55-e7b4949a345b service neutron] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:57:33.360326 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 1281/2550] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jul 14 10:57:33 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:57:33.445200 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a869dac-4205-482c-a052-dc68d9966f1b None None] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:57:33.445501 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a869dac-4205-482c-a052-dc68d9966f1b None None] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:57:33.445788 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a869dac-4205-482c-a052-dc68d9966f1b None None] PATH_INFO: `/` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:57:33.447239 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 1270/2551] 10.222.0.16 () {54 vars in 921 bytes} [Thu Jul 14 10:57:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:57:33.453012 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23eb3e75-340f-46bf-90bb-832017154d2e None None] REQUEST_METHOD: `POST` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:57:33.453378 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23eb3e75-340f-46bf-90bb-832017154d2e None None] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:57:33.453661 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23eb3e75-340f-46bf-90bb-832017154d2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:57:33.472651 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.auth.core [None req-23eb3e75-340f-46bf-90bb-832017154d2e None None] MFA Rules not processed for user `26aa294c913c408499a913ec25bb677d`. Rule list: `[]` (Enabled: `True`). {{(pid=86655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:57:33.474049 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-23eb3e75-340f-46bf-90bb-832017154d2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:57:33.485834 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 1282/2552] 10.222.0.16 () {58 vars in 1018 bytes} [Thu Jul 14 10:57:33 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:57:33.496948 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a869dac-4205-482c-a052-dc68d9966f1b None None] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:57:33.508105 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a869dac-4205-482c-a052-dc68d9966f1b None None] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:57:33.512231 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f10537-ae10-45e2-9a0f-33f2342d8c6b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dddf93691844886982c91fea974385d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59391272ecbe48b0aa736cb43807be1d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:57:33.512920 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f10537-ae10-45e2-9a0f-33f2342d8c6b service neutron] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:57:33.513203 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f10537-ae10-45e2-9a0f-33f2342d8c6b service neutron] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:57:33.513479 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f10537-ae10-45e2-9a0f-33f2342d8c6b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:57:33.523672 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f10537-ae10-45e2-9a0f-33f2342d8c6b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:57:33.525276 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f10537-ae10-45e2-9a0f-33f2342d8c6b service neutron] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:57:33.535776 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 1271/2553] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jul 14 10:57:33 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:57:35.564259 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138f1c96-fd0c-47f5-b7f4-114457bc972b None None] REQUEST_METHOD: `POST` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:57:35.564761 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138f1c96-fd0c-47f5-b7f4-114457bc972b None None] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:57:35.565019 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138f1c96-fd0c-47f5-b7f4-114457bc972b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:57:35.584723 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.auth.core [None req-138f1c96-fd0c-47f5-b7f4-114457bc972b None None] MFA Rules not processed for user `0dfc7cd9c05e4f268d2ce316d531c4bd`. Rule list: `[]` (Enabled: `True`). {{(pid=86655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:57:35.585964 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-138f1c96-fd0c-47f5-b7f4-114457bc972b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:57:35.593790 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 1283/2554] 10.222.0.16 () {58 vars in 1009 bytes} [Thu Jul 14 10:57:35 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:57:35.605671 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f10537-ae10-45e2-9a0f-33f2342d8c6b service neutron] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:57:35.617004 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f10537-ae10-45e2-9a0f-33f2342d8c6b service neutron] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:57:35.621900 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430fe309-9742-45a2-bf0e-db56f3ce2e78 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a23de49b80643eaab7a212f2884d62e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59391272ecbe48b0aa736cb43807be1d', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:57:35.622592 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430fe309-9742-45a2-bf0e-db56f3ce2e78 service swift] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:57:35.622873 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430fe309-9742-45a2-bf0e-db56f3ce2e78 service swift] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:57:35.623148 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430fe309-9742-45a2-bf0e-db56f3ce2e78 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:57:35.631149 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430fe309-9742-45a2-bf0e-db56f3ce2e78 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:57:35.632824 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430fe309-9742-45a2-bf0e-db56f3ce2e78 service swift] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:57:35.641719 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 1272/2555] 10.222.0.16 () {60 vars in 1384 bytes} [Thu Jul 14 10:57:35 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 14 10:57:38.775945 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138f1c96-fd0c-47f5-b7f4-114457bc972b None None] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:57:38.778067 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-138f1c96-fd0c-47f5-b7f4-114457bc972b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:57:38.807297 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138f1c96-fd0c-47f5-b7f4-114457bc972b None None] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:57:38.817214 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba0cca5-8e0c-4218-8a53-0ad05455c213 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:57:38.818485 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba0cca5-8e0c-4218-8a53-0ad05455c213 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:57:38.818942 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba0cca5-8e0c-4218-8a53-0ad05455c213 admin admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:57:38.819244 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba0cca5-8e0c-4218-8a53-0ad05455c213 admin admin] PATH_INFO: `/v3/users/a4034c8b54284229a38afc0c5210bc37` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:57:38.820502 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba0cca5-8e0c-4218-8a53-0ad05455c213 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a4034c8b54284229a38afc0c5210bc37)` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:57:38.823361 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba0cca5-8e0c-4218-8a53-0ad05455c213 admin admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:57:38.870251 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-1ba0cca5-8e0c-4218-8a53-0ad05455c213 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a4034c8b54284229a38afc0c5210bc37'} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:57:38.877808 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-1ba0cca5-8e0c-4218-8a53-0ad05455c213 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a4034c8b54284229a38afc0c5210bc37'} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:57:38.878836 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-1ba0cca5-8e0c-4218-8a53-0ad05455c213 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a4034c8b54284229a38afc0c5210bc37'} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:57:38.888703 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-1ba0cca5-8e0c-4218-8a53-0ad05455c213 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a4034c8b54284229a38afc0c5210bc37'} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:57:38.889850 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-1ba0cca5-8e0c-4218-8a53-0ad05455c213 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a4034c8b54284229a38afc0c5210bc37'} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:57:38.911637 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 1284/2556] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Jul 14 10:57:38 2022] DELETE /identity/v3/users/a4034c8b54284229a38afc0c5210bc37 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:57:39.123128 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430fe309-9742-45a2-bf0e-db56f3ce2e78 service swift] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:57:39.141915 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430fe309-9742-45a2-bf0e-db56f3ce2e78 service swift] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:57:39.237427 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8f6a31-86e2-41e5-919a-13002afc5005 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:57:39.238226 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8f6a31-86e2-41e5-919a-13002afc5005 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:57:39.238513 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8f6a31-86e2-41e5-919a-13002afc5005 admin admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:57:39.238791 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8f6a31-86e2-41e5-919a-13002afc5005 admin admin] PATH_INFO: `/v3/projects/8247d5ed9be94578977f5aefa8b642de` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:57:39.240164 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8f6a31-86e2-41e5-919a-13002afc5005 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8247d5ed9be94578977f5aefa8b642de)` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:57:39.242136 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8f6a31-86e2-41e5-919a-13002afc5005 admin admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:57:39.294311 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-8e8f6a31-86e2-41e5-919a-13002afc5005 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8247d5ed9be94578977f5aefa8b642de', 'request_id': 'req-8e8f6a31-86e2-41e5-919a-13002afc5005'} {{(pid=86656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:57:39.306544 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-8e8f6a31-86e2-41e5-919a-13002afc5005 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8247d5ed9be94578977f5aefa8b642de', 'request_id': 'req-8e8f6a31-86e2-41e5-919a-13002afc5005'} {{(pid=86656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:57:39.326865 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-8e8f6a31-86e2-41e5-919a-13002afc5005 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8247d5ed9be94578977f5aefa8b642de', 'request_id': 'req-8e8f6a31-86e2-41e5-919a-13002afc5005'} {{(pid=86656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:57:39.340669 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-8e8f6a31-86e2-41e5-919a-13002afc5005 admin admin] The token cache is being invalidate because project 8247d5ed9be94578977f5aefa8b642de was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86656) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 10:57:39.341066 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-8e8f6a31-86e2-41e5-919a-13002afc5005 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:57:39.341735 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-8e8f6a31-86e2-41e5-919a-13002afc5005 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:57:39.343569 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 1273/2557] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Jul 14 10:57:39 2022] DELETE /identity/v3/projects/8247d5ed9be94578977f5aefa8b642de => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:57:48.907870 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=44,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:57:49.337182 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=72,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:57:53.216053 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba0cca5-8e0c-4218-8a53-0ad05455c213 admin admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:57:53.217562 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-1ba0cca5-8e0c-4218-8a53-0ad05455c213 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:57:53.277525 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba0cca5-8e0c-4218-8a53-0ad05455c213 admin admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:57:53.329825 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601370f3-55af-483e-a50d-a0f5d07afb67 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dddf93691844886982c91fea974385d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59391272ecbe48b0aa736cb43807be1d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:57:53.330990 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601370f3-55af-483e-a50d-a0f5d07afb67 service neutron] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:57:53.332609 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601370f3-55af-483e-a50d-a0f5d07afb67 service neutron] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:57:53.332609 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601370f3-55af-483e-a50d-a0f5d07afb67 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:57:53.333846 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-601370f3-55af-483e-a50d-a0f5d07afb67 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:57:53.407889 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601370f3-55af-483e-a50d-a0f5d07afb67 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:57:53.409382 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601370f3-55af-483e-a50d-a0f5d07afb67 service neutron] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:57:53.420478 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 1285/2558] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jul 14 10:57:53 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:57:55.809126 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8f6a31-86e2-41e5-919a-13002afc5005 admin admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:57:55.810626 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-8e8f6a31-86e2-41e5-919a-13002afc5005 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:57:55.823573 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8f6a31-86e2-41e5-919a-13002afc5005 admin admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:57:55.827121 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32696054-bc35-4f1f-941e-2ce92dcd4f97 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dddf93691844886982c91fea974385d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59391272ecbe48b0aa736cb43807be1d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:57:55.827765 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32696054-bc35-4f1f-941e-2ce92dcd4f97 service neutron] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:57:55.828047 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32696054-bc35-4f1f-941e-2ce92dcd4f97 service neutron] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:57:55.828324 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32696054-bc35-4f1f-941e-2ce92dcd4f97 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:57:55.830076 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-32696054-bc35-4f1f-941e-2ce92dcd4f97 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:57:55.843673 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32696054-bc35-4f1f-941e-2ce92dcd4f97 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:57:55.845123 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32696054-bc35-4f1f-941e-2ce92dcd4f97 service neutron] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:57:55.855930 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 1274/2559] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jul 14 10:57:55 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:57:56.603642 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826b07e4-c9fe-4630-a4fb-d92fba99f9ea None None] REQUEST_METHOD: `POST` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:57:56.604101 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826b07e4-c9fe-4630-a4fb-d92fba99f9ea None None] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:57:56.604237 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826b07e4-c9fe-4630-a4fb-d92fba99f9ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:57:56.621886 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.auth.core [None req-826b07e4-c9fe-4630-a4fb-d92fba99f9ea None None] MFA Rules not processed for user `0dfc7cd9c05e4f268d2ce316d531c4bd`. Rule list: `[]` (Enabled: `True`). {{(pid=86655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:57:56.623079 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-826b07e4-c9fe-4630-a4fb-d92fba99f9ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:57:56.677338 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 1286/2560] 10.222.0.16 () {58 vars in 967 bytes} [Thu Jul 14 10:57:56 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:57:56.689791 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32696054-bc35-4f1f-941e-2ce92dcd4f97 service neutron] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:57:56.691163 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-32696054-bc35-4f1f-941e-2ce92dcd4f97 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:57:56.757633 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32696054-bc35-4f1f-941e-2ce92dcd4f97 service neutron] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:57:56.762677 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273f6b9d-bd08-4d3e-a616-45f99c71eb49 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a23de49b80643eaab7a212f2884d62e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59391272ecbe48b0aa736cb43807be1d', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:57:56.763314 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273f6b9d-bd08-4d3e-a616-45f99c71eb49 service swift] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:57:56.763603 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273f6b9d-bd08-4d3e-a616-45f99c71eb49 service swift] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:57:56.763879 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273f6b9d-bd08-4d3e-a616-45f99c71eb49 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:57:56.771712 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273f6b9d-bd08-4d3e-a616-45f99c71eb49 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:57:56.773308 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273f6b9d-bd08-4d3e-a616-45f99c71eb49 service swift] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:57:56.784902 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 1275/2561] 10.222.0.16 () {60 vars in 1384 bytes} [Thu Jul 14 10:57:56 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 14 10:58:06.670866 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=99 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:58:06.779859 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=38 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:58:22.211776 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826b07e4-c9fe-4630-a4fb-d92fba99f9ea None None] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:58:22.214210 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-826b07e4-c9fe-4630-a4fb-d92fba99f9ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:58:22.225674 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826b07e4-c9fe-4630-a4fb-d92fba99f9ea None None] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:58:22.229774 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c93d9e4-02ab-4571-a7ff-8dc2b5762ed1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dddf93691844886982c91fea974385d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59391272ecbe48b0aa736cb43807be1d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:58:22.230430 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c93d9e4-02ab-4571-a7ff-8dc2b5762ed1 service neutron] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:58:22.230717 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c93d9e4-02ab-4571-a7ff-8dc2b5762ed1 service neutron] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:58:22.230998 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c93d9e4-02ab-4571-a7ff-8dc2b5762ed1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:58:22.232817 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-1c93d9e4-02ab-4571-a7ff-8dc2b5762ed1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:58:22.243474 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c93d9e4-02ab-4571-a7ff-8dc2b5762ed1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:58:22.245134 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c93d9e4-02ab-4571-a7ff-8dc2b5762ed1 service neutron] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:58:22.253668 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 1287/2562] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jul 14 10:58:22 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:58:28.528722 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273f6b9d-bd08-4d3e-a616-45f99c71eb49 service swift] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:58:28.530154 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-273f6b9d-bd08-4d3e-a616-45f99c71eb49 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:58:28.588626 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273f6b9d-bd08-4d3e-a616-45f99c71eb49 service swift] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:58:28.592301 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ea41fd-72a8-49ae-9911-bde67c9bd928 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68382432147a48c3b62271fd2a2eab04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59391272ecbe48b0aa736cb43807be1d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:58:28.592981 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ea41fd-72a8-49ae-9911-bde67c9bd928 service cinder] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:58:28.593270 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ea41fd-72a8-49ae-9911-bde67c9bd928 service cinder] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:58:28.593602 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ea41fd-72a8-49ae-9911-bde67c9bd928 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:58:28.595434 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-59ea41fd-72a8-49ae-9911-bde67c9bd928 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:58:28.654174 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ea41fd-72a8-49ae-9911-bde67c9bd928 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:58:28.655621 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ea41fd-72a8-49ae-9911-bde67c9bd928 service cinder] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:58:28.664754 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 1276/2563] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jul 14 10:58:28 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:58:32.249828 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=6 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:58:34.816306 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c93d9e4-02ab-4571-a7ff-8dc2b5762ed1 service neutron] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:58:34.819340 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-1c93d9e4-02ab-4571-a7ff-8dc2b5762ed1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:58:34.838966 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c93d9e4-02ab-4571-a7ff-8dc2b5762ed1 service neutron] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:58:34.847650 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e4ca16-ea85-40d6-8b6c-13ebb16057bf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26aa294c913c408499a913ec25bb677d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59391272ecbe48b0aa736cb43807be1d', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:58:34.848419 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e4ca16-ea85-40d6-8b6c-13ebb16057bf service nova] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:58:34.848707 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e4ca16-ea85-40d6-8b6c-13ebb16057bf service nova] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:58:34.849021 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e4ca16-ea85-40d6-8b6c-13ebb16057bf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:58:34.850926 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-99e4ca16-ea85-40d6-8b6c-13ebb16057bf service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:58:34.864538 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e4ca16-ea85-40d6-8b6c-13ebb16057bf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:58:34.866197 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e4ca16-ea85-40d6-8b6c-13ebb16057bf service nova] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:58:34.878994 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 1288/2564] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jul 14 10:58:34 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:58:38.660507 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=48 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:58:44.873865 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=6 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:58:47.301596 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ea41fd-72a8-49ae-9911-bde67c9bd928 service cinder] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:58:47.311673 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ea41fd-72a8-49ae-9911-bde67c9bd928 service cinder] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:58:47.315374 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0d263f-2212-4854-b418-591f4b47f19b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dddf93691844886982c91fea974385d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59391272ecbe48b0aa736cb43807be1d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:58:47.316041 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0d263f-2212-4854-b418-591f4b47f19b service neutron] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:58:47.316323 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0d263f-2212-4854-b418-591f4b47f19b service neutron] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:58:47.316597 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0d263f-2212-4854-b418-591f4b47f19b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:58:47.318716 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-4e0d263f-2212-4854-b418-591f4b47f19b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:58:47.380702 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0d263f-2212-4854-b418-591f4b47f19b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:58:47.382175 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0d263f-2212-4854-b418-591f4b47f19b service neutron] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:58:47.392583 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 1277/2565] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jul 14 10:58:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:58:50.713771 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e4ca16-ea85-40d6-8b6c-13ebb16057bf service nova] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:58:50.715597 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-99e4ca16-ea85-40d6-8b6c-13ebb16057bf service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:58:50.736659 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e4ca16-ea85-40d6-8b6c-13ebb16057bf service nova] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:58:50.741521 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e2beed-93e4-41cf-9c88-4b057d7df68d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:58:50.742440 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e2beed-93e4-41cf-9c88-4b057d7df68d admin admin] REQUEST_METHOD: `DELETE` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:58:50.742735 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e2beed-93e4-41cf-9c88-4b057d7df68d admin admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:58:50.743136 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e2beed-93e4-41cf-9c88-4b057d7df68d admin admin] PATH_INFO: `/v3/users/fae8e5bd232344cca09294651f4cd93e` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:58:50.744384 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e2beed-93e4-41cf-9c88-4b057d7df68d admin admin] RBAC: Authorizing `identity:delete_user(user_id=fae8e5bd232344cca09294651f4cd93e)` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:58:50.746652 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e2beed-93e4-41cf-9c88-4b057d7df68d admin admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:58:50.800845 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-25e2beed-93e4-41cf-9c88-4b057d7df68d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fae8e5bd232344cca09294651f4cd93e'} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:58:50.808735 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-25e2beed-93e4-41cf-9c88-4b057d7df68d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fae8e5bd232344cca09294651f4cd93e'} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:58:50.809532 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-25e2beed-93e4-41cf-9c88-4b057d7df68d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fae8e5bd232344cca09294651f4cd93e'} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:58:50.817188 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-25e2beed-93e4-41cf-9c88-4b057d7df68d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fae8e5bd232344cca09294651f4cd93e'} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:58:50.818095 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-25e2beed-93e4-41cf-9c88-4b057d7df68d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fae8e5bd232344cca09294651f4cd93e'} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:58:50.837105 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 1289/2566] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Jul 14 10:58:50 2022] DELETE /identity/v3/users/fae8e5bd232344cca09294651f4cd93e => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:58:51.019251 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0d263f-2212-4854-b418-591f4b47f19b service neutron] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:58:51.030562 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0d263f-2212-4854-b418-591f4b47f19b service neutron] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:58:51.090927 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1681cf-446a-459f-995f-7d9ac534e2e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:58:51.091791 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1681cf-446a-459f-995f-7d9ac534e2e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:58:51.092077 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1681cf-446a-459f-995f-7d9ac534e2e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:58:51.092357 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1681cf-446a-459f-995f-7d9ac534e2e4 admin admin] PATH_INFO: `/v3/projects/d780859dfe7b4a998388a3af7491e7b8` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:58:51.093575 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1681cf-446a-459f-995f-7d9ac534e2e4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d780859dfe7b4a998388a3af7491e7b8)` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:58:51.095486 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1681cf-446a-459f-995f-7d9ac534e2e4 admin admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:58:51.140978 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-ff1681cf-446a-459f-995f-7d9ac534e2e4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd780859dfe7b4a998388a3af7491e7b8', 'request_id': 'req-ff1681cf-446a-459f-995f-7d9ac534e2e4'} {{(pid=86656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:58:51.148069 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-ff1681cf-446a-459f-995f-7d9ac534e2e4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd780859dfe7b4a998388a3af7491e7b8', 'request_id': 'req-ff1681cf-446a-459f-995f-7d9ac534e2e4'} {{(pid=86656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:58:51.154262 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-ff1681cf-446a-459f-995f-7d9ac534e2e4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd780859dfe7b4a998388a3af7491e7b8', 'request_id': 'req-ff1681cf-446a-459f-995f-7d9ac534e2e4'} {{(pid=86656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:58:51.164156 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-ff1681cf-446a-459f-995f-7d9ac534e2e4 admin admin] The token cache is being invalidate because project d780859dfe7b4a998388a3af7491e7b8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86656) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 10:58:51.164442 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-ff1681cf-446a-459f-995f-7d9ac534e2e4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:58:51.165089 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-ff1681cf-446a-459f-995f-7d9ac534e2e4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:58:51.166615 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 1278/2567] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Jul 14 10:58:51 2022] DELETE /identity/v3/projects/d780859dfe7b4a998388a3af7491e7b8 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:58:51.171558 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb93c15a-2285-4e41-a7cd-ca4ae36caaf7 None None] REQUEST_METHOD: `POST` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:58:51.171852 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb93c15a-2285-4e41-a7cd-ca4ae36caaf7 None None] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:58:51.172139 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb93c15a-2285-4e41-a7cd-ca4ae36caaf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:58:51.190032 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.auth.core [None req-fb93c15a-2285-4e41-a7cd-ca4ae36caaf7 None None] MFA Rules not processed for user `ae4bcdd8106d4bebbdcae96be33505bc`. Rule list: `[]` (Enabled: `True`). {{(pid=86655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:58:51.191318 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-fb93c15a-2285-4e41-a7cd-ca4ae36caaf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:58:51.250696 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 1290/2568] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jul 14 10:58:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:58:51.258939 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1ab5a9-d2d5-4c1f-ba20-8bd31323b016 None None] REQUEST_METHOD: `POST` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:58:51.259230 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1ab5a9-d2d5-4c1f-ba20-8bd31323b016 None None] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:58:51.259510 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1ab5a9-d2d5-4c1f-ba20-8bd31323b016 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:58:51.277493 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.auth.core [None req-1d1ab5a9-d2d5-4c1f-ba20-8bd31323b016 None None] MFA Rules not processed for user `ae4bcdd8106d4bebbdcae96be33505bc`. Rule list: `[]` (Enabled: `True`). {{(pid=86656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:58:51.278638 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-1d1ab5a9-d2d5-4c1f-ba20-8bd31323b016 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:58:51.286502 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 1279/2569] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jul 14 10:58:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:58:51.290550 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb93c15a-2285-4e41-a7cd-ca4ae36caaf7 None None] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:58:51.300124 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb93c15a-2285-4e41-a7cd-ca4ae36caaf7 None None] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:58:51.305331 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ea829c-4277-4c74-aef9-d55a474955b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:58:51.305998 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ea829c-4277-4c74-aef9-d55a474955b4 admin admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:58:51.306288 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ea829c-4277-4c74-aef9-d55a474955b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:58:51.306570 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ea829c-4277-4c74-aef9-d55a474955b4 admin admin] PATH_INFO: `/v3/domains` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:58:51.307349 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ea829c-4277-4c74-aef9-d55a474955b4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 10:58:51.307662 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ea829c-4277-4c74-aef9-d55a474955b4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:58:51.309307 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ea829c-4277-4c74-aef9-d55a474955b4 admin admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:58:51.321748 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 1291/2570] 10.222.0.16 () {58 vars in 1152 bytes} [Thu Jul 14 10:58:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 10:58:51.325752 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1ab5a9-d2d5-4c1f-ba20-8bd31323b016 None None] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:58:51.334898 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1ab5a9-d2d5-4c1f-ba20-8bd31323b016 None None] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:58:51.339638 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16094ed0-c4a0-4d2c-9924-7cf2314c4f7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:58:51.340286 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16094ed0-c4a0-4d2c-9924-7cf2314c4f7e admin admin] REQUEST_METHOD: `POST` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:58:51.340569 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16094ed0-c4a0-4d2c-9924-7cf2314c4f7e admin admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:58:51.340882 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16094ed0-c4a0-4d2c-9924-7cf2314c4f7e admin admin] PATH_INFO: `/v3/projects` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:58:51.341576 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16094ed0-c4a0-4d2c-9924-7cf2314c4f7e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:58:51.343461 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16094ed0-c4a0-4d2c-9924-7cf2314c4f7e admin admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:58:51.357116 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:58:51.371555 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 1280/2571] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Jul 14 10:58:51 2022] POST /identity/v3/projects => generated 383 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 10:58:51.375653 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ea829c-4277-4c74-aef9-d55a474955b4 admin admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:58:51.386443 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ea829c-4277-4c74-aef9-d55a474955b4 admin admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:58:51.442303 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9deddec8-1de6-4b20-a9a3-9702afb8424f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:58:51.443234 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9deddec8-1de6-4b20-a9a3-9702afb8424f admin admin] REQUEST_METHOD: `POST` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:58:51.443521 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9deddec8-1de6-4b20-a9a3-9702afb8424f admin admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:58:51.443800 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9deddec8-1de6-4b20-a9a3-9702afb8424f admin admin] PATH_INFO: `/v3/users` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:58:51.444503 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9deddec8-1de6-4b20-a9a3-9702afb8424f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:58:51.446635 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9deddec8-1de6-4b20-a9a3-9702afb8424f admin admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:58:51.453155 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:58:51.467310 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 1292/2572] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Jul 14 10:58:51 2022] POST /identity/v3/users => generated 292 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 10:58:51.471372 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16094ed0-c4a0-4d2c-9924-7cf2314c4f7e admin admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:58:51.482114 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16094ed0-c4a0-4d2c-9924-7cf2314c4f7e admin admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:58:51.486649 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8f588f-74be-4f93-b4b3-99e556a08d75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:58:51.487303 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8f588f-74be-4f93-b4b3-99e556a08d75 admin admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:58:51.487586 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8f588f-74be-4f93-b4b3-99e556a08d75 admin admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:58:51.487862 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8f588f-74be-4f93-b4b3-99e556a08d75 admin admin] PATH_INFO: `/v3/roles` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:58:51.488582 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8f588f-74be-4f93-b4b3-99e556a08d75 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:58:51.490214 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8f588f-74be-4f93-b4b3-99e556a08d75 admin admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:58:51.501093 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 1281/2573] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jul 14 10:58:51 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:58:51.504844 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9deddec8-1de6-4b20-a9a3-9702afb8424f admin admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:58:51.514892 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9deddec8-1de6-4b20-a9a3-9702afb8424f admin admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:58:51.519457 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646336e3-4544-4ca4-861f-e4603f981c00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:58:51.520112 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646336e3-4544-4ca4-861f-e4603f981c00 admin admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:58:51.520406 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646336e3-4544-4ca4-861f-e4603f981c00 admin admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:58:51.520688 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646336e3-4544-4ca4-861f-e4603f981c00 admin admin] PATH_INFO: `/v3/roles` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:58:51.521464 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646336e3-4544-4ca4-861f-e4603f981c00 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:58:51.523055 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646336e3-4544-4ca4-861f-e4603f981c00 admin admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:58:51.532939 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 1293/2574] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jul 14 10:58:51 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 10:58:51.536969 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8f588f-74be-4f93-b4b3-99e556a08d75 admin admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:58:51.547575 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8f588f-74be-4f93-b4b3-99e556a08d75 admin admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:58:51.552109 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3300877d-539a-4f9d-886a-8f11ee349e6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:58:51.553035 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3300877d-539a-4f9d-886a-8f11ee349e6c admin admin] REQUEST_METHOD: `PUT` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:58:51.553318 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3300877d-539a-4f9d-886a-8f11ee349e6c admin admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:58:51.553592 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3300877d-539a-4f9d-886a-8f11ee349e6c admin admin] PATH_INFO: `/v3/projects/56309a04e27d451eaa484f3210966b57/users/4d715ce7c98042adb432112376afe023/roles/0da46c267d354cce81495dfdd56c1ec2` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:58:51.569206 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3300877d-539a-4f9d-886a-8f11ee349e6c admin admin] RBAC: Authorizing `identity:create_grant(project_id=56309a04e27d451eaa484f3210966b57, user_id=4d715ce7c98042adb432112376afe023, role_id=0da46c267d354cce81495dfdd56c1ec2)` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:58:51.572067 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3300877d-539a-4f9d-886a-8f11ee349e6c admin admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:58:51.585479 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 1282/2575] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Jul 14 10:58:51 2022] PUT /identity/v3/projects/56309a04e27d451eaa484f3210966b57/users/4d715ce7c98042adb432112376afe023/roles/0da46c267d354cce81495dfdd56c1ec2 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 10:58:51.590753 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a1fc59-de46-4ddb-b915-2d2b1367d142 None None] REQUEST_METHOD: `POST` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:58:51.591050 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a1fc59-de46-4ddb-b915-2d2b1367d142 None None] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:58:51.591329 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a1fc59-de46-4ddb-b915-2d2b1367d142 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:58:51.609254 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.auth.core [None req-e0a1fc59-de46-4ddb-b915-2d2b1367d142 None None] MFA Rules not processed for user `ae4bcdd8106d4bebbdcae96be33505bc`. Rule list: `[]` (Enabled: `True`). {{(pid=86655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:58:51.610448 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-e0a1fc59-de46-4ddb-b915-2d2b1367d142 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:58:51.669105 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 1294/2576] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jul 14 10:58:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 10:58:51.678596 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3300877d-539a-4f9d-886a-8f11ee349e6c admin admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:58:51.681500 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-3300877d-539a-4f9d-886a-8f11ee349e6c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:58:51.739673 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3300877d-539a-4f9d-886a-8f11ee349e6c admin admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:58:51.744307 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ba10cc-ec34-4b04-b454-984e99bff7f2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dddf93691844886982c91fea974385d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59391272ecbe48b0aa736cb43807be1d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:58:51.744987 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ba10cc-ec34-4b04-b454-984e99bff7f2 service neutron] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:58:51.745278 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ba10cc-ec34-4b04-b454-984e99bff7f2 service neutron] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:58:51.745560 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ba10cc-ec34-4b04-b454-984e99bff7f2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:58:51.754638 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ba10cc-ec34-4b04-b454-984e99bff7f2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:58:51.756066 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ba10cc-ec34-4b04-b454-984e99bff7f2 service neutron] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:58:51.765984 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 1283/2577] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jul 14 10:58:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:58:55.831802 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cd96ba-4501-417b-9f04-ac091a5538a4 None None] REQUEST_METHOD: `POST` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:58:55.832299 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cd96ba-4501-417b-9f04-ac091a5538a4 None None] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:58:55.832417 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cd96ba-4501-417b-9f04-ac091a5538a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:58:55.861432 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.auth.core [None req-72cd96ba-4501-417b-9f04-ac091a5538a4 None None] MFA Rules not processed for user `4d715ce7c98042adb432112376afe023`. Rule list: `[]` (Enabled: `True`). {{(pid=86655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:58:55.862648 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-72cd96ba-4501-417b-9f04-ac091a5538a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:58:55.936654 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 1295/2578] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jul 14 10:58:55 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:58:55.951009 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ba10cc-ec34-4b04-b454-984e99bff7f2 service neutron] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:58:55.952447 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-32ba10cc-ec34-4b04-b454-984e99bff7f2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:58:56.042029 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ba10cc-ec34-4b04-b454-984e99bff7f2 service neutron] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:58:56.051627 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98341c14-19ed-4175-aa88-5d11e69c9576 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26aa294c913c408499a913ec25bb677d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59391272ecbe48b0aa736cb43807be1d', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:58:56.052310 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98341c14-19ed-4175-aa88-5d11e69c9576 service nova] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:58:56.052608 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98341c14-19ed-4175-aa88-5d11e69c9576 service nova] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:58:56.052979 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98341c14-19ed-4175-aa88-5d11e69c9576 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:58:56.062279 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98341c14-19ed-4175-aa88-5d11e69c9576 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:58:56.063861 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98341c14-19ed-4175-aa88-5d11e69c9576 service nova] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:58:56.073104 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 1284/2579] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jul 14 10:58:55 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:58:57.483798 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2abaf9-9dd6-4b18-827a-05adc9512828 None None] REQUEST_METHOD: `POST` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:58:57.484315 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2abaf9-9dd6-4b18-827a-05adc9512828 None None] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:58:57.484408 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2abaf9-9dd6-4b18-827a-05adc9512828 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:58:57.502935 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.auth.core [None req-fb2abaf9-9dd6-4b18-827a-05adc9512828 None None] MFA Rules not processed for user `4d715ce7c98042adb432112376afe023`. Rule list: `[]` (Enabled: `True`). {{(pid=86655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:58:57.504065 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-fb2abaf9-9dd6-4b18-827a-05adc9512828 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:58:57.511680 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 1296/2580] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jul 14 10:58:57 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:58:57.842397 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98341c14-19ed-4175-aa88-5d11e69c9576 service nova] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:58:57.843850 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-98341c14-19ed-4175-aa88-5d11e69c9576 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:58:57.857168 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98341c14-19ed-4175-aa88-5d11e69c9576 service nova] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:58:57.861613 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7f4491-da62-4b47-a19c-c7ce7e42c291 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dddf93691844886982c91fea974385d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59391272ecbe48b0aa736cb43807be1d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:58:57.862280 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7f4491-da62-4b47-a19c-c7ce7e42c291 service neutron] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:58:57.863063 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7f4491-da62-4b47-a19c-c7ce7e42c291 service neutron] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:58:57.863063 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7f4491-da62-4b47-a19c-c7ce7e42c291 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:58:57.865001 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-0c7f4491-da62-4b47-a19c-c7ce7e42c291 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:58:57.876726 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7f4491-da62-4b47-a19c-c7ce7e42c291 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:58:57.878190 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7f4491-da62-4b47-a19c-c7ce7e42c291 service neutron] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:58:57.887290 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 1285/2581] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jul 14 10:58:57 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:58:58.234629 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2abaf9-9dd6-4b18-827a-05adc9512828 None None] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:58:58.236081 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-fb2abaf9-9dd6-4b18-827a-05adc9512828 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:58:58.337790 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:58:58.342777 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2abaf9-9dd6-4b18-827a-05adc9512828 None None] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:58:58.349178 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d3800a-467f-43f8-9028-d291ff7daaf6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16846111ee2a42dd99c3052d40980f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59391272ecbe48b0aa736cb43807be1d', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:58:58.349846 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d3800a-467f-43f8-9028-d291ff7daaf6 service placement] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:58:58.350140 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d3800a-467f-43f8-9028-d291ff7daaf6 service placement] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:58:58.350425 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d3800a-467f-43f8-9028-d291ff7daaf6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:58:58.353565 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-a2d3800a-467f-43f8-9028-d291ff7daaf6 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:58:58.366414 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d3800a-467f-43f8-9028-d291ff7daaf6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:58:58.369079 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d3800a-467f-43f8-9028-d291ff7daaf6 service placement] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:58:58.381761 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 1297/2582] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jul 14 10:58:58 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:59:03.125881 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4855800-3c7f-4296-86e8-760c2f6903ce None None] REQUEST_METHOD: `POST` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:59:03.126371 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4855800-3c7f-4296-86e8-760c2f6903ce None None] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:59:03.126467 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4855800-3c7f-4296-86e8-760c2f6903ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:59:03.143736 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.auth.core [None req-d4855800-3c7f-4296-86e8-760c2f6903ce None None] MFA Rules not processed for user `9bf1e116dda742559eed6d9c25f1ff47`. Rule list: `[]` (Enabled: `True`). {{(pid=86656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:59:03.144984 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-d4855800-3c7f-4296-86e8-760c2f6903ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:59:03.176499 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:59:03.203421 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 1286/2583] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jul 14 10:59:03 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:59:06.009348 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d3800a-467f-43f8-9028-d291ff7daaf6 service placement] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:59:06.023783 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d3800a-467f-43f8-9028-d291ff7daaf6 service placement] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:59:06.029302 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b30d93e-15c0-422d-80e9-4d52b2f6c2f1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26aa294c913c408499a913ec25bb677d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59391272ecbe48b0aa736cb43807be1d', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:59:06.029950 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b30d93e-15c0-422d-80e9-4d52b2f6c2f1 service nova] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:59:06.030230 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b30d93e-15c0-422d-80e9-4d52b2f6c2f1 service nova] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:59:06.030507 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b30d93e-15c0-422d-80e9-4d52b2f6c2f1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:59:06.032303 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-7b30d93e-15c0-422d-80e9-4d52b2f6c2f1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:59:06.045896 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b30d93e-15c0-422d-80e9-4d52b2f6c2f1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:59:06.047653 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b30d93e-15c0-422d-80e9-4d52b2f6c2f1 service nova] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:59:06.057497 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 1298/2584] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jul 14 10:59:06 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:59:07.944443 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4855800-3c7f-4296-86e8-760c2f6903ce None None] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:59:07.963660 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4855800-3c7f-4296-86e8-760c2f6903ce None None] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:59:07.971991 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4010c0-6ba8-47be-8d7d-724471e92129 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26aa294c913c408499a913ec25bb677d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59391272ecbe48b0aa736cb43807be1d', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:59:07.973991 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4010c0-6ba8-47be-8d7d-724471e92129 service nova] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:59:07.974430 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4010c0-6ba8-47be-8d7d-724471e92129 service nova] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:59:07.975259 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4010c0-6ba8-47be-8d7d-724471e92129 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:59:07.977715 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-be4010c0-6ba8-47be-8d7d-724471e92129 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:59:07.998779 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4010c0-6ba8-47be-8d7d-724471e92129 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:59:08.000632 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4010c0-6ba8-47be-8d7d-724471e92129 service nova] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:59:08.013160 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 1287/2585] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jul 14 10:59:07 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:59:08.318406 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b30d93e-15c0-422d-80e9-4d52b2f6c2f1 service nova] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:59:08.321153 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-7b30d93e-15c0-422d-80e9-4d52b2f6c2f1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:59:08.343172 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b30d93e-15c0-422d-80e9-4d52b2f6c2f1 service nova] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:59:08.350308 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b9bafb-3ec8-4917-88e5-e2c1df07cc74 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26aa294c913c408499a913ec25bb677d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59391272ecbe48b0aa736cb43807be1d', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:59:08.352025 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b9bafb-3ec8-4917-88e5-e2c1df07cc74 service nova] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:59:08.352662 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b9bafb-3ec8-4917-88e5-e2c1df07cc74 service nova] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:59:08.352980 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b9bafb-3ec8-4917-88e5-e2c1df07cc74 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:59:08.357984 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-d9b9bafb-3ec8-4917-88e5-e2c1df07cc74 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:59:08.371700 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b9bafb-3ec8-4917-88e5-e2c1df07cc74 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:59:08.373746 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b9bafb-3ec8-4917-88e5-e2c1df07cc74 service nova] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:59:08.387924 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 1299/2586] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jul 14 10:59:08 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:59:08.963270 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb72928-4756-4886-bcc3-6d9c7c4c84b4 None None] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:59:08.963865 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb72928-4756-4886-bcc3-6d9c7c4c84b4 None None] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:59:08.963865 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb72928-4756-4886-bcc3-6d9c7c4c84b4 None None] PATH_INFO: `/` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:59:08.965374 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 1288/2587] 10.222.0.16 () {54 vars in 921 bytes} [Thu Jul 14 10:59:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:59:08.973088 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cf7100-0119-453c-b19b-e14ef2513739 None None] REQUEST_METHOD: `POST` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:59:08.973383 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cf7100-0119-453c-b19b-e14ef2513739 None None] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:59:08.973952 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cf7100-0119-453c-b19b-e14ef2513739 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:59:08.994049 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.auth.core [None req-c3cf7100-0119-453c-b19b-e14ef2513739 None None] MFA Rules not processed for user `4dddf93691844886982c91fea974385d`. Rule list: `[]` (Enabled: `True`). {{(pid=86655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:59:08.995849 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-c3cf7100-0119-453c-b19b-e14ef2513739 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:59:09.002965 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 1300/2588] 10.222.0.16 () {58 vars in 1018 bytes} [Thu Jul 14 10:59:08 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:59:09.036809 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb72928-4756-4886-bcc3-6d9c7c4c84b4 None None] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:59:09.049287 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb72928-4756-4886-bcc3-6d9c7c4c84b4 None None] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:59:09.052922 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f8536d-b3bc-434e-aaac-0cb03cecddbf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dddf93691844886982c91fea974385d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59391272ecbe48b0aa736cb43807be1d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:59:09.053585 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f8536d-b3bc-434e-aaac-0cb03cecddbf service neutron] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:59:09.053875 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f8536d-b3bc-434e-aaac-0cb03cecddbf service neutron] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:59:09.054694 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f8536d-b3bc-434e-aaac-0cb03cecddbf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:59:09.063618 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f8536d-b3bc-434e-aaac-0cb03cecddbf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:59:09.065026 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f8536d-b3bc-434e-aaac-0cb03cecddbf service neutron] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:59:09.074661 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 1289/2589] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jul 14 10:59:09 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:59:09.185422 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04da3bd0-0d7b-4b9f-bfbe-f51a5c9bc478 None None] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:59:09.185710 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04da3bd0-0d7b-4b9f-bfbe-f51a5c9bc478 None None] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:59:09.185988 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04da3bd0-0d7b-4b9f-bfbe-f51a5c9bc478 None None] PATH_INFO: `/` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:59:09.187393 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 1301/2590] 10.222.0.16 () {54 vars in 921 bytes} [Thu Jul 14 10:59:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 10:59:09.193006 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8f3e05-34be-4e55-b1cc-e0cdbabdddea None None] REQUEST_METHOD: `POST` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:59:09.193302 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8f3e05-34be-4e55-b1cc-e0cdbabdddea None None] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:59:09.193588 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8f3e05-34be-4e55-b1cc-e0cdbabdddea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:59:09.213591 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.auth.core [None req-cf8f3e05-34be-4e55-b1cc-e0cdbabdddea None None] MFA Rules not processed for user `26aa294c913c408499a913ec25bb677d`. Rule list: `[]` (Enabled: `True`). {{(pid=86656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:59:09.214807 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-cf8f3e05-34be-4e55-b1cc-e0cdbabdddea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:59:09.223966 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 1290/2591] 10.222.0.16 () {58 vars in 1018 bytes} [Thu Jul 14 10:59:09 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:59:09.234625 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04da3bd0-0d7b-4b9f-bfbe-f51a5c9bc478 None None] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:59:09.245998 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04da3bd0-0d7b-4b9f-bfbe-f51a5c9bc478 None None] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:59:09.249485 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35665911-0dc0-49ad-ad78-2921801aa75e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dddf93691844886982c91fea974385d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59391272ecbe48b0aa736cb43807be1d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:59:09.250118 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35665911-0dc0-49ad-ad78-2921801aa75e service neutron] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:59:09.250399 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35665911-0dc0-49ad-ad78-2921801aa75e service neutron] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:59:09.250672 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35665911-0dc0-49ad-ad78-2921801aa75e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:59:09.261866 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35665911-0dc0-49ad-ad78-2921801aa75e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:59:09.263333 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35665911-0dc0-49ad-ad78-2921801aa75e service neutron] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:59:09.274680 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 1302/2592] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jul 14 10:59:09 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:59:19.208764 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=24 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:59:19.269730 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=25 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:59:51.873449 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e11b9e0-dc87-4cab-8d8a-a2a413b11766 None None] REQUEST_METHOD: `POST` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:59:51.873911 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e11b9e0-dc87-4cab-8d8a-a2a413b11766 None None] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:59:51.874013 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e11b9e0-dc87-4cab-8d8a-a2a413b11766 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:59:51.891898 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.auth.core [None req-8e11b9e0-dc87-4cab-8d8a-a2a413b11766 None None] MFA Rules not processed for user `0dfc7cd9c05e4f268d2ce316d531c4bd`. Rule list: `[]` (Enabled: `True`). {{(pid=86656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 10:59:51.893149 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-8e11b9e0-dc87-4cab-8d8a-a2a413b11766 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:59:51.947614 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 1291/2593] 10.222.0.16 () {58 vars in 967 bytes} [Thu Jul 14 10:59:51 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 10:59:51.995837 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35665911-0dc0-49ad-ad78-2921801aa75e service neutron] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:59:51.997290 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-35665911-0dc0-49ad-ad78-2921801aa75e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:59:52.066436 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35665911-0dc0-49ad-ad78-2921801aa75e service neutron] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:59:52.072751 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a294c0b-124b-4208-8b21-e7a857669a25 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a23de49b80643eaab7a212f2884d62e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59391272ecbe48b0aa736cb43807be1d', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:59:52.073443 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a294c0b-124b-4208-8b21-e7a857669a25 service swift] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:59:52.073734 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a294c0b-124b-4208-8b21-e7a857669a25 service swift] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:59:52.074014 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a294c0b-124b-4208-8b21-e7a857669a25 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:59:52.084464 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a294c0b-124b-4208-8b21-e7a857669a25 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:59:52.086351 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a294c0b-124b-4208-8b21-e7a857669a25 service swift] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:59:52.094598 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 1303/2594] 10.222.0.16 () {60 vars in 1384 bytes} [Thu Jul 14 10:59:51 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 14 10:59:55.622789 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e11b9e0-dc87-4cab-8d8a-a2a413b11766 None None] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:59:55.636436 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e11b9e0-dc87-4cab-8d8a-a2a413b11766 None None] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:59:55.642303 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce2b2d6-afba-499a-b476-efb995b1aa33 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16846111ee2a42dd99c3052d40980f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59391272ecbe48b0aa736cb43807be1d', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:59:55.642962 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce2b2d6-afba-499a-b476-efb995b1aa33 service placement] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:59:55.643247 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce2b2d6-afba-499a-b476-efb995b1aa33 service placement] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:59:55.643528 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce2b2d6-afba-499a-b476-efb995b1aa33 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:59:55.645920 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-bce2b2d6-afba-499a-b476-efb995b1aa33 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:59:55.661160 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce2b2d6-afba-499a-b476-efb995b1aa33 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:59:55.662799 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce2b2d6-afba-499a-b476-efb995b1aa33 service placement] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:59:55.679867 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 1292/2595] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jul 14 10:59:55 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 10:59:58.773660 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a294c0b-124b-4208-8b21-e7a857669a25 service swift] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:59:58.775717 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-6a294c0b-124b-4208-8b21-e7a857669a25 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:59:58.801826 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a294c0b-124b-4208-8b21-e7a857669a25 service swift] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:59:58.809799 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de7d732-2190-4929-98b8-066ec195ba1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:59:58.809799 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de7d732-2190-4929-98b8-066ec195ba1b admin admin] REQUEST_METHOD: `DELETE` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:59:58.809799 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de7d732-2190-4929-98b8-066ec195ba1b admin admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:59:58.809799 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de7d732-2190-4929-98b8-066ec195ba1b admin admin] PATH_INFO: `/v3/users/1492156ccead49928ef9fbf3d9f9581b` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:59:58.810553 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de7d732-2190-4929-98b8-066ec195ba1b admin admin] RBAC: Authorizing `identity:delete_user(user_id=1492156ccead49928ef9fbf3d9f9581b)` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:59:58.812256 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de7d732-2190-4929-98b8-066ec195ba1b admin admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:59:58.861005 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-3de7d732-2190-4929-98b8-066ec195ba1b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1492156ccead49928ef9fbf3d9f9581b'} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:59:58.868371 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-3de7d732-2190-4929-98b8-066ec195ba1b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1492156ccead49928ef9fbf3d9f9581b'} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:59:58.869023 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-3de7d732-2190-4929-98b8-066ec195ba1b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1492156ccead49928ef9fbf3d9f9581b'} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:59:58.875879 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-3de7d732-2190-4929-98b8-066ec195ba1b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1492156ccead49928ef9fbf3d9f9581b'} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:59:58.876505 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-3de7d732-2190-4929-98b8-066ec195ba1b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1492156ccead49928ef9fbf3d9f9581b'} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:59:58.893873 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 1304/2596] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Jul 14 10:59:58 2022] DELETE /identity/v3/users/1492156ccead49928ef9fbf3d9f9581b => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:59:59.066100 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce2b2d6-afba-499a-b476-efb995b1aa33 service placement] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:59:59.076941 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce2b2d6-afba-499a-b476-efb995b1aa33 service placement] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:59:59.135111 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de6bb65-b096-4317-bb7c-10f0334f33f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:59:59.135966 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de6bb65-b096-4317-bb7c-10f0334f33f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:59:59.136248 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de6bb65-b096-4317-bb7c-10f0334f33f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:59:59.136521 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de6bb65-b096-4317-bb7c-10f0334f33f2 admin admin] PATH_INFO: `/v3/projects/a65ee1a2d63048f49e7884da3bba012e` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:59:59.137735 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de6bb65-b096-4317-bb7c-10f0334f33f2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a65ee1a2d63048f49e7884da3bba012e)` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:59:59.139632 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de6bb65-b096-4317-bb7c-10f0334f33f2 admin admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:59:59.185481 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-1de6bb65-b096-4317-bb7c-10f0334f33f2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a65ee1a2d63048f49e7884da3bba012e', 'request_id': 'req-1de6bb65-b096-4317-bb7c-10f0334f33f2'} {{(pid=86656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:59:59.192759 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-1de6bb65-b096-4317-bb7c-10f0334f33f2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a65ee1a2d63048f49e7884da3bba012e', 'request_id': 'req-1de6bb65-b096-4317-bb7c-10f0334f33f2'} {{(pid=86656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:59:59.199042 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-1de6bb65-b096-4317-bb7c-10f0334f33f2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a65ee1a2d63048f49e7884da3bba012e', 'request_id': 'req-1de6bb65-b096-4317-bb7c-10f0334f33f2'} {{(pid=86656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:59:59.208911 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-1de6bb65-b096-4317-bb7c-10f0334f33f2 admin admin] The token cache is being invalidate because project a65ee1a2d63048f49e7884da3bba012e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86656) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 10:59:59.209195 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-1de6bb65-b096-4317-bb7c-10f0334f33f2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:59:59.209907 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-1de6bb65-b096-4317-bb7c-10f0334f33f2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:59:59.211415 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 1293/2597] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Jul 14 10:59:59 2022] DELETE /identity/v3/projects/a65ee1a2d63048f49e7884da3bba012e => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:59:59.215350 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de7d732-2190-4929-98b8-066ec195ba1b admin admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:59:59.216872 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-3de7d732-2190-4929-98b8-066ec195ba1b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:59:59.230581 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de7d732-2190-4929-98b8-066ec195ba1b admin admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:59:59.286202 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e9b875-6a0b-43bf-b671-1eff4c8e5ab5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:59:59.287005 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e9b875-6a0b-43bf-b671-1eff4c8e5ab5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:59:59.287282 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e9b875-6a0b-43bf-b671-1eff4c8e5ab5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:59:59.287552 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e9b875-6a0b-43bf-b671-1eff4c8e5ab5 admin admin] PATH_INFO: `/v3/users/2f907157cd2a49619d538f0c25d83f7e` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:59:59.289597 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e9b875-6a0b-43bf-b671-1eff4c8e5ab5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2f907157cd2a49619d538f0c25d83f7e)` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:59:59.291494 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e9b875-6a0b-43bf-b671-1eff4c8e5ab5 admin admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:59:59.293777 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:59:59.339609 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-c7e9b875-6a0b-43bf-b671-1eff4c8e5ab5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2f907157cd2a49619d538f0c25d83f7e'} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:59:59.346397 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-c7e9b875-6a0b-43bf-b671-1eff4c8e5ab5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2f907157cd2a49619d538f0c25d83f7e'} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:59:59.347066 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-c7e9b875-6a0b-43bf-b671-1eff4c8e5ab5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2f907157cd2a49619d538f0c25d83f7e'} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:59:59.354539 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-c7e9b875-6a0b-43bf-b671-1eff4c8e5ab5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2f907157cd2a49619d538f0c25d83f7e'} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:59:59.355170 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-c7e9b875-6a0b-43bf-b671-1eff4c8e5ab5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2f907157cd2a49619d538f0c25d83f7e'} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:59:59.372601 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 1305/2598] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Jul 14 10:59:59 2022] DELETE /identity/v3/users/2f907157cd2a49619d538f0c25d83f7e => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 10:59:59.541712 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de6bb65-b096-4317-bb7c-10f0334f33f2 admin admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 10:59:59.543160 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-1de6bb65-b096-4317-bb7c-10f0334f33f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 10:59:59.559352 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de6bb65-b096-4317-bb7c-10f0334f33f2 admin admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 10:59:59.579713 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:59:59.620250 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72e3392-34fe-4b45-a56a-0a248145a98d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 10:59:59.621151 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72e3392-34fe-4b45-a56a-0a248145a98d admin admin] REQUEST_METHOD: `DELETE` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 10:59:59.621439 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72e3392-34fe-4b45-a56a-0a248145a98d admin admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 10:59:59.621718 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72e3392-34fe-4b45-a56a-0a248145a98d admin admin] PATH_INFO: `/v3/projects/44a6f7e232e342d7bcdbb4507f508ac7` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 10:59:59.622908 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72e3392-34fe-4b45-a56a-0a248145a98d admin admin] RBAC: Authorizing `identity:delete_project(project_id=44a6f7e232e342d7bcdbb4507f508ac7)` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 10:59:59.624850 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72e3392-34fe-4b45-a56a-0a248145a98d admin admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 10:59:59.669769 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-c72e3392-34fe-4b45-a56a-0a248145a98d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '44a6f7e232e342d7bcdbb4507f508ac7', 'request_id': 'req-c72e3392-34fe-4b45-a56a-0a248145a98d'} {{(pid=86656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:59:59.676763 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-c72e3392-34fe-4b45-a56a-0a248145a98d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '44a6f7e232e342d7bcdbb4507f508ac7', 'request_id': 'req-c72e3392-34fe-4b45-a56a-0a248145a98d'} {{(pid=86656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:59:59.683492 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-c72e3392-34fe-4b45-a56a-0a248145a98d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '44a6f7e232e342d7bcdbb4507f508ac7', 'request_id': 'req-c72e3392-34fe-4b45-a56a-0a248145a98d'} {{(pid=86656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:59:59.693967 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-c72e3392-34fe-4b45-a56a-0a248145a98d admin admin] The token cache is being invalidate because project 44a6f7e232e342d7bcdbb4507f508ac7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86656) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 10:59:59.694258 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-c72e3392-34fe-4b45-a56a-0a248145a98d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:59:59.694894 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-c72e3392-34fe-4b45-a56a-0a248145a98d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 10:59:59.696417 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 1294/2599] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Jul 14 10:59:59 2022] DELETE /identity/v3/projects/44a6f7e232e342d7bcdbb4507f508ac7 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:00:09.369125 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=25,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:00:09.690826 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=41,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:00:37.783982 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07836c09-e431-49f0-a036-41b4537e026d None None] REQUEST_METHOD: `POST` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:00:37.784402 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07836c09-e431-49f0-a036-41b4537e026d None None] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:00:37.784554 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07836c09-e431-49f0-a036-41b4537e026d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:00:37.803126 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.auth.core [None req-07836c09-e431-49f0-a036-41b4537e026d None None] MFA Rules not processed for user `4d715ce7c98042adb432112376afe023`. Rule list: `[]` (Enabled: `True`). {{(pid=86655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:00:37.804969 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-07836c09-e431-49f0-a036-41b4537e026d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:00:37.860490 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 1306/2600] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jul 14 11:00:37 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:00:38.167380 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72e3392-34fe-4b45-a56a-0a248145a98d admin admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:00:38.168906 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-c72e3392-34fe-4b45-a56a-0a248145a98d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:00:38.226178 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72e3392-34fe-4b45-a56a-0a248145a98d admin admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:00:38.229684 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a8e943-3b90-493b-9a73-92c898a019d8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dddf93691844886982c91fea974385d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59391272ecbe48b0aa736cb43807be1d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:00:38.230326 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a8e943-3b90-493b-9a73-92c898a019d8 service neutron] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:00:38.230617 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a8e943-3b90-493b-9a73-92c898a019d8 service neutron] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:00:38.230892 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a8e943-3b90-493b-9a73-92c898a019d8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:00:38.232632 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-97a8e943-3b90-493b-9a73-92c898a019d8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:00:38.241918 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a8e943-3b90-493b-9a73-92c898a019d8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:00:38.243329 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a8e943-3b90-493b-9a73-92c898a019d8 service neutron] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:00:38.251086 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 1295/2601] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jul 14 11:00:38 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 11:00:47.853874 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=25 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:00:48.247563 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=26 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:00:52.846579 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07836c09-e431-49f0-a036-41b4537e026d None None] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:00:52.848189 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-07836c09-e431-49f0-a036-41b4537e026d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:00:53.014910 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07836c09-e431-49f0-a036-41b4537e026d None None] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:00:53.020102 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9d98ec-25d4-4253-823f-1a2866102736 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16846111ee2a42dd99c3052d40980f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59391272ecbe48b0aa736cb43807be1d', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:00:53.020852 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9d98ec-25d4-4253-823f-1a2866102736 service placement] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:00:53.021151 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9d98ec-25d4-4253-823f-1a2866102736 service placement] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:00:53.021436 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9d98ec-25d4-4253-823f-1a2866102736 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:00:53.024110 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-ae9d98ec-25d4-4253-823f-1a2866102736 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:00:53.042467 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9d98ec-25d4-4253-823f-1a2866102736 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:00:53.045159 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9d98ec-25d4-4253-823f-1a2866102736 service placement] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:00:53.062870 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 1307/2602] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jul 14 11:00:52 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 11:01:01.522372 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b925ce15-0390-4700-a75a-6817f2af9e0d None None] REQUEST_METHOD: `POST` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:01:01.522846 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b925ce15-0390-4700-a75a-6817f2af9e0d None None] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:01:01.523025 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b925ce15-0390-4700-a75a-6817f2af9e0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:01:01.550662 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.auth.core [None req-b925ce15-0390-4700-a75a-6817f2af9e0d None None] MFA Rules not processed for user `0dfc7cd9c05e4f268d2ce316d531c4bd`. Rule list: `[]` (Enabled: `True`). {{(pid=86656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:01:01.551939 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-b925ce15-0390-4700-a75a-6817f2af9e0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:01:01.614973 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 1296/2603] 10.222.0.16 () {58 vars in 1009 bytes} [Thu Jul 14 11:01:01 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:01:01.662029 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9d98ec-25d4-4253-823f-1a2866102736 service placement] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:01:01.663495 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-ae9d98ec-25d4-4253-823f-1a2866102736 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:01:01.731676 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9d98ec-25d4-4253-823f-1a2866102736 service placement] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:01:01.736624 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee0426b-9d37-40dc-ab37-39ec48c7c539 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a23de49b80643eaab7a212f2884d62e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59391272ecbe48b0aa736cb43807be1d', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:01:01.737306 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee0426b-9d37-40dc-ab37-39ec48c7c539 service swift] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:01:01.737596 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee0426b-9d37-40dc-ab37-39ec48c7c539 service swift] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:01:01.737879 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee0426b-9d37-40dc-ab37-39ec48c7c539 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:01:01.747261 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee0426b-9d37-40dc-ab37-39ec48c7c539 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:01:01.748877 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee0426b-9d37-40dc-ab37-39ec48c7c539 service swift] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:01:01.757097 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 1308/2604] 10.222.0.16 () {60 vars in 1384 bytes} [Thu Jul 14 11:01:01 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 14 11:01:10.591995 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b925ce15-0390-4700-a75a-6817f2af9e0d None None] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:01:10.593521 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-b925ce15-0390-4700-a75a-6817f2af9e0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:01:10.627224 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b925ce15-0390-4700-a75a-6817f2af9e0d None None] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:01:10.631900 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d0214a-3339-449e-897c-a8a75b311540 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dddf93691844886982c91fea974385d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59391272ecbe48b0aa736cb43807be1d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:01:10.632538 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d0214a-3339-449e-897c-a8a75b311540 service neutron] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:01:10.632852 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d0214a-3339-449e-897c-a8a75b311540 service neutron] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:01:10.633129 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d0214a-3339-449e-897c-a8a75b311540 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:01:10.634894 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-04d0214a-3339-449e-897c-a8a75b311540 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:01:10.694424 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d0214a-3339-449e-897c-a8a75b311540 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:01:10.695866 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d0214a-3339-449e-897c-a8a75b311540 service neutron] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:01:10.705297 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 1297/2605] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jul 14 11:01:10 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 11:01:11.753788 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=95 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:01:16.540160 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff70c864-da95-4eeb-9f87-a7bac0ba62b9 None None] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:01:16.540806 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff70c864-da95-4eeb-9f87-a7bac0ba62b9 None None] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:01:16.540806 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff70c864-da95-4eeb-9f87-a7bac0ba62b9 None None] PATH_INFO: `/` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:01:16.542167 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 1309/2606] 10.222.0.16 () {54 vars in 921 bytes} [Thu Jul 14 11:01:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:01:16.547035 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549c3e60-c179-4326-9c14-c8fdfe0ce89f None None] REQUEST_METHOD: `POST` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:01:16.547483 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549c3e60-c179-4326-9c14-c8fdfe0ce89f None None] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:01:16.547606 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549c3e60-c179-4326-9c14-c8fdfe0ce89f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:01:16.589580 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.auth.core [None req-549c3e60-c179-4326-9c14-c8fdfe0ce89f None None] MFA Rules not processed for user `26aa294c913c408499a913ec25bb677d`. Rule list: `[]` (Enabled: `True`). {{(pid=86656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:01:16.590816 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-549c3e60-c179-4326-9c14-c8fdfe0ce89f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:01:16.656980 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=100 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:01:16.692910 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 1298/2607] 10.222.0.16 () {58 vars in 1018 bytes} [Thu Jul 14 11:01:16 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:01:16.704512 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff70c864-da95-4eeb-9f87-a7bac0ba62b9 None None] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:01:16.706354 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-ff70c864-da95-4eeb-9f87-a7bac0ba62b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:01:16.769589 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff70c864-da95-4eeb-9f87-a7bac0ba62b9 None None] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:01:16.773708 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ee44d5-8f64-475f-b1bd-d44cc10f90a2 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4cb877bf3f8241dcb2ecbb612c7f4f69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59391272ecbe48b0aa736cb43807be1d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:01:16.774488 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ee44d5-8f64-475f-b1bd-d44cc10f90a2 service glance] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:01:16.774853 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ee44d5-8f64-475f-b1bd-d44cc10f90a2 service glance] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:01:16.775228 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ee44d5-8f64-475f-b1bd-d44cc10f90a2 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:01:16.786791 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ee44d5-8f64-475f-b1bd-d44cc10f90a2 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:01:16.788439 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ee44d5-8f64-475f-b1bd-d44cc10f90a2 service glance] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:01:16.804409 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 1310/2608] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jul 14 11:01:16 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 11:01:16.866049 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549c3e60-c179-4326-9c14-c8fdfe0ce89f None None] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:01:16.875636 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549c3e60-c179-4326-9c14-c8fdfe0ce89f None None] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:01:16.879843 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6e200e-602a-4fb7-9fae-72d265f19748 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dddf93691844886982c91fea974385d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59391272ecbe48b0aa736cb43807be1d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:01:16.880508 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6e200e-602a-4fb7-9fae-72d265f19748 service neutron] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:01:16.880820 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6e200e-602a-4fb7-9fae-72d265f19748 service neutron] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:01:16.881105 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6e200e-602a-4fb7-9fae-72d265f19748 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:01:16.882898 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-af6e200e-602a-4fb7-9fae-72d265f19748 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:01:16.978076 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6e200e-602a-4fb7-9fae-72d265f19748 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:01:16.979300 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6e200e-602a-4fb7-9fae-72d265f19748 service neutron] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:01:17.002708 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 1299/2609] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jul 14 11:01:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 11:01:18.465438 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c8a225-3da5-4206-834d-eb18d4582384 None None] REQUEST_METHOD: `POST` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:01:18.465921 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c8a225-3da5-4206-834d-eb18d4582384 None None] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:01:18.465921 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c8a225-3da5-4206-834d-eb18d4582384 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:01:18.489753 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.auth.core [None req-69c8a225-3da5-4206-834d-eb18d4582384 None None] MFA Rules not processed for user `0dfc7cd9c05e4f268d2ce316d531c4bd`. Rule list: `[]` (Enabled: `True`). {{(pid=86655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:01:18.490612 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-69c8a225-3da5-4206-834d-eb18d4582384 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:01:18.497956 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 1311/2610] 10.222.0.16 () {58 vars in 1009 bytes} [Thu Jul 14 11:01:18 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:01:18.510357 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6e200e-602a-4fb7-9fae-72d265f19748 service neutron] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:01:18.522340 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6e200e-602a-4fb7-9fae-72d265f19748 service neutron] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:01:18.527414 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7437f3-1f6d-494c-9822-84a83ebf2200 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a23de49b80643eaab7a212f2884d62e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59391272ecbe48b0aa736cb43807be1d', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:01:18.528173 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7437f3-1f6d-494c-9822-84a83ebf2200 service swift] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:01:18.528529 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7437f3-1f6d-494c-9822-84a83ebf2200 service swift] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:01:18.528953 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7437f3-1f6d-494c-9822-84a83ebf2200 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:01:18.538800 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7437f3-1f6d-494c-9822-84a83ebf2200 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:01:18.540541 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7437f3-1f6d-494c-9822-84a83ebf2200 service swift] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:01:18.548747 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 1300/2611] 10.222.0.16 () {60 vars in 1384 bytes} [Thu Jul 14 11:01:18 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 14 11:01:21.186723 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c8a225-3da5-4206-834d-eb18d4582384 None None] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:01:21.188344 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-69c8a225-3da5-4206-834d-eb18d4582384 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:01:21.210090 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c8a225-3da5-4206-834d-eb18d4582384 None None] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:01:21.216179 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce77474c-97cb-49bc-8ffc-76a7a46408d0 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16846111ee2a42dd99c3052d40980f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59391272ecbe48b0aa736cb43807be1d', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:01:21.216908 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce77474c-97cb-49bc-8ffc-76a7a46408d0 service placement] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:01:21.217173 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce77474c-97cb-49bc-8ffc-76a7a46408d0 service placement] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:01:21.217641 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce77474c-97cb-49bc-8ffc-76a7a46408d0 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:01:21.219480 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-ce77474c-97cb-49bc-8ffc-76a7a46408d0 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:01:21.231990 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce77474c-97cb-49bc-8ffc-76a7a46408d0 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:01:21.233938 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce77474c-97cb-49bc-8ffc-76a7a46408d0 service placement] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:01:21.250601 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 1312/2612] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jul 14 11:01:21 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 11:01:24.806847 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7437f3-1f6d-494c-9822-84a83ebf2200 service swift] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:01:24.808585 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-1d7437f3-1f6d-494c-9822-84a83ebf2200 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:01:24.838397 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7437f3-1f6d-494c-9822-84a83ebf2200 service swift] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:01:24.850873 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d157130a-642e-4dd9-aefc-ccf3d70a1c19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:01:24.851758 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d157130a-642e-4dd9-aefc-ccf3d70a1c19 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:01:24.852058 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d157130a-642e-4dd9-aefc-ccf3d70a1c19 admin admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:01:24.852508 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d157130a-642e-4dd9-aefc-ccf3d70a1c19 admin admin] PATH_INFO: `/v3/users/219b9dabdb904973b7bd4c23d944ca92` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:01:24.856731 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d157130a-642e-4dd9-aefc-ccf3d70a1c19 admin admin] RBAC: Authorizing `identity:delete_user(user_id=219b9dabdb904973b7bd4c23d944ca92)` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:01:24.858841 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d157130a-642e-4dd9-aefc-ccf3d70a1c19 admin admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:01:24.942829 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-d157130a-642e-4dd9-aefc-ccf3d70a1c19 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '219b9dabdb904973b7bd4c23d944ca92'} {{(pid=86656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:01:24.951772 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-d157130a-642e-4dd9-aefc-ccf3d70a1c19 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '219b9dabdb904973b7bd4c23d944ca92'} {{(pid=86656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:01:24.952701 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-d157130a-642e-4dd9-aefc-ccf3d70a1c19 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '219b9dabdb904973b7bd4c23d944ca92'} {{(pid=86656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:01:24.962300 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-d157130a-642e-4dd9-aefc-ccf3d70a1c19 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '219b9dabdb904973b7bd4c23d944ca92'} {{(pid=86656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:01:24.963055 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-d157130a-642e-4dd9-aefc-ccf3d70a1c19 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '219b9dabdb904973b7bd4c23d944ca92'} {{(pid=86656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:01:24.983035 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:01:24.992018 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 1301/2613] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Jul 14 11:01:24 2022] DELETE /identity/v3/users/219b9dabdb904973b7bd4c23d944ca92 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:01:25.191054 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce77474c-97cb-49bc-8ffc-76a7a46408d0 service placement] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:01:25.204583 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce77474c-97cb-49bc-8ffc-76a7a46408d0 service placement] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:01:25.271176 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5f77ba-7595-4dff-bb8b-ed2316a47346 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:01:25.272084 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5f77ba-7595-4dff-bb8b-ed2316a47346 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:01:25.272472 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5f77ba-7595-4dff-bb8b-ed2316a47346 admin admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:01:25.272883 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5f77ba-7595-4dff-bb8b-ed2316a47346 admin admin] PATH_INFO: `/v3/projects/52d2f7529880413a8fc9312aae833ea2` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:01:25.274227 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5f77ba-7595-4dff-bb8b-ed2316a47346 admin admin] RBAC: Authorizing `identity:delete_project(project_id=52d2f7529880413a8fc9312aae833ea2)` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:01:25.276233 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5f77ba-7595-4dff-bb8b-ed2316a47346 admin admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:01:25.326392 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-fe5f77ba-7595-4dff-bb8b-ed2316a47346 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '52d2f7529880413a8fc9312aae833ea2', 'request_id': 'req-fe5f77ba-7595-4dff-bb8b-ed2316a47346'} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:01:25.333112 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-fe5f77ba-7595-4dff-bb8b-ed2316a47346 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '52d2f7529880413a8fc9312aae833ea2', 'request_id': 'req-fe5f77ba-7595-4dff-bb8b-ed2316a47346'} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:01:25.340973 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-fe5f77ba-7595-4dff-bb8b-ed2316a47346 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '52d2f7529880413a8fc9312aae833ea2', 'request_id': 'req-fe5f77ba-7595-4dff-bb8b-ed2316a47346'} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:01:25.353766 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-fe5f77ba-7595-4dff-bb8b-ed2316a47346 admin admin] The token cache is being invalidate because project 52d2f7529880413a8fc9312aae833ea2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86655) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 11:01:25.354057 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-fe5f77ba-7595-4dff-bb8b-ed2316a47346 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:01:25.354723 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-fe5f77ba-7595-4dff-bb8b-ed2316a47346 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:01:25.356281 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 1313/2614] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Jul 14 11:01:25 2022] DELETE /identity/v3/projects/52d2f7529880413a8fc9312aae833ea2 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:01:25.360398 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d157130a-642e-4dd9-aefc-ccf3d70a1c19 admin admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:01:25.361889 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-d157130a-642e-4dd9-aefc-ccf3d70a1c19 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:01:25.375949 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d157130a-642e-4dd9-aefc-ccf3d70a1c19 admin admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:01:25.437822 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a396cd6-7427-42c4-8747-d36a8866399f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:01:25.438904 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a396cd6-7427-42c4-8747-d36a8866399f admin admin] REQUEST_METHOD: `DELETE` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:01:25.439264 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a396cd6-7427-42c4-8747-d36a8866399f admin admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:01:25.439623 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a396cd6-7427-42c4-8747-d36a8866399f admin admin] PATH_INFO: `/v3/users/fd475a9b058a45df87e5cfaabbe5594e` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:01:25.442440 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a396cd6-7427-42c4-8747-d36a8866399f admin admin] RBAC: Authorizing `identity:delete_user(user_id=fd475a9b058a45df87e5cfaabbe5594e)` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:01:25.444468 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a396cd6-7427-42c4-8747-d36a8866399f admin admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:01:25.495582 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-8a396cd6-7427-42c4-8747-d36a8866399f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fd475a9b058a45df87e5cfaabbe5594e'} {{(pid=86656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:01:25.506189 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-8a396cd6-7427-42c4-8747-d36a8866399f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fd475a9b058a45df87e5cfaabbe5594e'} {{(pid=86656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:01:25.507408 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-8a396cd6-7427-42c4-8747-d36a8866399f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fd475a9b058a45df87e5cfaabbe5594e'} {{(pid=86656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:01:25.525490 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-8a396cd6-7427-42c4-8747-d36a8866399f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fd475a9b058a45df87e5cfaabbe5594e'} {{(pid=86656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:01:25.529602 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-8a396cd6-7427-42c4-8747-d36a8866399f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fd475a9b058a45df87e5cfaabbe5594e'} {{(pid=86656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:01:25.559686 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 1302/2615] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Jul 14 11:01:25 2022] DELETE /identity/v3/users/fd475a9b058a45df87e5cfaabbe5594e => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:01:25.759518 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5f77ba-7595-4dff-bb8b-ed2316a47346 admin admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:01:25.761367 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-fe5f77ba-7595-4dff-bb8b-ed2316a47346 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:01:25.775343 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5f77ba-7595-4dff-bb8b-ed2316a47346 admin admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:01:25.808205 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:01:25.869300 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeaa4fce-0163-494b-95cd-0c5591681502 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:01:25.870289 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeaa4fce-0163-494b-95cd-0c5591681502 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:01:25.870661 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeaa4fce-0163-494b-95cd-0c5591681502 admin admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:01:25.871015 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeaa4fce-0163-494b-95cd-0c5591681502 admin admin] PATH_INFO: `/v3/projects/bab3887a35ef49f2bacea8469c6b1ede` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:01:25.872282 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeaa4fce-0163-494b-95cd-0c5591681502 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bab3887a35ef49f2bacea8469c6b1ede)` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:01:25.874330 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeaa4fce-0163-494b-95cd-0c5591681502 admin admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:01:25.924741 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-aeaa4fce-0163-494b-95cd-0c5591681502 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bab3887a35ef49f2bacea8469c6b1ede', 'request_id': 'req-aeaa4fce-0163-494b-95cd-0c5591681502'} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:01:25.935529 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-aeaa4fce-0163-494b-95cd-0c5591681502 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bab3887a35ef49f2bacea8469c6b1ede', 'request_id': 'req-aeaa4fce-0163-494b-95cd-0c5591681502'} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:01:25.945220 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-aeaa4fce-0163-494b-95cd-0c5591681502 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bab3887a35ef49f2bacea8469c6b1ede', 'request_id': 'req-aeaa4fce-0163-494b-95cd-0c5591681502'} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:01:25.958771 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-aeaa4fce-0163-494b-95cd-0c5591681502 admin admin] The token cache is being invalidate because project bab3887a35ef49f2bacea8469c6b1ede was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86655) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 11:01:25.959058 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-aeaa4fce-0163-494b-95cd-0c5591681502 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:01:25.959726 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-aeaa4fce-0163-494b-95cd-0c5591681502 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:01:25.961434 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 1314/2616] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Jul 14 11:01:25 2022] DELETE /identity/v3/projects/bab3887a35ef49f2bacea8469c6b1ede => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:01:35.555616 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=55,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:01:35.954650 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=45,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:01:39.271351 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819f8f2f-0fbb-4f2b-8ea6-7d66f22c1f90 None None] REQUEST_METHOD: `POST` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:01:39.271832 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819f8f2f-0fbb-4f2b-8ea6-7d66f22c1f90 None None] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:01:39.271941 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819f8f2f-0fbb-4f2b-8ea6-7d66f22c1f90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:01:39.290034 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.auth.core [None req-819f8f2f-0fbb-4f2b-8ea6-7d66f22c1f90 None None] MFA Rules not processed for user `0dfc7cd9c05e4f268d2ce316d531c4bd`. Rule list: `[]` (Enabled: `True`). {{(pid=86656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:01:39.291223 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-819f8f2f-0fbb-4f2b-8ea6-7d66f22c1f90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:01:39.345214 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 1303/2617] 10.222.0.16 () {58 vars in 967 bytes} [Thu Jul 14 11:01:39 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:01:39.357394 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeaa4fce-0163-494b-95cd-0c5591681502 admin admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:01:39.358805 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-aeaa4fce-0163-494b-95cd-0c5591681502 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:01:39.428643 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeaa4fce-0163-494b-95cd-0c5591681502 admin admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:01:39.433708 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b33ecf-c167-4691-8225-c2e17792d035 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a23de49b80643eaab7a212f2884d62e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59391272ecbe48b0aa736cb43807be1d', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:01:39.434371 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b33ecf-c167-4691-8225-c2e17792d035 service swift] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:01:39.434650 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b33ecf-c167-4691-8225-c2e17792d035 service swift] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:01:39.434932 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b33ecf-c167-4691-8225-c2e17792d035 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:01:39.444003 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b33ecf-c167-4691-8225-c2e17792d035 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:01:39.445608 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b33ecf-c167-4691-8225-c2e17792d035 service swift] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:01:39.453696 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 1315/2618] 10.222.0.16 () {60 vars in 1384 bytes} [Thu Jul 14 11:01:39 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 14 11:01:49.338915 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=25 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:01:49.450420 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=32 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:02:22.544884 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab5696b-fe51-40c1-b42c-934b54099bd1 None None] REQUEST_METHOD: `POST` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:02:22.545421 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab5696b-fe51-40c1-b42c-934b54099bd1 None None] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:02:22.545521 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab5696b-fe51-40c1-b42c-934b54099bd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:02:22.563132 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.auth.core [None req-aab5696b-fe51-40c1-b42c-934b54099bd1 None None] MFA Rules not processed for user `4d715ce7c98042adb432112376afe023`. Rule list: `[]` (Enabled: `True`). {{(pid=86656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:02:22.564329 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-aab5696b-fe51-40c1-b42c-934b54099bd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:02:22.618878 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 1304/2619] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jul 14 11:02:22 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:02:32.611503 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=25 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:02:43.263221 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b33ecf-c167-4691-8225-c2e17792d035 service swift] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:02:43.264636 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-82b33ecf-c167-4691-8225-c2e17792d035 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:02:43.322655 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b33ecf-c167-4691-8225-c2e17792d035 service swift] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:02:43.326316 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf965747-9aba-4a4a-a774-c73352def248 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dddf93691844886982c91fea974385d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59391272ecbe48b0aa736cb43807be1d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:02:43.326998 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf965747-9aba-4a4a-a774-c73352def248 service neutron] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:02:43.327286 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf965747-9aba-4a4a-a774-c73352def248 service neutron] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:02:43.327569 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf965747-9aba-4a4a-a774-c73352def248 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:02:43.329423 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-cf965747-9aba-4a4a-a774-c73352def248 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:02:43.392001 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf965747-9aba-4a4a-a774-c73352def248 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:02:43.393475 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf965747-9aba-4a4a-a774-c73352def248 service neutron] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:02:43.403806 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 1316/2620] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jul 14 11:02:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 11:02:46.503623 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab5696b-fe51-40c1-b42c-934b54099bd1 None None] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:02:46.505110 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-aab5696b-fe51-40c1-b42c-934b54099bd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:02:46.519431 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab5696b-fe51-40c1-b42c-934b54099bd1 None None] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:02:46.523889 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632786b5-f4f4-47ee-b703-3b8f0fb0ae32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:02:46.525025 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632786b5-f4f4-47ee-b703-3b8f0fb0ae32 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:02:46.525315 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632786b5-f4f4-47ee-b703-3b8f0fb0ae32 admin admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:02:46.525595 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632786b5-f4f4-47ee-b703-3b8f0fb0ae32 admin admin] PATH_INFO: `/v3/users/9bf1e116dda742559eed6d9c25f1ff47` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:02:46.526791 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632786b5-f4f4-47ee-b703-3b8f0fb0ae32 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9bf1e116dda742559eed6d9c25f1ff47)` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:02:46.528708 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632786b5-f4f4-47ee-b703-3b8f0fb0ae32 admin admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:02:46.575459 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-632786b5-f4f4-47ee-b703-3b8f0fb0ae32 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9bf1e116dda742559eed6d9c25f1ff47'} {{(pid=86656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:02:46.582301 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-632786b5-f4f4-47ee-b703-3b8f0fb0ae32 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9bf1e116dda742559eed6d9c25f1ff47'} {{(pid=86656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:02:46.582928 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-632786b5-f4f4-47ee-b703-3b8f0fb0ae32 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9bf1e116dda742559eed6d9c25f1ff47'} {{(pid=86656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:02:46.590211 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-632786b5-f4f4-47ee-b703-3b8f0fb0ae32 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9bf1e116dda742559eed6d9c25f1ff47'} {{(pid=86656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:02:46.590861 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-632786b5-f4f4-47ee-b703-3b8f0fb0ae32 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9bf1e116dda742559eed6d9c25f1ff47'} {{(pid=86656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:02:46.608570 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 1305/2621] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Jul 14 11:02:46 2022] DELETE /identity/v3/users/9bf1e116dda742559eed6d9c25f1ff47 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:02:46.778076 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf965747-9aba-4a4a-a774-c73352def248 service neutron] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:02:46.797524 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf965747-9aba-4a4a-a774-c73352def248 service neutron] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:02:46.862789 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821f029b-2271-4013-9fe8-3cda4f555f0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:02:46.863626 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821f029b-2271-4013-9fe8-3cda4f555f0e admin admin] REQUEST_METHOD: `DELETE` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:02:46.863914 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821f029b-2271-4013-9fe8-3cda4f555f0e admin admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:02:46.864193 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821f029b-2271-4013-9fe8-3cda4f555f0e admin admin] PATH_INFO: `/v3/projects/dc39ecdf094e417b8356ab40e9e7316d` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:02:46.865408 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821f029b-2271-4013-9fe8-3cda4f555f0e admin admin] RBAC: Authorizing `identity:delete_project(project_id=dc39ecdf094e417b8356ab40e9e7316d)` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:02:46.867307 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821f029b-2271-4013-9fe8-3cda4f555f0e admin admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:02:46.917016 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-821f029b-2271-4013-9fe8-3cda4f555f0e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dc39ecdf094e417b8356ab40e9e7316d', 'request_id': 'req-821f029b-2271-4013-9fe8-3cda4f555f0e'} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:02:46.918963 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:02:46.923676 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-821f029b-2271-4013-9fe8-3cda4f555f0e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dc39ecdf094e417b8356ab40e9e7316d', 'request_id': 'req-821f029b-2271-4013-9fe8-3cda4f555f0e'} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:02:46.930875 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-821f029b-2271-4013-9fe8-3cda4f555f0e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dc39ecdf094e417b8356ab40e9e7316d', 'request_id': 'req-821f029b-2271-4013-9fe8-3cda4f555f0e'} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:02:46.942285 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-821f029b-2271-4013-9fe8-3cda4f555f0e admin admin] The token cache is being invalidate because project dc39ecdf094e417b8356ab40e9e7316d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86655) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 11:02:46.942576 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-821f029b-2271-4013-9fe8-3cda4f555f0e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:02:46.943206 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-821f029b-2271-4013-9fe8-3cda4f555f0e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:02:46.944748 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 1317/2622] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Jul 14 11:02:46 2022] DELETE /identity/v3/projects/dc39ecdf094e417b8356ab40e9e7316d => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:02:46.950420 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6041a6-978d-48da-bfce-e1657adbc1f2 None None] REQUEST_METHOD: `POST` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:02:46.950720 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6041a6-978d-48da-bfce-e1657adbc1f2 None None] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:02:46.951056 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6041a6-978d-48da-bfce-e1657adbc1f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:02:47.000403 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.auth.core [None req-0f6041a6-978d-48da-bfce-e1657adbc1f2 None None] MFA Rules not processed for user `ae4bcdd8106d4bebbdcae96be33505bc`. Rule list: `[]` (Enabled: `True`). {{(pid=86656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:02:47.001636 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-0f6041a6-978d-48da-bfce-e1657adbc1f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:02:47.059104 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 1306/2623] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jul 14 11:02:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:02:47.066978 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1222bf4-de9b-452e-a47a-f19a0bbd1380 None None] REQUEST_METHOD: `POST` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:02:47.067275 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1222bf4-de9b-452e-a47a-f19a0bbd1380 None None] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:02:47.067561 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1222bf4-de9b-452e-a47a-f19a0bbd1380 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:02:47.086069 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.auth.core [None req-e1222bf4-de9b-452e-a47a-f19a0bbd1380 None None] MFA Rules not processed for user `ae4bcdd8106d4bebbdcae96be33505bc`. Rule list: `[]` (Enabled: `True`). {{(pid=86655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:02:47.087476 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-e1222bf4-de9b-452e-a47a-f19a0bbd1380 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:02:47.095397 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 1318/2624] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jul 14 11:02:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:02:47.099479 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6041a6-978d-48da-bfce-e1657adbc1f2 None None] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:02:47.109352 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6041a6-978d-48da-bfce-e1657adbc1f2 None None] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:02:47.113898 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d97cdb-1eb0-46c7-bac7-9dcdfe342f8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:02:47.114484 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d97cdb-1eb0-46c7-bac7-9dcdfe342f8a admin admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:02:47.114766 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d97cdb-1eb0-46c7-bac7-9dcdfe342f8a admin admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:02:47.115041 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d97cdb-1eb0-46c7-bac7-9dcdfe342f8a admin admin] PATH_INFO: `/v3/domains` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:02:47.115763 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d97cdb-1eb0-46c7-bac7-9dcdfe342f8a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:02:47.116071 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d97cdb-1eb0-46c7-bac7-9dcdfe342f8a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:02:47.117692 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d97cdb-1eb0-46c7-bac7-9dcdfe342f8a admin admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:02:47.129815 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 1307/2625] 10.222.0.16 () {58 vars in 1152 bytes} [Thu Jul 14 11:02:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 11:02:47.134676 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1222bf4-de9b-452e-a47a-f19a0bbd1380 None None] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:02:47.144232 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1222bf4-de9b-452e-a47a-f19a0bbd1380 None None] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:02:47.148845 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85d5950-cd6b-4c0e-9b1f-beb33d39d67b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:02:47.149715 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85d5950-cd6b-4c0e-9b1f-beb33d39d67b admin admin] REQUEST_METHOD: `POST` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:02:47.150140 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85d5950-cd6b-4c0e-9b1f-beb33d39d67b admin admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:02:47.150428 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85d5950-cd6b-4c0e-9b1f-beb33d39d67b admin admin] PATH_INFO: `/v3/projects` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:02:47.151125 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85d5950-cd6b-4c0e-9b1f-beb33d39d67b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:02:47.153031 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85d5950-cd6b-4c0e-9b1f-beb33d39d67b admin admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:02:47.187554 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 1319/2626] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Jul 14 11:02:47 2022] POST /identity/v3/projects => generated 375 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 11:02:47.192023 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d97cdb-1eb0-46c7-bac7-9dcdfe342f8a admin admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:02:47.202760 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d97cdb-1eb0-46c7-bac7-9dcdfe342f8a admin admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:02:47.236049 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:02:47.261066 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370754aa-2e92-4b58-a30b-950948fab28a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:02:47.261735 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370754aa-2e92-4b58-a30b-950948fab28a admin admin] REQUEST_METHOD: `POST` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:02:47.262016 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370754aa-2e92-4b58-a30b-950948fab28a admin admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:02:47.262289 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370754aa-2e92-4b58-a30b-950948fab28a admin admin] PATH_INFO: `/v3/users` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:02:47.262971 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370754aa-2e92-4b58-a30b-950948fab28a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:02:47.264947 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370754aa-2e92-4b58-a30b-950948fab28a admin admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:02:47.283947 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 1308/2627] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Jul 14 11:02:47 2022] POST /identity/v3/users => generated 288 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 11:02:47.288089 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85d5950-cd6b-4c0e-9b1f-beb33d39d67b admin admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:02:47.299049 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85d5950-cd6b-4c0e-9b1f-beb33d39d67b admin admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:02:47.303592 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d85f743-a5a8-43e3-b963-af6184c97993 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:02:47.304249 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d85f743-a5a8-43e3-b963-af6184c97993 admin admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:02:47.304537 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d85f743-a5a8-43e3-b963-af6184c97993 admin admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:02:47.304851 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d85f743-a5a8-43e3-b963-af6184c97993 admin admin] PATH_INFO: `/v3/roles` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:02:47.305621 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d85f743-a5a8-43e3-b963-af6184c97993 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:02:47.307214 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d85f743-a5a8-43e3-b963-af6184c97993 admin admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:02:47.317367 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 1320/2628] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jul 14 11:02:47 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 11:02:47.321152 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370754aa-2e92-4b58-a30b-950948fab28a admin admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:02:47.331031 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370754aa-2e92-4b58-a30b-950948fab28a admin admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:02:47.335543 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859b2a0e-2077-4e99-873d-492ee261e22a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:02:47.336192 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859b2a0e-2077-4e99-873d-492ee261e22a admin admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:02:47.336474 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859b2a0e-2077-4e99-873d-492ee261e22a admin admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:02:47.336750 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859b2a0e-2077-4e99-873d-492ee261e22a admin admin] PATH_INFO: `/v3/roles` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:02:47.338225 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859b2a0e-2077-4e99-873d-492ee261e22a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:02:47.339848 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859b2a0e-2077-4e99-873d-492ee261e22a admin admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:02:47.349551 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 1309/2629] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jul 14 11:02:47 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 11:02:47.353708 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d85f743-a5a8-43e3-b963-af6184c97993 admin admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:02:47.363505 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d85f743-a5a8-43e3-b963-af6184c97993 admin admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:02:47.368686 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99aba7ac-aafa-4316-b428-8c2589dfa37a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:02:47.369766 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99aba7ac-aafa-4316-b428-8c2589dfa37a admin admin] REQUEST_METHOD: `PUT` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:02:47.370056 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99aba7ac-aafa-4316-b428-8c2589dfa37a admin admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:02:47.370338 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99aba7ac-aafa-4316-b428-8c2589dfa37a admin admin] PATH_INFO: `/v3/projects/c85377e530444a8ea8db75abe369ffc6/users/8b7f601f6ca242a4811ae36e0395ef3c/roles/0da46c267d354cce81495dfdd56c1ec2` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:02:47.386305 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99aba7ac-aafa-4316-b428-8c2589dfa37a admin admin] RBAC: Authorizing `identity:create_grant(project_id=c85377e530444a8ea8db75abe369ffc6, user_id=8b7f601f6ca242a4811ae36e0395ef3c, role_id=0da46c267d354cce81495dfdd56c1ec2)` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:02:47.388973 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99aba7ac-aafa-4316-b428-8c2589dfa37a admin admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:02:47.401578 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 1321/2630] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Jul 14 11:02:47 2022] PUT /identity/v3/projects/c85377e530444a8ea8db75abe369ffc6/users/8b7f601f6ca242a4811ae36e0395ef3c/roles/0da46c267d354cce81495dfdd56c1ec2 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 11:02:47.406528 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51f315c-d355-4082-8704-56973cb0390a None None] REQUEST_METHOD: `POST` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:02:47.406825 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51f315c-d355-4082-8704-56973cb0390a None None] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:02:47.407105 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51f315c-d355-4082-8704-56973cb0390a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:02:47.424813 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.auth.core [None req-f51f315c-d355-4082-8704-56973cb0390a None None] MFA Rules not processed for user `ae4bcdd8106d4bebbdcae96be33505bc`. Rule list: `[]` (Enabled: `True`). {{(pid=86656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:02:47.426026 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-f51f315c-d355-4082-8704-56973cb0390a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:02:47.483914 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 1310/2631] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jul 14 11:02:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:02:47.493744 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99aba7ac-aafa-4316-b428-8c2589dfa37a admin admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:02:47.495472 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-99aba7ac-aafa-4316-b428-8c2589dfa37a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:02:47.553009 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99aba7ac-aafa-4316-b428-8c2589dfa37a admin admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:02:47.556825 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88c8575-3664-4851-bf64-b544616bc6bf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dddf93691844886982c91fea974385d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59391272ecbe48b0aa736cb43807be1d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:02:47.557471 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88c8575-3664-4851-bf64-b544616bc6bf service neutron] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:02:47.557757 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88c8575-3664-4851-bf64-b544616bc6bf service neutron] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:02:47.558035 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88c8575-3664-4851-bf64-b544616bc6bf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:02:47.567130 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88c8575-3664-4851-bf64-b544616bc6bf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:02:47.568545 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88c8575-3664-4851-bf64-b544616bc6bf service neutron] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:02:47.578715 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 1322/2632] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jul 14 11:02:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 11:02:51.505342 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13be4d97-eeef-4b24-bc60-525fc45db9d2 None None] REQUEST_METHOD: `POST` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:02:51.505852 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13be4d97-eeef-4b24-bc60-525fc45db9d2 None None] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:02:51.505951 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13be4d97-eeef-4b24-bc60-525fc45db9d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:02:51.534230 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.auth.core [None req-13be4d97-eeef-4b24-bc60-525fc45db9d2 None None] MFA Rules not processed for user `8b7f601f6ca242a4811ae36e0395ef3c`. Rule list: `[]` (Enabled: `True`). {{(pid=86656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:02:51.535456 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-13be4d97-eeef-4b24-bc60-525fc45db9d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:02:51.606161 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 1311/2633] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jul 14 11:02:51 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:02:51.621349 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88c8575-3664-4851-bf64-b544616bc6bf service neutron] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:02:51.622771 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-c88c8575-3664-4851-bf64-b544616bc6bf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:02:51.704962 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88c8575-3664-4851-bf64-b544616bc6bf service neutron] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:02:51.710584 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e528814-1f8b-4e18-aa1a-11db96fcec58 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26aa294c913c408499a913ec25bb677d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59391272ecbe48b0aa736cb43807be1d', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:02:51.711249 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e528814-1f8b-4e18-aa1a-11db96fcec58 service nova] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:02:51.711543 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e528814-1f8b-4e18-aa1a-11db96fcec58 service nova] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:02:51.712348 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e528814-1f8b-4e18-aa1a-11db96fcec58 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:02:51.719227 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:02:51.721802 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e528814-1f8b-4e18-aa1a-11db96fcec58 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:02:51.723750 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e528814-1f8b-4e18-aa1a-11db96fcec58 service nova] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:02:51.735264 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 1323/2634] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jul 14 11:02:51 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 11:02:53.019150 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a70f72-eab0-4ac7-9bee-f5fe57cc0998 None None] REQUEST_METHOD: `POST` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:02:53.019638 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a70f72-eab0-4ac7-9bee-f5fe57cc0998 None None] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:02:53.019747 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a70f72-eab0-4ac7-9bee-f5fe57cc0998 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:02:53.037703 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.auth.core [None req-e3a70f72-eab0-4ac7-9bee-f5fe57cc0998 None None] MFA Rules not processed for user `8b7f601f6ca242a4811ae36e0395ef3c`. Rule list: `[]` (Enabled: `True`). {{(pid=86656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:02:53.038921 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-e3a70f72-eab0-4ac7-9bee-f5fe57cc0998 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:02:53.046724 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 1312/2635] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jul 14 11:02:53 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:02:53.987209 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e528814-1f8b-4e18-aa1a-11db96fcec58 service nova] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:02:53.988681 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-8e528814-1f8b-4e18-aa1a-11db96fcec58 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:02:54.001482 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e528814-1f8b-4e18-aa1a-11db96fcec58 service nova] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:02:54.005045 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4890aca2-8750-48db-979f-57a0f4493c09 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dddf93691844886982c91fea974385d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59391272ecbe48b0aa736cb43807be1d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:02:54.005961 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4890aca2-8750-48db-979f-57a0f4493c09 service neutron] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:02:54.006416 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4890aca2-8750-48db-979f-57a0f4493c09 service neutron] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:02:54.006703 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4890aca2-8750-48db-979f-57a0f4493c09 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:02:54.008855 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-4890aca2-8750-48db-979f-57a0f4493c09 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:02:54.023441 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4890aca2-8750-48db-979f-57a0f4493c09 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:02:54.025554 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4890aca2-8750-48db-979f-57a0f4493c09 service neutron] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:02:54.038152 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 1324/2636] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jul 14 11:02:53 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 11:02:58.628238 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a70f72-eab0-4ac7-9bee-f5fe57cc0998 None None] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:02:58.638475 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a70f72-eab0-4ac7-9bee-f5fe57cc0998 None None] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:02:58.641976 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb161fe-0c94-4192-9c15-cfd4d9c9bf87 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dddf93691844886982c91fea974385d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59391272ecbe48b0aa736cb43807be1d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:02:58.642622 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb161fe-0c94-4192-9c15-cfd4d9c9bf87 service neutron] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:02:58.642908 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb161fe-0c94-4192-9c15-cfd4d9c9bf87 service neutron] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:02:58.643186 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb161fe-0c94-4192-9c15-cfd4d9c9bf87 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:02:58.644988 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-9eb161fe-0c94-4192-9c15-cfd4d9c9bf87 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:02:58.658006 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb161fe-0c94-4192-9c15-cfd4d9c9bf87 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:02:58.659429 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb161fe-0c94-4192-9c15-cfd4d9c9bf87 service neutron] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:02:58.670753 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 1313/2637] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jul 14 11:02:58 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 11:03:04.032445 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=8 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:03:08.665983 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=85,keystone:INSERT=3 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:03:56.438345 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4890aca2-8750-48db-979f-57a0f4493c09 service neutron] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:03:56.439901 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-4890aca2-8750-48db-979f-57a0f4493c09 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:03:56.454505 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4890aca2-8750-48db-979f-57a0f4493c09 service neutron] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:03:56.460361 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07245e64-870b-4e94-82f5-8593a7f647a2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26aa294c913c408499a913ec25bb677d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59391272ecbe48b0aa736cb43807be1d', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:03:56.461033 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07245e64-870b-4e94-82f5-8593a7f647a2 service nova] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:03:56.461316 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07245e64-870b-4e94-82f5-8593a7f647a2 service nova] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:03:56.461594 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07245e64-870b-4e94-82f5-8593a7f647a2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:03:56.463359 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-07245e64-870b-4e94-82f5-8593a7f647a2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:03:56.521003 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07245e64-870b-4e94-82f5-8593a7f647a2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:03:56.522581 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07245e64-870b-4e94-82f5-8593a7f647a2 service nova] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:03:56.531410 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 1325/2638] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jul 14 11:03:56 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 11:03:58.066137 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb161fe-0c94-4192-9c15-cfd4d9c9bf87 service neutron] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:03:58.075040 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb161fe-0c94-4192-9c15-cfd4d9c9bf87 service neutron] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:03:58.078739 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf841875-45eb-49f4-9955-3e3f7a6783c6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dddf93691844886982c91fea974385d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59391272ecbe48b0aa736cb43807be1d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:03:58.079376 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf841875-45eb-49f4-9955-3e3f7a6783c6 service neutron] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:03:58.079661 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf841875-45eb-49f4-9955-3e3f7a6783c6 service neutron] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:03:58.079943 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf841875-45eb-49f4-9955-3e3f7a6783c6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:03:58.081734 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-cf841875-45eb-49f4-9955-3e3f7a6783c6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:03:58.091809 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf841875-45eb-49f4-9955-3e3f7a6783c6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:03:58.093266 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf841875-45eb-49f4-9955-3e3f7a6783c6 service neutron] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:03:58.101982 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 1314/2639] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jul 14 11:03:58 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 11:03:59.439472 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07245e64-870b-4e94-82f5-8593a7f647a2 service nova] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:03:59.461689 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07245e64-870b-4e94-82f5-8593a7f647a2 service nova] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:03:59.467994 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3b7ca4-6eeb-4b48-982d-44b84ca828b7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26aa294c913c408499a913ec25bb677d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59391272ecbe48b0aa736cb43807be1d', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:03:59.468666 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3b7ca4-6eeb-4b48-982d-44b84ca828b7 service nova] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:03:59.469029 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3b7ca4-6eeb-4b48-982d-44b84ca828b7 service nova] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:03:59.469271 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3b7ca4-6eeb-4b48-982d-44b84ca828b7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:03:59.471179 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-da3b7ca4-6eeb-4b48-982d-44b84ca828b7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:03:59.485555 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3b7ca4-6eeb-4b48-982d-44b84ca828b7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:03:59.487383 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3b7ca4-6eeb-4b48-982d-44b84ca828b7 service nova] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:03:59.504973 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 1326/2640] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jul 14 11:03:59 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 11:04:02.304909 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab8441e-24a7-491d-813e-dfb878d2293d None None] REQUEST_METHOD: `POST` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:02.305484 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab8441e-24a7-491d-813e-dfb878d2293d None None] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:02.305484 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab8441e-24a7-491d-813e-dfb878d2293d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:02.324076 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.auth.core [None req-8ab8441e-24a7-491d-813e-dfb878d2293d None None] MFA Rules not processed for user `4d715ce7c98042adb432112376afe023`. Rule list: `[]` (Enabled: `True`). {{(pid=86656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:04:02.325329 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-8ab8441e-24a7-491d-813e-dfb878d2293d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:04:02.332875 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 1315/2641] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jul 14 11:04:02 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:04:02.952725 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3b7ca4-6eeb-4b48-982d-44b84ca828b7 service nova] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:04:02.954210 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-da3b7ca4-6eeb-4b48-982d-44b84ca828b7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:04:03.031813 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3b7ca4-6eeb-4b48-982d-44b84ca828b7 service nova] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:04:03.037403 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0fa3b5-a8af-4aa1-a3fd-b9921e25528a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16846111ee2a42dd99c3052d40980f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59391272ecbe48b0aa736cb43807be1d', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:04:03.038051 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0fa3b5-a8af-4aa1-a3fd-b9921e25528a service placement] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:03.038340 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0fa3b5-a8af-4aa1-a3fd-b9921e25528a service placement] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:03.038621 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0fa3b5-a8af-4aa1-a3fd-b9921e25528a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:03.040374 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-0a0fa3b5-a8af-4aa1-a3fd-b9921e25528a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:04:03.051774 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0fa3b5-a8af-4aa1-a3fd-b9921e25528a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:04:03.053380 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0fa3b5-a8af-4aa1-a3fd-b9921e25528a service placement] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:04:03.063441 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 1327/2642] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jul 14 11:04:02 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 11:04:11.972586 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab8441e-24a7-491d-813e-dfb878d2293d None None] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:04:11.986753 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab8441e-24a7-491d-813e-dfb878d2293d None None] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:04:11.992245 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87757798-78e3-455d-b28f-cfde56c905d9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26aa294c913c408499a913ec25bb677d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59391272ecbe48b0aa736cb43807be1d', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:04:11.992955 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87757798-78e3-455d-b28f-cfde56c905d9 service nova] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:11.993243 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87757798-78e3-455d-b28f-cfde56c905d9 service nova] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:11.993520 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87757798-78e3-455d-b28f-cfde56c905d9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:11.995337 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-87757798-78e3-455d-b28f-cfde56c905d9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:04:12.008068 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87757798-78e3-455d-b28f-cfde56c905d9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:04:12.009786 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87757798-78e3-455d-b28f-cfde56c905d9 service nova] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:04:12.021186 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 1316/2643] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jul 14 11:04:11 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 11:04:13.059008 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=66 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:04:22.016066 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=15 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:05:44.317792 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0fa3b5-a8af-4aa1-a3fd-b9921e25528a service placement] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:05:44.327721 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0fa3b5-a8af-4aa1-a3fd-b9921e25528a service placement] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:05:44.331232 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a14e2df-c582-4659-be39-62ef9be36940 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dddf93691844886982c91fea974385d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59391272ecbe48b0aa736cb43807be1d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:05:44.331867 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a14e2df-c582-4659-be39-62ef9be36940 service neutron] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:05:44.332150 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a14e2df-c582-4659-be39-62ef9be36940 service neutron] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:05:44.332425 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a14e2df-c582-4659-be39-62ef9be36940 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:05:44.334270 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-9a14e2df-c582-4659-be39-62ef9be36940 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:05:44.346274 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a14e2df-c582-4659-be39-62ef9be36940 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:05:44.347680 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a14e2df-c582-4659-be39-62ef9be36940 service neutron] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:05:44.357929 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 1328/2644] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jul 14 11:05:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 11:05:47.450527 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87757798-78e3-455d-b28f-cfde56c905d9 service nova] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:05:47.451956 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-87757798-78e3-455d-b28f-cfde56c905d9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:05:47.465491 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87757798-78e3-455d-b28f-cfde56c905d9 service nova] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:05:47.469990 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74435316-21a7-49cd-bedd-93bbbf6de8b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:05:47.470861 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74435316-21a7-49cd-bedd-93bbbf6de8b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:05:47.471143 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74435316-21a7-49cd-bedd-93bbbf6de8b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:05:47.471417 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74435316-21a7-49cd-bedd-93bbbf6de8b0 admin admin] PATH_INFO: `/v3/users/4d715ce7c98042adb432112376afe023` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:05:47.472588 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74435316-21a7-49cd-bedd-93bbbf6de8b0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4d715ce7c98042adb432112376afe023)` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:05:47.474526 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74435316-21a7-49cd-bedd-93bbbf6de8b0 admin admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:05:47.520435 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-74435316-21a7-49cd-bedd-93bbbf6de8b0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4d715ce7c98042adb432112376afe023'} {{(pid=86656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:05:47.527558 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-74435316-21a7-49cd-bedd-93bbbf6de8b0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4d715ce7c98042adb432112376afe023'} {{(pid=86656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:05:47.528254 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-74435316-21a7-49cd-bedd-93bbbf6de8b0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4d715ce7c98042adb432112376afe023'} {{(pid=86656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:05:47.535087 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-74435316-21a7-49cd-bedd-93bbbf6de8b0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4d715ce7c98042adb432112376afe023'} {{(pid=86656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:05:47.535713 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-74435316-21a7-49cd-bedd-93bbbf6de8b0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4d715ce7c98042adb432112376afe023'} {{(pid=86656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:05:47.552636 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 1317/2645] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Jul 14 11:05:47 2022] DELETE /identity/v3/users/4d715ce7c98042adb432112376afe023 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:05:47.726399 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a14e2df-c582-4659-be39-62ef9be36940 service neutron] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:05:47.740878 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a14e2df-c582-4659-be39-62ef9be36940 service neutron] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:05:47.800499 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38cc180d-9ec3-4942-b305-5ff4e61db5f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:05:47.801411 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cc180d-9ec3-4942-b305-5ff4e61db5f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:05:47.801700 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cc180d-9ec3-4942-b305-5ff4e61db5f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:05:47.801982 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cc180d-9ec3-4942-b305-5ff4e61db5f4 admin admin] PATH_INFO: `/v3/projects/56309a04e27d451eaa484f3210966b57` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:05:47.803176 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38cc180d-9ec3-4942-b305-5ff4e61db5f4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=56309a04e27d451eaa484f3210966b57)` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:05:47.805154 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38cc180d-9ec3-4942-b305-5ff4e61db5f4 admin admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:05:47.850409 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-38cc180d-9ec3-4942-b305-5ff4e61db5f4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '56309a04e27d451eaa484f3210966b57', 'request_id': 'req-38cc180d-9ec3-4942-b305-5ff4e61db5f4'} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:05:47.856282 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-38cc180d-9ec3-4942-b305-5ff4e61db5f4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '56309a04e27d451eaa484f3210966b57', 'request_id': 'req-38cc180d-9ec3-4942-b305-5ff4e61db5f4'} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:05:47.862791 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-38cc180d-9ec3-4942-b305-5ff4e61db5f4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '56309a04e27d451eaa484f3210966b57', 'request_id': 'req-38cc180d-9ec3-4942-b305-5ff4e61db5f4'} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:05:47.874567 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-38cc180d-9ec3-4942-b305-5ff4e61db5f4 admin admin] The token cache is being invalidate because project 56309a04e27d451eaa484f3210966b57 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86655) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 11:05:47.874860 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-38cc180d-9ec3-4942-b305-5ff4e61db5f4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:05:47.875496 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-38cc180d-9ec3-4942-b305-5ff4e61db5f4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:05:47.877332 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 1329/2646] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Jul 14 11:05:47 2022] DELETE /identity/v3/projects/56309a04e27d451eaa484f3210966b57 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:05:47.882068 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ef1582-d4e9-44a4-9615-ad684a1eaf32 None None] REQUEST_METHOD: `POST` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:05:47.882364 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ef1582-d4e9-44a4-9615-ad684a1eaf32 None None] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:05:47.882650 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ef1582-d4e9-44a4-9615-ad684a1eaf32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:05:47.900421 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.auth.core [None req-22ef1582-d4e9-44a4-9615-ad684a1eaf32 None None] MFA Rules not processed for user `ae4bcdd8106d4bebbdcae96be33505bc`. Rule list: `[]` (Enabled: `True`). {{(pid=86656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:05:47.901677 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-22ef1582-d4e9-44a4-9615-ad684a1eaf32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:05:47.961916 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 1318/2647] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jul 14 11:05:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:05:47.970062 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc4399f-1d52-4e37-9b4c-8974e52684b5 None None] REQUEST_METHOD: `POST` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:05:47.970290 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc4399f-1d52-4e37-9b4c-8974e52684b5 None None] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:05:47.970569 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc4399f-1d52-4e37-9b4c-8974e52684b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:05:47.989578 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.auth.core [None req-0bc4399f-1d52-4e37-9b4c-8974e52684b5 None None] MFA Rules not processed for user `ae4bcdd8106d4bebbdcae96be33505bc`. Rule list: `[]` (Enabled: `True`). {{(pid=86655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:05:47.990776 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-0bc4399f-1d52-4e37-9b4c-8974e52684b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:05:47.999337 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 1330/2648] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jul 14 11:05:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:05:48.003614 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ef1582-d4e9-44a4-9615-ad684a1eaf32 None None] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:05:48.013340 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ef1582-d4e9-44a4-9615-ad684a1eaf32 None None] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:05:48.017892 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fdc53c-5ff6-4a23-8c03-10362de57abb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:05:48.018548 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fdc53c-5ff6-4a23-8c03-10362de57abb admin admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:05:48.018833 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fdc53c-5ff6-4a23-8c03-10362de57abb admin admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:05:48.019110 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fdc53c-5ff6-4a23-8c03-10362de57abb admin admin] PATH_INFO: `/v3/domains` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:05:48.019836 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7fdc53c-5ff6-4a23-8c03-10362de57abb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:05:48.020143 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7fdc53c-5ff6-4a23-8c03-10362de57abb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:05:48.021773 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7fdc53c-5ff6-4a23-8c03-10362de57abb admin admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:05:48.033094 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 1319/2649] 10.222.0.16 () {58 vars in 1152 bytes} [Thu Jul 14 11:05:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:05:48.037205 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc4399f-1d52-4e37-9b4c-8974e52684b5 None None] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:05:48.046897 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc4399f-1d52-4e37-9b4c-8974e52684b5 None None] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:05:48.051471 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8600d707-9437-497c-9034-a2252c6a708c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:05:48.052113 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8600d707-9437-497c-9034-a2252c6a708c admin admin] REQUEST_METHOD: `POST` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:05:48.052396 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8600d707-9437-497c-9034-a2252c6a708c admin admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:05:48.052672 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8600d707-9437-497c-9034-a2252c6a708c admin admin] PATH_INFO: `/v3/projects` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:05:48.053394 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8600d707-9437-497c-9034-a2252c6a708c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:05:48.055318 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8600d707-9437-497c-9034-a2252c6a708c admin admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:05:48.081012 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 1331/2650] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Jul 14 11:05:48 2022] POST /identity/v3/projects => generated 403 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 11:05:48.085090 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fdc53c-5ff6-4a23-8c03-10362de57abb admin admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:05:48.095487 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fdc53c-5ff6-4a23-8c03-10362de57abb admin admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:05:48.149924 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9181ecd1-6ac0-4731-b833-4fed0c96e6b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:05:48.150593 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9181ecd1-6ac0-4731-b833-4fed0c96e6b1 admin admin] REQUEST_METHOD: `POST` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:05:48.150880 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9181ecd1-6ac0-4731-b833-4fed0c96e6b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:05:48.151711 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9181ecd1-6ac0-4731-b833-4fed0c96e6b1 admin admin] PATH_INFO: `/v3/users` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:05:48.152390 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9181ecd1-6ac0-4731-b833-4fed0c96e6b1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:05:48.154327 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9181ecd1-6ac0-4731-b833-4fed0c96e6b1 admin admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:05:48.160766 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:05:48.176007 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 1320/2651] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Jul 14 11:05:48 2022] POST /identity/v3/users => generated 302 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 11:05:48.180198 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8600d707-9437-497c-9034-a2252c6a708c admin admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:05:48.191135 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8600d707-9437-497c-9034-a2252c6a708c admin admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:05:48.195970 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6f4e4c-5aed-4f7f-a5e5-d44b505adde8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:05:48.196631 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6f4e4c-5aed-4f7f-a5e5-d44b505adde8 admin admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:05:48.196955 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6f4e4c-5aed-4f7f-a5e5-d44b505adde8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:05:48.197237 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6f4e4c-5aed-4f7f-a5e5-d44b505adde8 admin admin] PATH_INFO: `/v3/roles` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:05:48.198583 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6f4e4c-5aed-4f7f-a5e5-d44b505adde8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:05:48.200337 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6f4e4c-5aed-4f7f-a5e5-d44b505adde8 admin admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:05:48.210708 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 1332/2652] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jul 14 11:05:48 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 11:05:48.214641 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9181ecd1-6ac0-4731-b833-4fed0c96e6b1 admin admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:05:48.224459 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9181ecd1-6ac0-4731-b833-4fed0c96e6b1 admin admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:05:48.228996 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6bcb6b-ec75-437f-b01c-be37f7f11d36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:05:48.229670 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6bcb6b-ec75-437f-b01c-be37f7f11d36 admin admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:05:48.229949 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6bcb6b-ec75-437f-b01c-be37f7f11d36 admin admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:05:48.230224 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6bcb6b-ec75-437f-b01c-be37f7f11d36 admin admin] PATH_INFO: `/v3/roles` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:05:48.230943 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6bcb6b-ec75-437f-b01c-be37f7f11d36 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:05:48.232515 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6bcb6b-ec75-437f-b01c-be37f7f11d36 admin admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:05:48.242259 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 1321/2653] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jul 14 11:05:48 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 11:05:48.246821 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6f4e4c-5aed-4f7f-a5e5-d44b505adde8 admin admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:05:48.256717 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6f4e4c-5aed-4f7f-a5e5-d44b505adde8 admin admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:05:48.263500 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b16883e-1b89-4598-bab9-76f597966588 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:05:48.264402 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b16883e-1b89-4598-bab9-76f597966588 admin admin] REQUEST_METHOD: `PUT` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:05:48.264694 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b16883e-1b89-4598-bab9-76f597966588 admin admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:05:48.265015 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b16883e-1b89-4598-bab9-76f597966588 admin admin] PATH_INFO: `/v3/projects/aa54f8aebfa44a9e9109b753738e4b7b/users/fb624d47497742af8a915835429a2bec/roles/0da46c267d354cce81495dfdd56c1ec2` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:05:48.281133 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b16883e-1b89-4598-bab9-76f597966588 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aa54f8aebfa44a9e9109b753738e4b7b, user_id=fb624d47497742af8a915835429a2bec, role_id=0da46c267d354cce81495dfdd56c1ec2)` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:05:48.283792 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b16883e-1b89-4598-bab9-76f597966588 admin admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:05:48.297080 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 1333/2654] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Jul 14 11:05:48 2022] PUT /identity/v3/projects/aa54f8aebfa44a9e9109b753738e4b7b/users/fb624d47497742af8a915835429a2bec/roles/0da46c267d354cce81495dfdd56c1ec2 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:05:48.302151 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ff2de2-6c3f-43e5-b610-ce666994e241 None None] REQUEST_METHOD: `POST` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:05:48.302474 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ff2de2-6c3f-43e5-b610-ce666994e241 None None] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:05:48.302756 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ff2de2-6c3f-43e5-b610-ce666994e241 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:05:48.321024 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.auth.core [None req-f0ff2de2-6c3f-43e5-b610-ce666994e241 None None] MFA Rules not processed for user `ae4bcdd8106d4bebbdcae96be33505bc`. Rule list: `[]` (Enabled: `True`). {{(pid=86656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:05:48.322268 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-f0ff2de2-6c3f-43e5-b610-ce666994e241 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:05:48.381027 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 1322/2655] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jul 14 11:05:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:05:48.391014 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b16883e-1b89-4598-bab9-76f597966588 admin admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:05:48.392712 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-8b16883e-1b89-4598-bab9-76f597966588 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:05:48.406843 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:05:48.451838 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b16883e-1b89-4598-bab9-76f597966588 admin admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:05:48.455417 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e22174-f86c-4cd9-b2be-53b896af1496 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dddf93691844886982c91fea974385d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59391272ecbe48b0aa736cb43807be1d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:05:48.456081 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e22174-f86c-4cd9-b2be-53b896af1496 service neutron] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:05:48.456365 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e22174-f86c-4cd9-b2be-53b896af1496 service neutron] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:05:48.456642 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e22174-f86c-4cd9-b2be-53b896af1496 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:05:48.465883 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e22174-f86c-4cd9-b2be-53b896af1496 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:05:48.467308 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e22174-f86c-4cd9-b2be-53b896af1496 service neutron] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:05:48.476897 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 1334/2656] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jul 14 11:05:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 11:05:49.094923 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9eaebf3-65ca-4e95-8d3f-cef8d1d6accd None None] REQUEST_METHOD: `POST` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:05:49.095427 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9eaebf3-65ca-4e95-8d3f-cef8d1d6accd None None] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:05:49.095629 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9eaebf3-65ca-4e95-8d3f-cef8d1d6accd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:05:49.122817 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.auth.core [None req-c9eaebf3-65ca-4e95-8d3f-cef8d1d6accd None None] MFA Rules not processed for user `fb624d47497742af8a915835429a2bec`. Rule list: `[]` (Enabled: `True`). {{(pid=86656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:05:49.124063 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-c9eaebf3-65ca-4e95-8d3f-cef8d1d6accd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:05:49.191337 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 1323/2657] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jul 14 11:05:49 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:05:49.196034 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e22174-f86c-4cd9-b2be-53b896af1496 service neutron] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:05:49.206670 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e22174-f86c-4cd9-b2be-53b896af1496 service neutron] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:05:49.211294 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d28d77a-c3b6-41a0-a161-843a73d32bd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:05:49.211959 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d28d77a-c3b6-41a0-a161-843a73d32bd5 admin admin] REQUEST_METHOD: `POST` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:05:49.212249 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d28d77a-c3b6-41a0-a161-843a73d32bd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:05:49.212579 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d28d77a-c3b6-41a0-a161-843a73d32bd5 admin admin] PATH_INFO: `/v3/projects` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:05:49.213323 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d28d77a-c3b6-41a0-a161-843a73d32bd5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:05:49.215516 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d28d77a-c3b6-41a0-a161-843a73d32bd5 admin admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:05:49.243309 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 1335/2658] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Jul 14 11:05:49 2022] POST /identity/v3/projects => generated 405 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 11:05:49.247420 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9eaebf3-65ca-4e95-8d3f-cef8d1d6accd None None] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:05:49.258224 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9eaebf3-65ca-4e95-8d3f-cef8d1d6accd None None] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:05:49.319420 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2442ca-39ac-4640-83c0-596f3732ab47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:05:49.320104 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2442ca-39ac-4640-83c0-596f3732ab47 admin admin] REQUEST_METHOD: `POST` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:05:49.320392 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2442ca-39ac-4640-83c0-596f3732ab47 admin admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:05:49.320975 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2442ca-39ac-4640-83c0-596f3732ab47 admin admin] PATH_INFO: `/v3/users` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:05:49.321680 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2442ca-39ac-4640-83c0-596f3732ab47 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:05:49.324122 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2442ca-39ac-4640-83c0-596f3732ab47 admin admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:05:49.338091 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:INSERT=6,keystone:SELECT=94 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:05:49.344811 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 1324/2659] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Jul 14 11:05:49 2022] POST /identity/v3/users => generated 309 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 11:05:49.348976 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d28d77a-c3b6-41a0-a161-843a73d32bd5 admin admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:05:49.366535 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d28d77a-c3b6-41a0-a161-843a73d32bd5 admin admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:05:49.372335 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1cae49-c3d0-46e1-83b4-ba9165a40f0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:05:49.373049 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1cae49-c3d0-46e1-83b4-ba9165a40f0d admin admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:05:49.373331 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1cae49-c3d0-46e1-83b4-ba9165a40f0d admin admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:05:49.373608 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1cae49-c3d0-46e1-83b4-ba9165a40f0d admin admin] PATH_INFO: `/v3/roles` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:05:49.374345 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1cae49-c3d0-46e1-83b4-ba9165a40f0d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:05:49.375951 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1cae49-c3d0-46e1-83b4-ba9165a40f0d admin admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:05:49.388796 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 1336/2660] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jul 14 11:05:49 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 11:05:49.393092 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2442ca-39ac-4640-83c0-596f3732ab47 admin admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:05:49.403865 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2442ca-39ac-4640-83c0-596f3732ab47 admin admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:05:49.408492 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3cac0f7-24d4-4d2d-90a0-53fd97a05a92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:05:49.409397 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cac0f7-24d4-4d2d-90a0-53fd97a05a92 admin admin] REQUEST_METHOD: `PUT` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:05:49.409683 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cac0f7-24d4-4d2d-90a0-53fd97a05a92 admin admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:05:49.409961 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cac0f7-24d4-4d2d-90a0-53fd97a05a92 admin admin] PATH_INFO: `/v3/projects/3b9a2cedf4e144228f19d052581432a1/users/dccacbd6fb3746019e79ab20a08a480c/roles/153539819e5542df99269d2913bbecfb` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:05:49.425338 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3cac0f7-24d4-4d2d-90a0-53fd97a05a92 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3b9a2cedf4e144228f19d052581432a1, user_id=dccacbd6fb3746019e79ab20a08a480c, role_id=153539819e5542df99269d2913bbecfb)` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:05:49.428047 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3cac0f7-24d4-4d2d-90a0-53fd97a05a92 admin admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:05:49.441248 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 1325/2661] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Jul 14 11:05:49 2022] PUT /identity/v3/projects/3b9a2cedf4e144228f19d052581432a1/users/dccacbd6fb3746019e79ab20a08a480c/roles/153539819e5542df99269d2913bbecfb => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:05:49.445259 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1cae49-c3d0-46e1-83b4-ba9165a40f0d admin admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:05:49.455851 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1cae49-c3d0-46e1-83b4-ba9165a40f0d admin admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:05:49.520308 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202859ae-3911-4217-8ba2-c6b4b179b560 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:05:49.520933 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202859ae-3911-4217-8ba2-c6b4b179b560 admin admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:05:49.521220 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202859ae-3911-4217-8ba2-c6b4b179b560 admin admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:05:49.521503 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202859ae-3911-4217-8ba2-c6b4b179b560 admin admin] PATH_INFO: `/v3/roles` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:05:49.522272 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202859ae-3911-4217-8ba2-c6b4b179b560 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:05:49.523876 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202859ae-3911-4217-8ba2-c6b4b179b560 admin admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:05:49.535330 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 1337/2662] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jul 14 11:05:49 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 11:05:49.539733 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3cac0f7-24d4-4d2d-90a0-53fd97a05a92 admin admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:05:49.550396 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3cac0f7-24d4-4d2d-90a0-53fd97a05a92 admin admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:05:49.555802 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9af3a8d-8a6a-4927-88c5-5f2f0b09cc3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:05:49.556724 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9af3a8d-8a6a-4927-88c5-5f2f0b09cc3a admin admin] REQUEST_METHOD: `PUT` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:05:49.557033 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9af3a8d-8a6a-4927-88c5-5f2f0b09cc3a admin admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:05:49.557348 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9af3a8d-8a6a-4927-88c5-5f2f0b09cc3a admin admin] PATH_INFO: `/v3/projects/3b9a2cedf4e144228f19d052581432a1/users/dccacbd6fb3746019e79ab20a08a480c/roles/153539819e5542df99269d2913bbecfb` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:05:49.559546 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9af3a8d-8a6a-4927-88c5-5f2f0b09cc3a admin admin] RBAC: Authorizing `identity:create_grant(project_id=3b9a2cedf4e144228f19d052581432a1, user_id=dccacbd6fb3746019e79ab20a08a480c, role_id=153539819e5542df99269d2913bbecfb)` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:05:49.562475 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9af3a8d-8a6a-4927-88c5-5f2f0b09cc3a admin admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:05:49.575113 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 1326/2663] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Jul 14 11:05:49 2022] PUT /identity/v3/projects/3b9a2cedf4e144228f19d052581432a1/users/dccacbd6fb3746019e79ab20a08a480c/roles/153539819e5542df99269d2913bbecfb => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:05:50.193188 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5217d1cc-f32f-45c1-83df-34c437ab04c3 None None] REQUEST_METHOD: `POST` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:05:50.193472 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5217d1cc-f32f-45c1-83df-34c437ab04c3 None None] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:05:50.193772 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5217d1cc-f32f-45c1-83df-34c437ab04c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:05:50.239702 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.auth.core [None req-5217d1cc-f32f-45c1-83df-34c437ab04c3 None None] MFA Rules not processed for user `dccacbd6fb3746019e79ab20a08a480c`. Rule list: `[]` (Enabled: `True`). {{(pid=86655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:05:50.241064 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-5217d1cc-f32f-45c1-83df-34c437ab04c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:05:50.329536 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 1338/2664] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jul 14 11:05:50 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 11:05:51.313581 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9af3a8d-8a6a-4927-88c5-5f2f0b09cc3a admin admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:05:51.315360 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-e9af3a8d-8a6a-4927-88c5-5f2f0b09cc3a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:05:51.371019 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5217d1cc-f32f-45c1-83df-34c437ab04c3 None None] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:05:51.378100 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:05:51.391621 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9af3a8d-8a6a-4927-88c5-5f2f0b09cc3a admin admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:05:51.396719 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c772cc63-bd01-4f21-886e-8e8296b87cef service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16846111ee2a42dd99c3052d40980f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59391272ecbe48b0aa736cb43807be1d', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:05:51.397410 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c772cc63-bd01-4f21-886e-8e8296b87cef service placement] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:05:51.397695 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c772cc63-bd01-4f21-886e-8e8296b87cef service placement] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:05:51.397975 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c772cc63-bd01-4f21-886e-8e8296b87cef service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:05:51.399732 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-c772cc63-bd01-4f21-886e-8e8296b87cef service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:05:51.412566 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c772cc63-bd01-4f21-886e-8e8296b87cef service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:05:51.414196 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c772cc63-bd01-4f21-886e-8e8296b87cef service placement] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:05:51.424851 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 1327/2665] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jul 14 11:05:51 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 11:05:51.444620 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5217d1cc-f32f-45c1-83df-34c437ab04c3 None None] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:05:51.450243 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f4ecf5-3c3e-4ecd-89cd-919519c9a1ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:05:51.451154 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f4ecf5-3c3e-4ecd-89cd-919519c9a1ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:05:51.451445 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f4ecf5-3c3e-4ecd-89cd-919519c9a1ba admin admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:05:51.451728 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f4ecf5-3c3e-4ecd-89cd-919519c9a1ba admin admin] PATH_INFO: `/v3/users/fb624d47497742af8a915835429a2bec` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:05:51.452973 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f4ecf5-3c3e-4ecd-89cd-919519c9a1ba admin admin] RBAC: Authorizing `identity:delete_user(user_id=fb624d47497742af8a915835429a2bec)` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:05:51.454900 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f4ecf5-3c3e-4ecd-89cd-919519c9a1ba admin admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:05:51.502358 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-b0f4ecf5-3c3e-4ecd-89cd-919519c9a1ba admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fb624d47497742af8a915835429a2bec'} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:05:51.509286 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-b0f4ecf5-3c3e-4ecd-89cd-919519c9a1ba admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fb624d47497742af8a915835429a2bec'} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:05:51.509904 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-b0f4ecf5-3c3e-4ecd-89cd-919519c9a1ba admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fb624d47497742af8a915835429a2bec'} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:05:51.517196 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-b0f4ecf5-3c3e-4ecd-89cd-919519c9a1ba admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fb624d47497742af8a915835429a2bec'} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:05:51.517848 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-b0f4ecf5-3c3e-4ecd-89cd-919519c9a1ba admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fb624d47497742af8a915835429a2bec'} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:05:51.534870 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 1339/2666] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Jul 14 11:05:51 2022] DELETE /identity/v3/users/fb624d47497742af8a915835429a2bec => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:05:51.715278 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c772cc63-bd01-4f21-886e-8e8296b87cef service placement] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:05:51.727705 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c772cc63-bd01-4f21-886e-8e8296b87cef service placement] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:05:51.794634 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8f714b-913b-4772-88f9-8d84b1be7614 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:05:51.795682 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8f714b-913b-4772-88f9-8d84b1be7614 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:05:51.795991 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8f714b-913b-4772-88f9-8d84b1be7614 admin admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:05:51.796275 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8f714b-913b-4772-88f9-8d84b1be7614 admin admin] PATH_INFO: `/v3/projects/aa54f8aebfa44a9e9109b753738e4b7b` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:05:51.797536 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8f714b-913b-4772-88f9-8d84b1be7614 admin admin] RBAC: Authorizing `identity:delete_project(project_id=aa54f8aebfa44a9e9109b753738e4b7b)` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:05:51.799458 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8f714b-913b-4772-88f9-8d84b1be7614 admin admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:05:51.848840 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-2d8f714b-913b-4772-88f9-8d84b1be7614 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aa54f8aebfa44a9e9109b753738e4b7b', 'request_id': 'req-2d8f714b-913b-4772-88f9-8d84b1be7614'} {{(pid=86656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:05:51.851303 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=93,keystone:INSERT=3,keystone:DELETE=4 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:05:51.856924 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-2d8f714b-913b-4772-88f9-8d84b1be7614 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aa54f8aebfa44a9e9109b753738e4b7b', 'request_id': 'req-2d8f714b-913b-4772-88f9-8d84b1be7614'} {{(pid=86656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:05:51.864731 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-2d8f714b-913b-4772-88f9-8d84b1be7614 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aa54f8aebfa44a9e9109b753738e4b7b', 'request_id': 'req-2d8f714b-913b-4772-88f9-8d84b1be7614'} {{(pid=86656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:05:51.875687 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-2d8f714b-913b-4772-88f9-8d84b1be7614 admin admin] The token cache is being invalidate because project aa54f8aebfa44a9e9109b753738e4b7b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86656) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 11:05:51.875920 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-2d8f714b-913b-4772-88f9-8d84b1be7614 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:05:51.876671 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-2d8f714b-913b-4772-88f9-8d84b1be7614 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:05:51.878267 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 1328/2667] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Jul 14 11:05:51 2022] DELETE /identity/v3/projects/aa54f8aebfa44a9e9109b753738e4b7b => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:05:51.882251 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f4ecf5-3c3e-4ecd-89cd-919519c9a1ba admin admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:05:51.883700 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-b0f4ecf5-3c3e-4ecd-89cd-919519c9a1ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:05:51.896991 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f4ecf5-3c3e-4ecd-89cd-919519c9a1ba admin admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:05:51.953994 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6d9afd-e10e-4d76-9025-6521b7a7cd1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:05:51.954861 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6d9afd-e10e-4d76-9025-6521b7a7cd1b admin admin] REQUEST_METHOD: `DELETE` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:05:51.955145 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6d9afd-e10e-4d76-9025-6521b7a7cd1b admin admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:05:51.955419 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6d9afd-e10e-4d76-9025-6521b7a7cd1b admin admin] PATH_INFO: `/v3/users/dccacbd6fb3746019e79ab20a08a480c` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:05:51.956622 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6d9afd-e10e-4d76-9025-6521b7a7cd1b admin admin] RBAC: Authorizing `identity:delete_user(user_id=dccacbd6fb3746019e79ab20a08a480c)` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:05:51.958567 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6d9afd-e10e-4d76-9025-6521b7a7cd1b admin admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:05:51.985873 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:05:52.006036 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-4c6d9afd-e10e-4d76-9025-6521b7a7cd1b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dccacbd6fb3746019e79ab20a08a480c'} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:05:52.013736 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-4c6d9afd-e10e-4d76-9025-6521b7a7cd1b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dccacbd6fb3746019e79ab20a08a480c'} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:05:52.014369 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-4c6d9afd-e10e-4d76-9025-6521b7a7cd1b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dccacbd6fb3746019e79ab20a08a480c'} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:05:52.021807 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-4c6d9afd-e10e-4d76-9025-6521b7a7cd1b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dccacbd6fb3746019e79ab20a08a480c'} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:05:52.022455 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-4c6d9afd-e10e-4d76-9025-6521b7a7cd1b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dccacbd6fb3746019e79ab20a08a480c'} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:05:52.040426 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 1340/2668] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Jul 14 11:05:51 2022] DELETE /identity/v3/users/dccacbd6fb3746019e79ab20a08a480c => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:05:52.212689 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8f714b-913b-4772-88f9-8d84b1be7614 admin admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:05:52.214839 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-2d8f714b-913b-4772-88f9-8d84b1be7614 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:05:52.228085 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8f714b-913b-4772-88f9-8d84b1be7614 admin admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:05:52.285348 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc72f15f-319c-4549-930c-8eef78496604 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:05:52.286209 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc72f15f-319c-4549-930c-8eef78496604 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:05:52.286489 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc72f15f-319c-4549-930c-8eef78496604 admin admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:05:52.286762 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc72f15f-319c-4549-930c-8eef78496604 admin admin] PATH_INFO: `/v3/projects/3b9a2cedf4e144228f19d052581432a1` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:05:52.287931 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc72f15f-319c-4549-930c-8eef78496604 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3b9a2cedf4e144228f19d052581432a1)` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:05:52.289860 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc72f15f-319c-4549-930c-8eef78496604 admin admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:05:52.333891 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-dc72f15f-319c-4549-930c-8eef78496604 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3b9a2cedf4e144228f19d052581432a1', 'request_id': 'req-dc72f15f-319c-4549-930c-8eef78496604'} {{(pid=86656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:05:52.342379 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-dc72f15f-319c-4549-930c-8eef78496604 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3b9a2cedf4e144228f19d052581432a1', 'request_id': 'req-dc72f15f-319c-4549-930c-8eef78496604'} {{(pid=86656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:05:52.348636 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-dc72f15f-319c-4549-930c-8eef78496604 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3b9a2cedf4e144228f19d052581432a1', 'request_id': 'req-dc72f15f-319c-4549-930c-8eef78496604'} {{(pid=86656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:05:52.359013 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-dc72f15f-319c-4549-930c-8eef78496604 admin admin] The token cache is being invalidate because project 3b9a2cedf4e144228f19d052581432a1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86656) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 11:05:52.359300 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-dc72f15f-319c-4549-930c-8eef78496604 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:05:52.359924 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-dc72f15f-319c-4549-930c-8eef78496604 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:05:52.361472 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 1329/2669] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Jul 14 11:05:52 2022] DELETE /identity/v3/projects/3b9a2cedf4e144228f19d052581432a1 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:05:52.367042 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cb2b5f-6aab-4ad3-9a30-2c7027a551a9 None None] REQUEST_METHOD: `POST` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:05:52.367417 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cb2b5f-6aab-4ad3-9a30-2c7027a551a9 None None] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:05:52.367765 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cb2b5f-6aab-4ad3-9a30-2c7027a551a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:05:52.385228 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.auth.core [None req-30cb2b5f-6aab-4ad3-9a30-2c7027a551a9 None None] MFA Rules not processed for user `ae4bcdd8106d4bebbdcae96be33505bc`. Rule list: `[]` (Enabled: `True`). {{(pid=86655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:05:52.387143 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-30cb2b5f-6aab-4ad3-9a30-2c7027a551a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:05:52.444149 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 1341/2670] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jul 14 11:05:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:05:52.452657 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e2d079-57fe-44a5-b04c-24ee14517733 None None] REQUEST_METHOD: `POST` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:05:52.452979 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e2d079-57fe-44a5-b04c-24ee14517733 None None] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:05:52.453263 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e2d079-57fe-44a5-b04c-24ee14517733 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:05:52.471512 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.auth.core [None req-e7e2d079-57fe-44a5-b04c-24ee14517733 None None] MFA Rules not processed for user `ae4bcdd8106d4bebbdcae96be33505bc`. Rule list: `[]` (Enabled: `True`). {{(pid=86656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:05:52.472716 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-e7e2d079-57fe-44a5-b04c-24ee14517733 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:05:52.480692 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 1330/2671] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jul 14 11:05:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:05:52.484586 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cb2b5f-6aab-4ad3-9a30-2c7027a551a9 None None] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:05:52.494167 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cb2b5f-6aab-4ad3-9a30-2c7027a551a9 None None] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:05:52.498831 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a046708d-61c1-4716-82fa-1a5a3ca07282 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:05:52.499481 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a046708d-61c1-4716-82fa-1a5a3ca07282 admin admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:05:52.499781 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a046708d-61c1-4716-82fa-1a5a3ca07282 admin admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:05:52.500038 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a046708d-61c1-4716-82fa-1a5a3ca07282 admin admin] PATH_INFO: `/v3/domains` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:05:52.500766 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a046708d-61c1-4716-82fa-1a5a3ca07282 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:05:52.501107 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a046708d-61c1-4716-82fa-1a5a3ca07282 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:05:52.502687 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a046708d-61c1-4716-82fa-1a5a3ca07282 admin admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:05:52.514693 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 1342/2672] 10.222.0.16 () {58 vars in 1152 bytes} [Thu Jul 14 11:05:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:05:52.518823 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e2d079-57fe-44a5-b04c-24ee14517733 None None] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:05:52.528426 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e2d079-57fe-44a5-b04c-24ee14517733 None None] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:05:52.532964 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab748e2-dc0b-4ec2-8dc4-33e4f0530a88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:05:52.533606 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab748e2-dc0b-4ec2-8dc4-33e4f0530a88 admin admin] REQUEST_METHOD: `POST` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:05:52.533889 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab748e2-dc0b-4ec2-8dc4-33e4f0530a88 admin admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:05:52.534163 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab748e2-dc0b-4ec2-8dc4-33e4f0530a88 admin admin] PATH_INFO: `/v3/projects` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:05:52.534857 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab748e2-dc0b-4ec2-8dc4-33e4f0530a88 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:05:52.536738 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab748e2-dc0b-4ec2-8dc4-33e4f0530a88 admin admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:05:52.560874 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 1331/2673] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Jul 14 11:05:52 2022] POST /identity/v3/projects => generated 365 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 11:05:52.565077 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a046708d-61c1-4716-82fa-1a5a3ca07282 admin admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:05:52.575919 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a046708d-61c1-4716-82fa-1a5a3ca07282 admin admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:05:52.631846 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ffd782-0fe2-4ebc-8b68-4470a0a42bdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:05:52.632514 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ffd782-0fe2-4ebc-8b68-4470a0a42bdb admin admin] REQUEST_METHOD: `POST` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:05:52.632825 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ffd782-0fe2-4ebc-8b68-4470a0a42bdb admin admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:05:52.633111 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ffd782-0fe2-4ebc-8b68-4470a0a42bdb admin admin] PATH_INFO: `/v3/users` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:05:52.633823 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ffd782-0fe2-4ebc-8b68-4470a0a42bdb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:05:52.636425 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ffd782-0fe2-4ebc-8b68-4470a0a42bdb admin admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:05:52.655841 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 1343/2674] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Jul 14 11:05:52 2022] POST /identity/v3/users => generated 283 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 11:05:52.659755 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab748e2-dc0b-4ec2-8dc4-33e4f0530a88 admin admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:05:52.670381 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab748e2-dc0b-4ec2-8dc4-33e4f0530a88 admin admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:05:52.675119 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdfa971-49ae-4bad-b86e-1415b3b479c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:05:52.675851 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdfa971-49ae-4bad-b86e-1415b3b479c4 admin admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:05:52.676134 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdfa971-49ae-4bad-b86e-1415b3b479c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:05:52.676411 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdfa971-49ae-4bad-b86e-1415b3b479c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:05:52.677249 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cdfa971-49ae-4bad-b86e-1415b3b479c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:05:52.678893 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cdfa971-49ae-4bad-b86e-1415b3b479c4 admin admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:05:52.690274 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 1332/2675] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jul 14 11:05:52 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 11:05:52.694250 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ffd782-0fe2-4ebc-8b68-4470a0a42bdb admin admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:05:52.705169 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ffd782-0fe2-4ebc-8b68-4470a0a42bdb admin admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:05:52.709749 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8d52fb-fcec-4ab0-adee-0d3833224706 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:05:52.710403 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8d52fb-fcec-4ab0-adee-0d3833224706 admin admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:05:52.710707 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8d52fb-fcec-4ab0-adee-0d3833224706 admin admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:05:52.710968 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8d52fb-fcec-4ab0-adee-0d3833224706 admin admin] PATH_INFO: `/v3/roles` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:05:52.711696 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8d52fb-fcec-4ab0-adee-0d3833224706 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:05:52.713308 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8d52fb-fcec-4ab0-adee-0d3833224706 admin admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:05:52.723088 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 1344/2676] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jul 14 11:05:52 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 11:05:52.726969 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdfa971-49ae-4bad-b86e-1415b3b479c4 admin admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:05:52.736997 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdfa971-49ae-4bad-b86e-1415b3b479c4 admin admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:05:52.741563 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63af3e4-a821-445b-ad56-b83c18ec1104 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:05:52.742424 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63af3e4-a821-445b-ad56-b83c18ec1104 admin admin] REQUEST_METHOD: `PUT` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:05:52.742711 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63af3e4-a821-445b-ad56-b83c18ec1104 admin admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:05:52.742989 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63af3e4-a821-445b-ad56-b83c18ec1104 admin admin] PATH_INFO: `/v3/projects/ecd3ae72434a45cdbfb0f5be972ce64f/users/70066d58a2f3420983bb2dd94dbbdfec/roles/0da46c267d354cce81495dfdd56c1ec2` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:05:52.758177 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63af3e4-a821-445b-ad56-b83c18ec1104 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ecd3ae72434a45cdbfb0f5be972ce64f, user_id=70066d58a2f3420983bb2dd94dbbdfec, role_id=0da46c267d354cce81495dfdd56c1ec2)` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:05:52.761604 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63af3e4-a821-445b-ad56-b83c18ec1104 admin admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:05:52.774536 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 1333/2677] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Jul 14 11:05:52 2022] PUT /identity/v3/projects/ecd3ae72434a45cdbfb0f5be972ce64f/users/70066d58a2f3420983bb2dd94dbbdfec/roles/0da46c267d354cce81495dfdd56c1ec2 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:05:52.785075 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce95f8a9-764e-406b-8ba8-19866ace34cf None None] REQUEST_METHOD: `POST` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:05:52.785370 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce95f8a9-764e-406b-8ba8-19866ace34cf None None] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:05:52.785652 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce95f8a9-764e-406b-8ba8-19866ace34cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:05:52.804686 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:05:52.815577 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.auth.core [None req-ce95f8a9-764e-406b-8ba8-19866ace34cf None None] MFA Rules not processed for user `70066d58a2f3420983bb2dd94dbbdfec`. Rule list: `[]` (Enabled: `True`). {{(pid=86655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:05:52.817448 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-ce95f8a9-764e-406b-8ba8-19866ace34cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:05:52.892039 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 1345/2678] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jul 14 11:05:52 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:05:52.893454 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63af3e4-a821-445b-ad56-b83c18ec1104 admin admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:05:52.902584 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:DELETE=10,keystone:SELECT=87,keystone:INSERT=3 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:05:52.960322 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63af3e4-a821-445b-ad56-b83c18ec1104 admin admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:05:52.965255 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1323cd1-2287-464b-b8ea-f0106d325a40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:05:52.965926 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1323cd1-2287-464b-b8ea-f0106d325a40 admin admin] REQUEST_METHOD: `POST` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:05:52.966213 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1323cd1-2287-464b-b8ea-f0106d325a40 admin admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:05:52.966493 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1323cd1-2287-464b-b8ea-f0106d325a40 admin admin] PATH_INFO: `/v3/projects` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:05:52.967197 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1323cd1-2287-464b-b8ea-f0106d325a40 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:05:52.969194 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1323cd1-2287-464b-b8ea-f0106d325a40 admin admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:05:52.998166 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 1334/2679] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Jul 14 11:05:52 2022] POST /identity/v3/projects => generated 365 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 11:05:53.002219 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce95f8a9-764e-406b-8ba8-19866ace34cf None None] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:05:53.012914 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce95f8a9-764e-406b-8ba8-19866ace34cf None None] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:05:53.068301 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea575626-b41c-4e04-b1b4-892cbbdd69bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:05:53.069002 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea575626-b41c-4e04-b1b4-892cbbdd69bb admin admin] REQUEST_METHOD: `POST` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:05:53.069289 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea575626-b41c-4e04-b1b4-892cbbdd69bb admin admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:05:53.069581 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea575626-b41c-4e04-b1b4-892cbbdd69bb admin admin] PATH_INFO: `/v3/users` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:05:53.070269 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea575626-b41c-4e04-b1b4-892cbbdd69bb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:05:53.072433 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea575626-b41c-4e04-b1b4-892cbbdd69bb admin admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:05:53.091217 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 1346/2680] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Jul 14 11:05:53 2022] POST /identity/v3/users => generated 289 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 11:05:53.095119 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1323cd1-2287-464b-b8ea-f0106d325a40 admin admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:05:53.106252 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1323cd1-2287-464b-b8ea-f0106d325a40 admin admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:05:53.110835 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d517d32c-d15e-4bb5-974c-8f4e22b2f149 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:05:53.111486 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d517d32c-d15e-4bb5-974c-8f4e22b2f149 admin admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:05:53.111767 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d517d32c-d15e-4bb5-974c-8f4e22b2f149 admin admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:05:53.112043 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d517d32c-d15e-4bb5-974c-8f4e22b2f149 admin admin] PATH_INFO: `/v3/roles` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:05:53.112766 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d517d32c-d15e-4bb5-974c-8f4e22b2f149 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:05:53.114378 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d517d32c-d15e-4bb5-974c-8f4e22b2f149 admin admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:05:53.125642 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 1335/2681] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jul 14 11:05:53 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 11:05:53.129747 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea575626-b41c-4e04-b1b4-892cbbdd69bb admin admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:05:53.139700 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea575626-b41c-4e04-b1b4-892cbbdd69bb admin admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:05:53.144315 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a231ab3d-0b19-495b-ae67-cfd5bee93a62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:05:53.145222 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a231ab3d-0b19-495b-ae67-cfd5bee93a62 admin admin] REQUEST_METHOD: `PUT` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:05:53.145510 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a231ab3d-0b19-495b-ae67-cfd5bee93a62 admin admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:05:53.145791 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a231ab3d-0b19-495b-ae67-cfd5bee93a62 admin admin] PATH_INFO: `/v3/projects/cea4944dc820495685c73373cf760835/users/47ecea1b2f6540f6b1b2ad5b63d4604f/roles/153539819e5542df99269d2913bbecfb` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:05:53.161384 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a231ab3d-0b19-495b-ae67-cfd5bee93a62 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cea4944dc820495685c73373cf760835, user_id=47ecea1b2f6540f6b1b2ad5b63d4604f, role_id=153539819e5542df99269d2913bbecfb)` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:05:53.164021 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a231ab3d-0b19-495b-ae67-cfd5bee93a62 admin admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:05:53.177113 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 1347/2682] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Jul 14 11:05:53 2022] PUT /identity/v3/projects/cea4944dc820495685c73373cf760835/users/47ecea1b2f6540f6b1b2ad5b63d4604f/roles/153539819e5542df99269d2913bbecfb => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:05:53.180916 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d517d32c-d15e-4bb5-974c-8f4e22b2f149 admin admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:05:53.191485 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d517d32c-d15e-4bb5-974c-8f4e22b2f149 admin admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:05:53.246903 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf26260-ffa7-490b-abc1-bd6483c63fa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:05:53.247550 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf26260-ffa7-490b-abc1-bd6483c63fa9 admin admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:05:53.247833 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf26260-ffa7-490b-abc1-bd6483c63fa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:05:53.248110 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf26260-ffa7-490b-abc1-bd6483c63fa9 admin admin] PATH_INFO: `/v3/roles` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:05:53.248883 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf26260-ffa7-490b-abc1-bd6483c63fa9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:05:53.250477 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf26260-ffa7-490b-abc1-bd6483c63fa9 admin admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:05:53.260094 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 1336/2683] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jul 14 11:05:53 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 11:05:53.264558 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a231ab3d-0b19-495b-ae67-cfd5bee93a62 admin admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:05:53.274775 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a231ab3d-0b19-495b-ae67-cfd5bee93a62 admin admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:05:53.279576 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f96095-aba7-4fb1-9d17-9a543a5bd4d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:05:53.280458 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f96095-aba7-4fb1-9d17-9a543a5bd4d0 admin admin] REQUEST_METHOD: `PUT` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:05:53.280742 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f96095-aba7-4fb1-9d17-9a543a5bd4d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:05:53.281052 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f96095-aba7-4fb1-9d17-9a543a5bd4d0 admin admin] PATH_INFO: `/v3/projects/cea4944dc820495685c73373cf760835/users/47ecea1b2f6540f6b1b2ad5b63d4604f/roles/153539819e5542df99269d2913bbecfb` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:05:53.283019 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f96095-aba7-4fb1-9d17-9a543a5bd4d0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cea4944dc820495685c73373cf760835, user_id=47ecea1b2f6540f6b1b2ad5b63d4604f, role_id=153539819e5542df99269d2913bbecfb)` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:05:53.285636 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f96095-aba7-4fb1-9d17-9a543a5bd4d0 admin admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:05:53.296227 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 1348/2684] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Jul 14 11:05:53 2022] PUT /identity/v3/projects/cea4944dc820495685c73373cf760835/users/47ecea1b2f6540f6b1b2ad5b63d4604f/roles/153539819e5542df99269d2913bbecfb => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:05:53.307204 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4eca6d9-478b-49e0-be01-ed747f462c2c None None] REQUEST_METHOD: `POST` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:05:53.308086 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4eca6d9-478b-49e0-be01-ed747f462c2c None None] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:05:53.308377 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4eca6d9-478b-49e0-be01-ed747f462c2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:05:53.334553 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.auth.core [None req-c4eca6d9-478b-49e0-be01-ed747f462c2c None None] MFA Rules not processed for user `47ecea1b2f6540f6b1b2ad5b63d4604f`. Rule list: `[]` (Enabled: `True`). {{(pid=86656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:05:53.335768 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-c4eca6d9-478b-49e0-be01-ed747f462c2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:05:53.402881 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 1337/2685] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jul 14 11:05:53 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:05:53.414305 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f96095-aba7-4fb1-9d17-9a543a5bd4d0 admin admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:05:53.416016 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-97f96095-aba7-4fb1-9d17-9a543a5bd4d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:05:53.471356 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:05:53.494974 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f96095-aba7-4fb1-9d17-9a543a5bd4d0 admin admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:05:53.499088 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50338f0-839a-442b-8e85-3b5d4fcb76d6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68382432147a48c3b62271fd2a2eab04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59391272ecbe48b0aa736cb43807be1d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:05:53.499735 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50338f0-839a-442b-8e85-3b5d4fcb76d6 service cinder] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:05:53.500019 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50338f0-839a-442b-8e85-3b5d4fcb76d6 service cinder] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:05:53.500295 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50338f0-839a-442b-8e85-3b5d4fcb76d6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:05:53.509178 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50338f0-839a-442b-8e85-3b5d4fcb76d6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:05:53.510622 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50338f0-839a-442b-8e85-3b5d4fcb76d6 service cinder] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:05:53.519903 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 1349/2686] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jul 14 11:05:53 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 11:05:53.916402 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4eca6d9-478b-49e0-be01-ed747f462c2c None None] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:05:53.920621 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:05:53.979891 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4eca6d9-478b-49e0-be01-ed747f462c2c None None] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:05:53.984282 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f790876e-700c-4dd8-86be-3769e673d535 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:05:53.985183 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f790876e-700c-4dd8-86be-3769e673d535 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:05:53.985470 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f790876e-700c-4dd8-86be-3769e673d535 admin admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:05:53.985750 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f790876e-700c-4dd8-86be-3769e673d535 admin admin] PATH_INFO: `/v3/users/70066d58a2f3420983bb2dd94dbbdfec` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:05:53.986936 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f790876e-700c-4dd8-86be-3769e673d535 admin admin] RBAC: Authorizing `identity:delete_user(user_id=70066d58a2f3420983bb2dd94dbbdfec)` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:05:53.988902 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f790876e-700c-4dd8-86be-3769e673d535 admin admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:05:54.035745 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-f790876e-700c-4dd8-86be-3769e673d535 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '70066d58a2f3420983bb2dd94dbbdfec'} {{(pid=86656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:05:54.043688 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-f790876e-700c-4dd8-86be-3769e673d535 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '70066d58a2f3420983bb2dd94dbbdfec'} {{(pid=86656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:05:54.044377 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-f790876e-700c-4dd8-86be-3769e673d535 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '70066d58a2f3420983bb2dd94dbbdfec'} {{(pid=86656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:05:54.051744 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-f790876e-700c-4dd8-86be-3769e673d535 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '70066d58a2f3420983bb2dd94dbbdfec'} {{(pid=86656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:05:54.052401 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-f790876e-700c-4dd8-86be-3769e673d535 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '70066d58a2f3420983bb2dd94dbbdfec'} {{(pid=86656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:05:54.071158 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 1338/2687] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Jul 14 11:05:53 2022] DELETE /identity/v3/users/70066d58a2f3420983bb2dd94dbbdfec => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:05:54.076562 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4863ea-544f-4675-92d0-f0fa505c85f0 None None] REQUEST_METHOD: `POST` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:05:54.076887 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4863ea-544f-4675-92d0-f0fa505c85f0 None None] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:05:54.077170 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4863ea-544f-4675-92d0-f0fa505c85f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:05:54.094925 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.auth.core [None req-fd4863ea-544f-4675-92d0-f0fa505c85f0 None None] MFA Rules not processed for user `ae4bcdd8106d4bebbdcae96be33505bc`. Rule list: `[]` (Enabled: `True`). {{(pid=86655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:05:54.096120 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-fd4863ea-544f-4675-92d0-f0fa505c85f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:05:54.163083 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 1350/2688] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jul 14 11:05:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:05:54.172415 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f790876e-700c-4dd8-86be-3769e673d535 admin admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:05:54.173829 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-f790876e-700c-4dd8-86be-3769e673d535 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:05:54.231626 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f790876e-700c-4dd8-86be-3769e673d535 admin admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:05:54.235112 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca92011-4b67-400e-8174-9c92626d03ad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dddf93691844886982c91fea974385d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59391272ecbe48b0aa736cb43807be1d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:05:54.235750 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca92011-4b67-400e-8174-9c92626d03ad service neutron] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:05:54.236033 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca92011-4b67-400e-8174-9c92626d03ad service neutron] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:05:54.236307 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca92011-4b67-400e-8174-9c92626d03ad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:05:54.245625 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca92011-4b67-400e-8174-9c92626d03ad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:05:54.247048 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca92011-4b67-400e-8174-9c92626d03ad service neutron] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:05:54.256377 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 1339/2689] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jul 14 11:05:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 11:05:54.524534 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4863ea-544f-4675-92d0-f0fa505c85f0 None None] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:05:54.525998 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-fd4863ea-544f-4675-92d0-f0fa505c85f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:05:54.537994 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4863ea-544f-4675-92d0-f0fa505c85f0 None None] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:05:54.543312 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610b4b3d-387e-47f8-9cb2-89907df0756a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:05:54.544208 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610b4b3d-387e-47f8-9cb2-89907df0756a admin admin] REQUEST_METHOD: `DELETE` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:05:54.544449 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610b4b3d-387e-47f8-9cb2-89907df0756a admin admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:05:54.544723 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610b4b3d-387e-47f8-9cb2-89907df0756a admin admin] PATH_INFO: `/v3/projects/ecd3ae72434a45cdbfb0f5be972ce64f` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:05:54.545946 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610b4b3d-387e-47f8-9cb2-89907df0756a admin admin] RBAC: Authorizing `identity:delete_project(project_id=ecd3ae72434a45cdbfb0f5be972ce64f)` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:05:54.547881 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610b4b3d-387e-47f8-9cb2-89907df0756a admin admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:05:54.594383 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-610b4b3d-387e-47f8-9cb2-89907df0756a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ecd3ae72434a45cdbfb0f5be972ce64f', 'request_id': 'req-610b4b3d-387e-47f8-9cb2-89907df0756a'} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:05:54.599725 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-610b4b3d-387e-47f8-9cb2-89907df0756a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ecd3ae72434a45cdbfb0f5be972ce64f', 'request_id': 'req-610b4b3d-387e-47f8-9cb2-89907df0756a'} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:05:54.607835 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-610b4b3d-387e-47f8-9cb2-89907df0756a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ecd3ae72434a45cdbfb0f5be972ce64f', 'request_id': 'req-610b4b3d-387e-47f8-9cb2-89907df0756a'} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:05:54.618781 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-610b4b3d-387e-47f8-9cb2-89907df0756a admin admin] The token cache is being invalidate because project ecd3ae72434a45cdbfb0f5be972ce64f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86655) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 11:05:54.619072 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-610b4b3d-387e-47f8-9cb2-89907df0756a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:05:54.619712 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-610b4b3d-387e-47f8-9cb2-89907df0756a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:05:54.622031 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 1351/2690] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Jul 14 11:05:54 2022] DELETE /identity/v3/projects/ecd3ae72434a45cdbfb0f5be972ce64f => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:05:54.626000 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca92011-4b67-400e-8174-9c92626d03ad service neutron] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:05:54.635778 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca92011-4b67-400e-8174-9c92626d03ad service neutron] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:05:54.655068 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:05:54.693410 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c38f9e-c3d2-4106-8ee0-63a469be4596 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:05:54.694316 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c38f9e-c3d2-4106-8ee0-63a469be4596 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:05:54.694605 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c38f9e-c3d2-4106-8ee0-63a469be4596 admin admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:05:54.694888 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c38f9e-c3d2-4106-8ee0-63a469be4596 admin admin] PATH_INFO: `/v3/users/47ecea1b2f6540f6b1b2ad5b63d4604f` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:05:54.696363 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c38f9e-c3d2-4106-8ee0-63a469be4596 admin admin] RBAC: Authorizing `identity:delete_user(user_id=47ecea1b2f6540f6b1b2ad5b63d4604f)` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:05:54.698457 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c38f9e-c3d2-4106-8ee0-63a469be4596 admin admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:05:54.744796 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-c1c38f9e-c3d2-4106-8ee0-63a469be4596 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '47ecea1b2f6540f6b1b2ad5b63d4604f'} {{(pid=86656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:05:54.752584 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-c1c38f9e-c3d2-4106-8ee0-63a469be4596 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '47ecea1b2f6540f6b1b2ad5b63d4604f'} {{(pid=86656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:05:54.753258 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-c1c38f9e-c3d2-4106-8ee0-63a469be4596 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '47ecea1b2f6540f6b1b2ad5b63d4604f'} {{(pid=86656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:05:54.760131 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-c1c38f9e-c3d2-4106-8ee0-63a469be4596 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '47ecea1b2f6540f6b1b2ad5b63d4604f'} {{(pid=86656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:05:54.760810 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-c1c38f9e-c3d2-4106-8ee0-63a469be4596 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '47ecea1b2f6540f6b1b2ad5b63d4604f'} {{(pid=86656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:05:54.778229 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 1340/2691] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Jul 14 11:05:54 2022] DELETE /identity/v3/users/47ecea1b2f6540f6b1b2ad5b63d4604f => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 11:05:55.052336 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610b4b3d-387e-47f8-9cb2-89907df0756a admin admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:05:55.053894 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-610b4b3d-387e-47f8-9cb2-89907df0756a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:05:55.068095 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610b4b3d-387e-47f8-9cb2-89907df0756a admin admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:05:55.121096 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:05:55.128228 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f5ec4e-9636-4864-a639-0faf437018cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:05:55.129303 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f5ec4e-9636-4864-a639-0faf437018cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:05:55.129965 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f5ec4e-9636-4864-a639-0faf437018cb admin admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:05:55.130421 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f5ec4e-9636-4864-a639-0faf437018cb admin admin] PATH_INFO: `/v3/projects/cea4944dc820495685c73373cf760835` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:05:55.131501 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f5ec4e-9636-4864-a639-0faf437018cb admin admin] RBAC: Authorizing `identity:delete_project(project_id=cea4944dc820495685c73373cf760835)` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:05:55.133786 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f5ec4e-9636-4864-a639-0faf437018cb admin admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:05:55.181128 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-49f5ec4e-9636-4864-a639-0faf437018cb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cea4944dc820495685c73373cf760835', 'request_id': 'req-49f5ec4e-9636-4864-a639-0faf437018cb'} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:05:55.186922 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-49f5ec4e-9636-4864-a639-0faf437018cb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cea4944dc820495685c73373cf760835', 'request_id': 'req-49f5ec4e-9636-4864-a639-0faf437018cb'} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:05:55.194617 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-49f5ec4e-9636-4864-a639-0faf437018cb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cea4944dc820495685c73373cf760835', 'request_id': 'req-49f5ec4e-9636-4864-a639-0faf437018cb'} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:05:55.206844 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-49f5ec4e-9636-4864-a639-0faf437018cb admin admin] The token cache is being invalidate because project cea4944dc820495685c73373cf760835 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86655) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 11:05:55.207144 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-49f5ec4e-9636-4864-a639-0faf437018cb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:05:55.207793 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-49f5ec4e-9636-4864-a639-0faf437018cb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:05:55.209567 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 1352/2692] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Jul 14 11:05:55 2022] DELETE /identity/v3/projects/cea4944dc820495685c73373cf760835 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:05:55.215403 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea8ed07-bcb6-4fe5-92c8-24f7f12764eb None None] REQUEST_METHOD: `POST` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:05:55.215702 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea8ed07-bcb6-4fe5-92c8-24f7f12764eb None None] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:05:55.215981 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea8ed07-bcb6-4fe5-92c8-24f7f12764eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:05:55.234555 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.auth.core [None req-cea8ed07-bcb6-4fe5-92c8-24f7f12764eb None None] MFA Rules not processed for user `ae4bcdd8106d4bebbdcae96be33505bc`. Rule list: `[]` (Enabled: `True`). {{(pid=86656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:05:55.235815 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-cea8ed07-bcb6-4fe5-92c8-24f7f12764eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:05:55.299746 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 1341/2693] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jul 14 11:05:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:05:55.307395 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7dfaf3-26d5-4004-888d-27d7c363d7c3 None None] REQUEST_METHOD: `POST` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:05:55.307694 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7dfaf3-26d5-4004-888d-27d7c363d7c3 None None] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:05:55.307978 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7dfaf3-26d5-4004-888d-27d7c363d7c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:05:55.327816 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.auth.core [None req-ed7dfaf3-26d5-4004-888d-27d7c363d7c3 None None] MFA Rules not processed for user `ae4bcdd8106d4bebbdcae96be33505bc`. Rule list: `[]` (Enabled: `True`). {{(pid=86655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:05:55.329074 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-ed7dfaf3-26d5-4004-888d-27d7c363d7c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:05:55.345462 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 1353/2694] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jul 14 11:05:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 11:05:55.349532 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea8ed07-bcb6-4fe5-92c8-24f7f12764eb None None] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:05:55.359392 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea8ed07-bcb6-4fe5-92c8-24f7f12764eb None None] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:05:55.364076 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f8cacb-1959-46ad-82e8-52edc39fafd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:05:55.364732 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f8cacb-1959-46ad-82e8-52edc39fafd0 admin admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:05:55.365064 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f8cacb-1959-46ad-82e8-52edc39fafd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:05:55.365329 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f8cacb-1959-46ad-82e8-52edc39fafd0 admin admin] PATH_INFO: `/v3/domains` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:05:55.366054 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f8cacb-1959-46ad-82e8-52edc39fafd0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:05:55.366360 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f8cacb-1959-46ad-82e8-52edc39fafd0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:05:55.367952 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f8cacb-1959-46ad-82e8-52edc39fafd0 admin admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:05:55.379523 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 1342/2695] 10.222.0.16 () {58 vars in 1152 bytes} [Thu Jul 14 11:05:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:05:55.383628 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7dfaf3-26d5-4004-888d-27d7c363d7c3 None None] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:05:55.394504 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7dfaf3-26d5-4004-888d-27d7c363d7c3 None None] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:05:55.399208 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcca3aa-e262-477c-bc81-2d044d2bf632 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:05:55.400020 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcca3aa-e262-477c-bc81-2d044d2bf632 admin admin] REQUEST_METHOD: `POST` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:05:55.400317 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcca3aa-e262-477c-bc81-2d044d2bf632 admin admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:05:55.400606 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcca3aa-e262-477c-bc81-2d044d2bf632 admin admin] PATH_INFO: `/v3/projects` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:05:55.402496 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdcca3aa-e262-477c-bc81-2d044d2bf632 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:05:55.404388 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdcca3aa-e262-477c-bc81-2d044d2bf632 admin admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:05:55.430636 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 1354/2696] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Jul 14 11:05:55 2022] POST /identity/v3/projects => generated 381 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 11:05:55.434670 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f8cacb-1959-46ad-82e8-52edc39fafd0 admin admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:05:55.444615 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f8cacb-1959-46ad-82e8-52edc39fafd0 admin admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:05:55.474008 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:05:55.503113 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4d28fa-de2e-456d-b1fc-267efb50006b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:05:55.503782 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4d28fa-de2e-456d-b1fc-267efb50006b admin admin] REQUEST_METHOD: `POST` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:05:55.504068 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4d28fa-de2e-456d-b1fc-267efb50006b admin admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:05:55.504347 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4d28fa-de2e-456d-b1fc-267efb50006b admin admin] PATH_INFO: `/v3/users` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:05:55.505094 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4d28fa-de2e-456d-b1fc-267efb50006b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:05:55.506998 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4d28fa-de2e-456d-b1fc-267efb50006b admin admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:05:55.527117 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 1343/2697] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Jul 14 11:05:55 2022] POST /identity/v3/users => generated 291 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 11:05:55.531356 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcca3aa-e262-477c-bc81-2d044d2bf632 admin admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:05:55.542015 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcca3aa-e262-477c-bc81-2d044d2bf632 admin admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:05:55.546670 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72dd14e-ada1-4858-ae09-5dcdb83de039 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:05:55.547326 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72dd14e-ada1-4858-ae09-5dcdb83de039 admin admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:05:55.547610 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72dd14e-ada1-4858-ae09-5dcdb83de039 admin admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:05:55.547889 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72dd14e-ada1-4858-ae09-5dcdb83de039 admin admin] PATH_INFO: `/v3/roles` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:05:55.548620 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72dd14e-ada1-4858-ae09-5dcdb83de039 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:05:55.550286 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72dd14e-ada1-4858-ae09-5dcdb83de039 admin admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:05:55.560709 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 1355/2698] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jul 14 11:05:55 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 11:05:55.564412 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4d28fa-de2e-456d-b1fc-267efb50006b admin admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:05:55.575621 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4d28fa-de2e-456d-b1fc-267efb50006b admin admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:05:55.580307 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f880d464-6031-411a-9dd2-c7d756b83279 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:05:55.581003 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f880d464-6031-411a-9dd2-c7d756b83279 admin admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:05:55.581293 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f880d464-6031-411a-9dd2-c7d756b83279 admin admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:05:55.581573 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f880d464-6031-411a-9dd2-c7d756b83279 admin admin] PATH_INFO: `/v3/roles` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:05:55.582328 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f880d464-6031-411a-9dd2-c7d756b83279 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:05:55.583919 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f880d464-6031-411a-9dd2-c7d756b83279 admin admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:05:55.594622 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 1344/2699] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jul 14 11:05:55 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 11:05:55.598640 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72dd14e-ada1-4858-ae09-5dcdb83de039 admin admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:05:55.608653 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72dd14e-ada1-4858-ae09-5dcdb83de039 admin admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:05:55.613271 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54f6a1d-5aec-48c1-b69d-026fd8dbe4a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:05:55.614141 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54f6a1d-5aec-48c1-b69d-026fd8dbe4a1 admin admin] REQUEST_METHOD: `PUT` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:05:55.614427 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54f6a1d-5aec-48c1-b69d-026fd8dbe4a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:05:55.614705 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54f6a1d-5aec-48c1-b69d-026fd8dbe4a1 admin admin] PATH_INFO: `/v3/projects/316dd24b6539469385ea7d5870dbefd3/users/1fbb085b72a14f9f9c283b90abad760e/roles/0da46c267d354cce81495dfdd56c1ec2` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:05:55.629737 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54f6a1d-5aec-48c1-b69d-026fd8dbe4a1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=316dd24b6539469385ea7d5870dbefd3, user_id=1fbb085b72a14f9f9c283b90abad760e, role_id=0da46c267d354cce81495dfdd56c1ec2)` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:05:55.632382 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54f6a1d-5aec-48c1-b69d-026fd8dbe4a1 admin admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:05:55.645722 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 1356/2700] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Jul 14 11:05:55 2022] PUT /identity/v3/projects/316dd24b6539469385ea7d5870dbefd3/users/1fbb085b72a14f9f9c283b90abad760e/roles/0da46c267d354cce81495dfdd56c1ec2 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:05:55.657032 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62d2248-2683-4b5e-980b-0050736e400d None None] REQUEST_METHOD: `POST` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:05:55.657528 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62d2248-2683-4b5e-980b-0050736e400d None None] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:05:55.657626 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62d2248-2683-4b5e-980b-0050736e400d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:05:55.688503 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.auth.core [None req-c62d2248-2683-4b5e-980b-0050736e400d None None] MFA Rules not processed for user `1fbb085b72a14f9f9c283b90abad760e`. Rule list: `[]` (Enabled: `True`). {{(pid=86656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:05:55.690154 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-c62d2248-2683-4b5e-980b-0050736e400d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:05:55.755931 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 1345/2701] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jul 14 11:05:55 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:05:55.761321 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54f6a1d-5aec-48c1-b69d-026fd8dbe4a1 admin admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:05:55.822645 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54f6a1d-5aec-48c1-b69d-026fd8dbe4a1 admin admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:05:55.827939 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba719dc5-bcd2-42c4-91fb-6ef5297369cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:05:55.828602 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba719dc5-bcd2-42c4-91fb-6ef5297369cf admin admin] REQUEST_METHOD: `POST` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:05:55.828923 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba719dc5-bcd2-42c4-91fb-6ef5297369cf admin admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:05:55.829206 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba719dc5-bcd2-42c4-91fb-6ef5297369cf admin admin] PATH_INFO: `/v3/projects` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:05:55.829912 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba719dc5-bcd2-42c4-91fb-6ef5297369cf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:05:55.831811 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba719dc5-bcd2-42c4-91fb-6ef5297369cf admin admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:05:55.856268 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 1357/2702] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Jul 14 11:05:55 2022] POST /identity/v3/projects => generated 387 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 11:05:55.860282 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62d2248-2683-4b5e-980b-0050736e400d None None] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:05:55.871765 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62d2248-2683-4b5e-980b-0050736e400d None None] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:05:55.927021 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d580882-2234-410b-b43b-a1d198f157ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:05:55.927691 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d580882-2234-410b-b43b-a1d198f157ec admin admin] REQUEST_METHOD: `POST` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:05:55.927978 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d580882-2234-410b-b43b-a1d198f157ec admin admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:05:55.928259 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d580882-2234-410b-b43b-a1d198f157ec admin admin] PATH_INFO: `/v3/users` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:05:55.928999 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d580882-2234-410b-b43b-a1d198f157ec admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:05:55.930937 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d580882-2234-410b-b43b-a1d198f157ec admin admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:05:55.951624 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 1346/2703] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Jul 14 11:05:55 2022] POST /identity/v3/users => generated 300 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 11:05:55.956313 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba719dc5-bcd2-42c4-91fb-6ef5297369cf admin admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:05:55.966742 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba719dc5-bcd2-42c4-91fb-6ef5297369cf admin admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:05:55.971361 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738c164d-69fe-4998-b593-e84128f5c587 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:05:55.972016 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738c164d-69fe-4998-b593-e84128f5c587 admin admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:05:55.972298 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738c164d-69fe-4998-b593-e84128f5c587 admin admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:05:55.972575 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738c164d-69fe-4998-b593-e84128f5c587 admin admin] PATH_INFO: `/v3/roles` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:05:55.973751 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738c164d-69fe-4998-b593-e84128f5c587 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:05:55.975554 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738c164d-69fe-4998-b593-e84128f5c587 admin admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:05:55.977672 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:05:55.987505 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 1358/2704] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jul 14 11:05:55 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 11:05:55.991574 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d580882-2234-410b-b43b-a1d198f157ec admin admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:05:56.002184 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d580882-2234-410b-b43b-a1d198f157ec admin admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:05:56.006821 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a17a7cf-5489-4d44-a890-3579ebdf44ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:05:56.007698 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a17a7cf-5489-4d44-a890-3579ebdf44ee admin admin] REQUEST_METHOD: `PUT` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:05:56.007980 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a17a7cf-5489-4d44-a890-3579ebdf44ee admin admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:05:56.008255 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a17a7cf-5489-4d44-a890-3579ebdf44ee admin admin] PATH_INFO: `/v3/projects/9835366dba3b4a069ed1caf0919032e8/users/9566ab999d66426c888e299f33c518c8/roles/153539819e5542df99269d2913bbecfb` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:05:56.022881 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a17a7cf-5489-4d44-a890-3579ebdf44ee admin admin] RBAC: Authorizing `identity:create_grant(project_id=9835366dba3b4a069ed1caf0919032e8, user_id=9566ab999d66426c888e299f33c518c8, role_id=153539819e5542df99269d2913bbecfb)` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:05:56.025879 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a17a7cf-5489-4d44-a890-3579ebdf44ee admin admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:05:56.038430 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 1347/2705] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Jul 14 11:05:55 2022] PUT /identity/v3/projects/9835366dba3b4a069ed1caf0919032e8/users/9566ab999d66426c888e299f33c518c8/roles/153539819e5542df99269d2913bbecfb => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:05:56.042906 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738c164d-69fe-4998-b593-e84128f5c587 admin admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:05:56.052765 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738c164d-69fe-4998-b593-e84128f5c587 admin admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:05:56.110685 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f9a9d1-367e-41c6-abe9-cc2358e4990a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:05:56.111272 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f9a9d1-367e-41c6-abe9-cc2358e4990a admin admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:05:56.111554 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f9a9d1-367e-41c6-abe9-cc2358e4990a admin admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:05:56.111829 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f9a9d1-367e-41c6-abe9-cc2358e4990a admin admin] PATH_INFO: `/v3/roles` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:05:56.112558 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f9a9d1-367e-41c6-abe9-cc2358e4990a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:05:56.114177 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f9a9d1-367e-41c6-abe9-cc2358e4990a admin admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:05:56.124403 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 1359/2706] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jul 14 11:05:56 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 11:05:56.128614 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a17a7cf-5489-4d44-a890-3579ebdf44ee admin admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:05:56.135302 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:05:56.139184 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a17a7cf-5489-4d44-a890-3579ebdf44ee admin admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:05:56.144741 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465bf5a4-e7f5-42e1-b0d8-fbffb79bcde3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:05:56.145654 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465bf5a4-e7f5-42e1-b0d8-fbffb79bcde3 admin admin] REQUEST_METHOD: `PUT` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:05:56.145937 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465bf5a4-e7f5-42e1-b0d8-fbffb79bcde3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:05:56.146210 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465bf5a4-e7f5-42e1-b0d8-fbffb79bcde3 admin admin] PATH_INFO: `/v3/projects/9835366dba3b4a069ed1caf0919032e8/users/9566ab999d66426c888e299f33c518c8/roles/153539819e5542df99269d2913bbecfb` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:05:56.148189 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465bf5a4-e7f5-42e1-b0d8-fbffb79bcde3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9835366dba3b4a069ed1caf0919032e8, user_id=9566ab999d66426c888e299f33c518c8, role_id=153539819e5542df99269d2913bbecfb)` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:05:56.150848 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465bf5a4-e7f5-42e1-b0d8-fbffb79bcde3 admin admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:05:56.161087 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 1348/2707] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Jul 14 11:05:56 2022] PUT /identity/v3/projects/9835366dba3b4a069ed1caf0919032e8/users/9566ab999d66426c888e299f33c518c8/roles/153539819e5542df99269d2913bbecfb => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:05:56.222114 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ed2fbb-55f6-4e70-86ed-8ca60a9cc43a None None] REQUEST_METHOD: `POST` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:05:56.222408 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ed2fbb-55f6-4e70-86ed-8ca60a9cc43a None None] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:05:56.222693 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ed2fbb-55f6-4e70-86ed-8ca60a9cc43a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:05:56.248606 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.auth.core [None req-e9ed2fbb-55f6-4e70-86ed-8ca60a9cc43a None None] MFA Rules not processed for user `9566ab999d66426c888e299f33c518c8`. Rule list: `[]` (Enabled: `True`). {{(pid=86655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:05:56.249857 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-e9ed2fbb-55f6-4e70-86ed-8ca60a9cc43a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:05:56.316884 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 1360/2708] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jul 14 11:05:56 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:05:56.329088 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465bf5a4-e7f5-42e1-b0d8-fbffb79bcde3 admin admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:05:56.330801 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-465bf5a4-e7f5-42e1-b0d8-fbffb79bcde3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:05:56.390776 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465bf5a4-e7f5-42e1-b0d8-fbffb79bcde3 admin admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:05:56.394398 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67906b77-7e72-4ea7-83ad-f931bded6891 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68382432147a48c3b62271fd2a2eab04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59391272ecbe48b0aa736cb43807be1d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:05:56.395048 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67906b77-7e72-4ea7-83ad-f931bded6891 service cinder] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:05:56.395330 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67906b77-7e72-4ea7-83ad-f931bded6891 service cinder] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:05:56.395606 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67906b77-7e72-4ea7-83ad-f931bded6891 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:05:56.405276 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67906b77-7e72-4ea7-83ad-f931bded6891 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:05:56.406707 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67906b77-7e72-4ea7-83ad-f931bded6891 service cinder] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:05:56.416292 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 1349/2709] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jul 14 11:05:56 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 11:05:56.483260 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ed2fbb-55f6-4e70-86ed-8ca60a9cc43a None None] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:05:56.545832 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ed2fbb-55f6-4e70-86ed-8ca60a9cc43a None None] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:05:56.550395 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c61361d-aa91-4d7f-a936-54569e5d7b51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:05:56.551275 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c61361d-aa91-4d7f-a936-54569e5d7b51 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:05:56.551590 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c61361d-aa91-4d7f-a936-54569e5d7b51 admin admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:05:56.551872 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c61361d-aa91-4d7f-a936-54569e5d7b51 admin admin] PATH_INFO: `/v3/users/1fbb085b72a14f9f9c283b90abad760e` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:05:56.553115 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c61361d-aa91-4d7f-a936-54569e5d7b51 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1fbb085b72a14f9f9c283b90abad760e)` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:05:56.555041 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c61361d-aa91-4d7f-a936-54569e5d7b51 admin admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:05:56.577215 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:05:56.600995 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-4c61361d-aa91-4d7f-a936-54569e5d7b51 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1fbb085b72a14f9f9c283b90abad760e'} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:05:56.608091 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-4c61361d-aa91-4d7f-a936-54569e5d7b51 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1fbb085b72a14f9f9c283b90abad760e'} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:05:56.608698 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-4c61361d-aa91-4d7f-a936-54569e5d7b51 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1fbb085b72a14f9f9c283b90abad760e'} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:05:56.615428 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-4c61361d-aa91-4d7f-a936-54569e5d7b51 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1fbb085b72a14f9f9c283b90abad760e'} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:05:56.616047 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-4c61361d-aa91-4d7f-a936-54569e5d7b51 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1fbb085b72a14f9f9c283b90abad760e'} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:05:56.634507 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 1361/2710] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Jul 14 11:05:56 2022] DELETE /identity/v3/users/1fbb085b72a14f9f9c283b90abad760e => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:05:56.639994 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321a667e-27a7-4bd4-af70-e3508f9962ac None None] REQUEST_METHOD: `POST` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:05:56.640283 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321a667e-27a7-4bd4-af70-e3508f9962ac None None] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:05:56.640562 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321a667e-27a7-4bd4-af70-e3508f9962ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:05:56.658024 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.auth.core [None req-321a667e-27a7-4bd4-af70-e3508f9962ac None None] MFA Rules not processed for user `ae4bcdd8106d4bebbdcae96be33505bc`. Rule list: `[]` (Enabled: `True`). {{(pid=86656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:05:56.659166 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-321a667e-27a7-4bd4-af70-e3508f9962ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:05:56.716723 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 1350/2711] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jul 14 11:05:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:05:56.726285 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c61361d-aa91-4d7f-a936-54569e5d7b51 admin admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:05:56.727670 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-4c61361d-aa91-4d7f-a936-54569e5d7b51 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:05:56.784123 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c61361d-aa91-4d7f-a936-54569e5d7b51 admin admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:05:56.787873 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e502d1ba-9874-49d2-af9d-64545c1967b6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dddf93691844886982c91fea974385d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59391272ecbe48b0aa736cb43807be1d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:05:56.788527 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e502d1ba-9874-49d2-af9d-64545c1967b6 service neutron] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:05:56.788841 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e502d1ba-9874-49d2-af9d-64545c1967b6 service neutron] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:05:56.789125 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e502d1ba-9874-49d2-af9d-64545c1967b6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:05:56.799274 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e502d1ba-9874-49d2-af9d-64545c1967b6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:05:56.800699 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e502d1ba-9874-49d2-af9d-64545c1967b6 service neutron] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:05:56.810795 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 1362/2712] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jul 14 11:05:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 11:05:57.077915 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321a667e-27a7-4bd4-af70-e3508f9962ac None None] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:05:57.079465 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-321a667e-27a7-4bd4-af70-e3508f9962ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:05:57.092308 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321a667e-27a7-4bd4-af70-e3508f9962ac None None] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:05:57.096959 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc8ac52-e0c4-46df-a87d-12be7c45883e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:05:57.097843 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc8ac52-e0c4-46df-a87d-12be7c45883e admin admin] REQUEST_METHOD: `DELETE` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:05:57.098126 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc8ac52-e0c4-46df-a87d-12be7c45883e admin admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:05:57.098398 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc8ac52-e0c4-46df-a87d-12be7c45883e admin admin] PATH_INFO: `/v3/projects/316dd24b6539469385ea7d5870dbefd3` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:05:57.099585 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc8ac52-e0c4-46df-a87d-12be7c45883e admin admin] RBAC: Authorizing `identity:delete_project(project_id=316dd24b6539469385ea7d5870dbefd3)` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:05:57.101532 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc8ac52-e0c4-46df-a87d-12be7c45883e admin admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:05:57.146702 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-4dc8ac52-e0c4-46df-a87d-12be7c45883e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '316dd24b6539469385ea7d5870dbefd3', 'request_id': 'req-4dc8ac52-e0c4-46df-a87d-12be7c45883e'} {{(pid=86656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:05:57.154634 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-4dc8ac52-e0c4-46df-a87d-12be7c45883e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '316dd24b6539469385ea7d5870dbefd3', 'request_id': 'req-4dc8ac52-e0c4-46df-a87d-12be7c45883e'} {{(pid=86656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:05:57.160723 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-4dc8ac52-e0c4-46df-a87d-12be7c45883e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '316dd24b6539469385ea7d5870dbefd3', 'request_id': 'req-4dc8ac52-e0c4-46df-a87d-12be7c45883e'} {{(pid=86656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:05:57.171458 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-4dc8ac52-e0c4-46df-a87d-12be7c45883e admin admin] The token cache is being invalidate because project 316dd24b6539469385ea7d5870dbefd3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86656) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 11:05:57.171744 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-4dc8ac52-e0c4-46df-a87d-12be7c45883e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:05:57.172371 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-4dc8ac52-e0c4-46df-a87d-12be7c45883e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:05:57.173910 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 1351/2713] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Jul 14 11:05:57 2022] DELETE /identity/v3/projects/316dd24b6539469385ea7d5870dbefd3 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:05:57.177999 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e502d1ba-9874-49d2-af9d-64545c1967b6 service neutron] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:05:57.187901 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e502d1ba-9874-49d2-af9d-64545c1967b6 service neutron] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:05:57.243351 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2619f8-e1bd-4f07-8b2d-d12ec865f38a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:05:57.244185 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2619f8-e1bd-4f07-8b2d-d12ec865f38a admin admin] REQUEST_METHOD: `DELETE` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:05:57.244472 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2619f8-e1bd-4f07-8b2d-d12ec865f38a admin admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:05:57.244795 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2619f8-e1bd-4f07-8b2d-d12ec865f38a admin admin] PATH_INFO: `/v3/users/9566ab999d66426c888e299f33c518c8` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:05:57.245973 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2619f8-e1bd-4f07-8b2d-d12ec865f38a admin admin] RBAC: Authorizing `identity:delete_user(user_id=9566ab999d66426c888e299f33c518c8)` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:05:57.248007 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2619f8-e1bd-4f07-8b2d-d12ec865f38a admin admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:05:57.291484 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:05:57.294986 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-9f2619f8-e1bd-4f07-8b2d-d12ec865f38a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9566ab999d66426c888e299f33c518c8'} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:05:57.303312 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-9f2619f8-e1bd-4f07-8b2d-d12ec865f38a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9566ab999d66426c888e299f33c518c8'} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:05:57.303929 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-9f2619f8-e1bd-4f07-8b2d-d12ec865f38a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9566ab999d66426c888e299f33c518c8'} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:05:57.311099 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-9f2619f8-e1bd-4f07-8b2d-d12ec865f38a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9566ab999d66426c888e299f33c518c8'} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:05:57.311728 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-9f2619f8-e1bd-4f07-8b2d-d12ec865f38a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9566ab999d66426c888e299f33c518c8'} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:05:57.328896 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 1363/2714] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Jul 14 11:05:57 2022] DELETE /identity/v3/users/9566ab999d66426c888e299f33c518c8 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:05:57.660323 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc8ac52-e0c4-46df-a87d-12be7c45883e admin admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:05:57.661971 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-4dc8ac52-e0c4-46df-a87d-12be7c45883e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:05:57.688043 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc8ac52-e0c4-46df-a87d-12be7c45883e admin admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:05:57.705192 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:05:57.747574 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2619f8-e1bd-4f07-8b2d-d12ec865f38a admin admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:05:57.749046 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-9f2619f8-e1bd-4f07-8b2d-d12ec865f38a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:05:57.757122 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d11413-bc95-4f46-9d21-d808bc1e38b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:05:57.758065 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d11413-bc95-4f46-9d21-d808bc1e38b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:05:57.758421 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d11413-bc95-4f46-9d21-d808bc1e38b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:05:57.758757 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d11413-bc95-4f46-9d21-d808bc1e38b7 admin admin] PATH_INFO: `/v3/projects/9835366dba3b4a069ed1caf0919032e8` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:05:57.759999 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d11413-bc95-4f46-9d21-d808bc1e38b7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9835366dba3b4a069ed1caf0919032e8)` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:05:57.762798 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d11413-bc95-4f46-9d21-d808bc1e38b7 admin admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:05:57.816444 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-70d11413-bc95-4f46-9d21-d808bc1e38b7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9835366dba3b4a069ed1caf0919032e8', 'request_id': 'req-70d11413-bc95-4f46-9d21-d808bc1e38b7'} {{(pid=86656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:05:57.824811 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-70d11413-bc95-4f46-9d21-d808bc1e38b7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9835366dba3b4a069ed1caf0919032e8', 'request_id': 'req-70d11413-bc95-4f46-9d21-d808bc1e38b7'} {{(pid=86656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:05:57.827329 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2619f8-e1bd-4f07-8b2d-d12ec865f38a admin admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:05:57.831432 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-70d11413-bc95-4f46-9d21-d808bc1e38b7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9835366dba3b4a069ed1caf0919032e8', 'request_id': 'req-70d11413-bc95-4f46-9d21-d808bc1e38b7'} {{(pid=86656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:05:57.844169 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-70d11413-bc95-4f46-9d21-d808bc1e38b7 admin admin] The token cache is being invalidate because project 9835366dba3b4a069ed1caf0919032e8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86656) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 11:05:57.844464 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-70d11413-bc95-4f46-9d21-d808bc1e38b7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:05:57.845134 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-70d11413-bc95-4f46-9d21-d808bc1e38b7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:05:57.846831 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 1352/2715] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Jul 14 11:05:57 2022] DELETE /identity/v3/projects/9835366dba3b4a069ed1caf0919032e8 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:05:57.852093 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c52f81a-fec1-4f52-ba03-58868f41e67d None None] REQUEST_METHOD: `POST` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:05:57.852391 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c52f81a-fec1-4f52-ba03-58868f41e67d None None] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:05:57.852674 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c52f81a-fec1-4f52-ba03-58868f41e67d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:05:57.871646 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.auth.core [None req-2c52f81a-fec1-4f52-ba03-58868f41e67d None None] MFA Rules not processed for user `ae4bcdd8106d4bebbdcae96be33505bc`. Rule list: `[]` (Enabled: `True`). {{(pid=86656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:05:57.872875 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-2c52f81a-fec1-4f52-ba03-58868f41e67d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:05:57.897540 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd2bd84-e8e9-4e7c-81a8-c80a35552bf7 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16846111ee2a42dd99c3052d40980f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59391272ecbe48b0aa736cb43807be1d', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:05:57.898205 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd2bd84-e8e9-4e7c-81a8-c80a35552bf7 service placement] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:05:57.898496 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd2bd84-e8e9-4e7c-81a8-c80a35552bf7 service placement] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:05:57.898780 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd2bd84-e8e9-4e7c-81a8-c80a35552bf7 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:05:57.900598 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-4dd2bd84-e8e9-4e7c-81a8-c80a35552bf7 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:05:57.912479 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd2bd84-e8e9-4e7c-81a8-c80a35552bf7 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:05:57.914117 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd2bd84-e8e9-4e7c-81a8-c80a35552bf7 service placement] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:05:57.924858 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 1364/2716] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jul 14 11:05:57 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 11:05:57.935952 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 1353/2717] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jul 14 11:05:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 11:05:57.943649 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2f4e1e-4ad1-4a55-b1ae-a1c5fc0cc99b None None] REQUEST_METHOD: `POST` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:05:57.944153 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2f4e1e-4ad1-4a55-b1ae-a1c5fc0cc99b None None] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:05:57.944436 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2f4e1e-4ad1-4a55-b1ae-a1c5fc0cc99b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:05:57.963216 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.auth.core [None req-bd2f4e1e-4ad1-4a55-b1ae-a1c5fc0cc99b None None] MFA Rules not processed for user `ae4bcdd8106d4bebbdcae96be33505bc`. Rule list: `[]` (Enabled: `True`). {{(pid=86655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:05:57.964809 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-bd2f4e1e-4ad1-4a55-b1ae-a1c5fc0cc99b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:05:57.973338 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 1365/2718] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jul 14 11:05:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:05:57.978835 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c52f81a-fec1-4f52-ba03-58868f41e67d None None] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:05:57.992110 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c52f81a-fec1-4f52-ba03-58868f41e67d None None] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:05:57.997653 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39dcefa5-56c4-4fd2-8582-792c85ffed72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:05:57.998321 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dcefa5-56c4-4fd2-8582-792c85ffed72 admin admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:05:57.998611 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dcefa5-56c4-4fd2-8582-792c85ffed72 admin admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:05:57.998894 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dcefa5-56c4-4fd2-8582-792c85ffed72 admin admin] PATH_INFO: `/v3/domains` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:05:57.999635 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39dcefa5-56c4-4fd2-8582-792c85ffed72 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:05:57.999948 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39dcefa5-56c4-4fd2-8582-792c85ffed72 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:05:58.001666 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39dcefa5-56c4-4fd2-8582-792c85ffed72 admin admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:05:58.014332 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 1354/2719] 10.222.0.16 () {58 vars in 1152 bytes} [Thu Jul 14 11:05:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:05:58.018674 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2f4e1e-4ad1-4a55-b1ae-a1c5fc0cc99b None None] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:05:58.028664 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2f4e1e-4ad1-4a55-b1ae-a1c5fc0cc99b None None] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:05:58.034514 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b643e836-22a2-4f6b-bc84-68f21f3aaa52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:05:58.035430 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b643e836-22a2-4f6b-bc84-68f21f3aaa52 admin admin] REQUEST_METHOD: `POST` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:05:58.035970 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b643e836-22a2-4f6b-bc84-68f21f3aaa52 admin admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:05:58.036448 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b643e836-22a2-4f6b-bc84-68f21f3aaa52 admin admin] PATH_INFO: `/v3/projects` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:05:58.037195 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b643e836-22a2-4f6b-bc84-68f21f3aaa52 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:05:58.039112 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b643e836-22a2-4f6b-bc84-68f21f3aaa52 admin admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:05:58.073753 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 1366/2720] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Jul 14 11:05:58 2022] POST /identity/v3/projects => generated 401 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 11:05:58.075178 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39dcefa5-56c4-4fd2-8582-792c85ffed72 admin admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:05:58.085395 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39dcefa5-56c4-4fd2-8582-792c85ffed72 admin admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:05:58.118447 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:05:58.145625 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc528eb-daef-4522-98bb-f40e3e7295e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:05:58.146299 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc528eb-daef-4522-98bb-f40e3e7295e0 admin admin] REQUEST_METHOD: `POST` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:05:58.146584 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc528eb-daef-4522-98bb-f40e3e7295e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:05:58.146859 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc528eb-daef-4522-98bb-f40e3e7295e0 admin admin] PATH_INFO: `/v3/users` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:05:58.147554 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc528eb-daef-4522-98bb-f40e3e7295e0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:05:58.149525 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc528eb-daef-4522-98bb-f40e3e7295e0 admin admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:05:58.168678 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 1355/2721] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Jul 14 11:05:58 2022] POST /identity/v3/users => generated 301 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 11:05:58.173016 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b643e836-22a2-4f6b-bc84-68f21f3aaa52 admin admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:05:58.184025 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b643e836-22a2-4f6b-bc84-68f21f3aaa52 admin admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:05:58.188546 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56342c5-edb7-4cb3-b7bf-9035f594bc8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:05:58.189230 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56342c5-edb7-4cb3-b7bf-9035f594bc8d admin admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:05:58.189511 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56342c5-edb7-4cb3-b7bf-9035f594bc8d admin admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:05:58.189787 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56342c5-edb7-4cb3-b7bf-9035f594bc8d admin admin] PATH_INFO: `/v3/roles` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:05:58.190509 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56342c5-edb7-4cb3-b7bf-9035f594bc8d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:05:58.192140 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56342c5-edb7-4cb3-b7bf-9035f594bc8d admin admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:05:58.203145 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 1367/2722] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jul 14 11:05:58 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 11:05:58.206919 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc528eb-daef-4522-98bb-f40e3e7295e0 admin admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:05:58.217160 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc528eb-daef-4522-98bb-f40e3e7295e0 admin admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:05:58.221754 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb67230f-bb78-4831-925d-67c472b39a09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:05:58.222401 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb67230f-bb78-4831-925d-67c472b39a09 admin admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:05:58.222685 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb67230f-bb78-4831-925d-67c472b39a09 admin admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:05:58.222966 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb67230f-bb78-4831-925d-67c472b39a09 admin admin] PATH_INFO: `/v3/roles` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:05:58.223693 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb67230f-bb78-4831-925d-67c472b39a09 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:05:58.225348 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb67230f-bb78-4831-925d-67c472b39a09 admin admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:05:58.235806 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 1356/2723] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jul 14 11:05:58 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 11:05:58.239680 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56342c5-edb7-4cb3-b7bf-9035f594bc8d admin admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:05:58.250363 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56342c5-edb7-4cb3-b7bf-9035f594bc8d admin admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:05:58.255014 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50261ead-dbd1-4ea6-95f9-81826a77e13a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:05:58.255888 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50261ead-dbd1-4ea6-95f9-81826a77e13a admin admin] REQUEST_METHOD: `PUT` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:05:58.256175 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50261ead-dbd1-4ea6-95f9-81826a77e13a admin admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:05:58.256456 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50261ead-dbd1-4ea6-95f9-81826a77e13a admin admin] PATH_INFO: `/v3/projects/3701d14bcce343bb8a2b38a8a1977c49/users/211ea3e2826941e68a6f17f23a7285e7/roles/0da46c267d354cce81495dfdd56c1ec2` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:05:58.267557 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:DELETE=4,keystone:SELECT=94,keystone:INSERT=2 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:05:58.271754 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50261ead-dbd1-4ea6-95f9-81826a77e13a admin admin] RBAC: Authorizing `identity:create_grant(project_id=3701d14bcce343bb8a2b38a8a1977c49, user_id=211ea3e2826941e68a6f17f23a7285e7, role_id=0da46c267d354cce81495dfdd56c1ec2)` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:05:58.274695 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50261ead-dbd1-4ea6-95f9-81826a77e13a admin admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:05:58.287435 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 1368/2724] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Jul 14 11:05:58 2022] PUT /identity/v3/projects/3701d14bcce343bb8a2b38a8a1977c49/users/211ea3e2826941e68a6f17f23a7285e7/roles/0da46c267d354cce81495dfdd56c1ec2 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:05:58.299249 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8ae15b-7c73-41ed-b64c-00a637039399 None None] REQUEST_METHOD: `POST` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:05:58.299544 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8ae15b-7c73-41ed-b64c-00a637039399 None None] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:05:58.299827 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8ae15b-7c73-41ed-b64c-00a637039399 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:05:58.327432 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.auth.core [None req-ec8ae15b-7c73-41ed-b64c-00a637039399 None None] MFA Rules not processed for user `211ea3e2826941e68a6f17f23a7285e7`. Rule list: `[]` (Enabled: `True`). {{(pid=86656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:05:58.328715 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-ec8ae15b-7c73-41ed-b64c-00a637039399 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:05:58.394750 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 1357/2725] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jul 14 11:05:58 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:05:58.399152 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50261ead-dbd1-4ea6-95f9-81826a77e13a admin admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:05:58.462104 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50261ead-dbd1-4ea6-95f9-81826a77e13a admin admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:05:58.466728 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652973ba-24f7-4593-8e6b-80833d7e7038 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:05:58.467387 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652973ba-24f7-4593-8e6b-80833d7e7038 admin admin] REQUEST_METHOD: `POST` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:05:58.467678 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652973ba-24f7-4593-8e6b-80833d7e7038 admin admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:05:58.467974 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652973ba-24f7-4593-8e6b-80833d7e7038 admin admin] PATH_INFO: `/v3/projects` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:05:58.468650 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652973ba-24f7-4593-8e6b-80833d7e7038 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:05:58.470604 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652973ba-24f7-4593-8e6b-80833d7e7038 admin admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:05:58.495919 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 1369/2726] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Jul 14 11:05:58 2022] POST /identity/v3/projects => generated 397 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 11:05:58.499785 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8ae15b-7c73-41ed-b64c-00a637039399 None None] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:05:58.510406 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8ae15b-7c73-41ed-b64c-00a637039399 None None] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:05:58.566116 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7719e9b6-39a8-43dd-a1d5-0be15fef35bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:05:58.566777 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7719e9b6-39a8-43dd-a1d5-0be15fef35bc admin admin] REQUEST_METHOD: `POST` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:05:58.567058 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7719e9b6-39a8-43dd-a1d5-0be15fef35bc admin admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:05:58.567332 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7719e9b6-39a8-43dd-a1d5-0be15fef35bc admin admin] PATH_INFO: `/v3/users` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:05:58.568025 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7719e9b6-39a8-43dd-a1d5-0be15fef35bc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:05:58.569960 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7719e9b6-39a8-43dd-a1d5-0be15fef35bc admin admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:05:58.590477 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 1358/2727] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Jul 14 11:05:58 2022] POST /identity/v3/users => generated 305 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 11:05:58.594573 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652973ba-24f7-4593-8e6b-80833d7e7038 admin admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:05:58.605628 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652973ba-24f7-4593-8e6b-80833d7e7038 admin admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:05:58.610242 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30022a9a-747f-4494-bebe-80fd94e9eda9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:05:58.610903 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30022a9a-747f-4494-bebe-80fd94e9eda9 admin admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:05:58.611194 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30022a9a-747f-4494-bebe-80fd94e9eda9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:05:58.611475 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30022a9a-747f-4494-bebe-80fd94e9eda9 admin admin] PATH_INFO: `/v3/roles` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:05:58.612236 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30022a9a-747f-4494-bebe-80fd94e9eda9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:05:58.613860 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30022a9a-747f-4494-bebe-80fd94e9eda9 admin admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:05:58.625570 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 1370/2728] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jul 14 11:05:58 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 11:05:58.629711 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7719e9b6-39a8-43dd-a1d5-0be15fef35bc admin admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:05:58.640333 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7719e9b6-39a8-43dd-a1d5-0be15fef35bc admin admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:05:58.645084 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35398a9-e11a-47e7-9b2a-181f7ee96737 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:05:58.645961 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35398a9-e11a-47e7-9b2a-181f7ee96737 admin admin] REQUEST_METHOD: `PUT` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:05:58.646248 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35398a9-e11a-47e7-9b2a-181f7ee96737 admin admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:05:58.646527 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35398a9-e11a-47e7-9b2a-181f7ee96737 admin admin] PATH_INFO: `/v3/projects/cf918c53643e4301b365e4732a444787/users/905b8b26a981445bbdec1622622261d6/roles/153539819e5542df99269d2913bbecfb` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:05:58.662156 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35398a9-e11a-47e7-9b2a-181f7ee96737 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cf918c53643e4301b365e4732a444787, user_id=905b8b26a981445bbdec1622622261d6, role_id=153539819e5542df99269d2913bbecfb)` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:05:58.664819 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35398a9-e11a-47e7-9b2a-181f7ee96737 admin admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:05:58.678669 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 1359/2729] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Jul 14 11:05:58 2022] PUT /identity/v3/projects/cf918c53643e4301b365e4732a444787/users/905b8b26a981445bbdec1622622261d6/roles/153539819e5542df99269d2913bbecfb => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 11:05:58.682600 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30022a9a-747f-4494-bebe-80fd94e9eda9 admin admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:05:58.692396 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30022a9a-747f-4494-bebe-80fd94e9eda9 admin admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:05:58.750146 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dca1deb-072d-4132-867d-15171f528c83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:05:58.750827 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dca1deb-072d-4132-867d-15171f528c83 admin admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:05:58.751118 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dca1deb-072d-4132-867d-15171f528c83 admin admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:05:58.751403 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dca1deb-072d-4132-867d-15171f528c83 admin admin] PATH_INFO: `/v3/roles` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:05:58.752143 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dca1deb-072d-4132-867d-15171f528c83 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:05:58.753758 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dca1deb-072d-4132-867d-15171f528c83 admin admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:05:58.767234 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 1371/2730] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jul 14 11:05:58 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 11:05:58.768363 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35398a9-e11a-47e7-9b2a-181f7ee96737 admin admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:05:58.779333 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35398a9-e11a-47e7-9b2a-181f7ee96737 admin admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:05:58.784223 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0292493b-d0f3-40c5-b6ee-26df120d9c18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:05:58.785168 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0292493b-d0f3-40c5-b6ee-26df120d9c18 admin admin] REQUEST_METHOD: `PUT` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:05:58.785457 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0292493b-d0f3-40c5-b6ee-26df120d9c18 admin admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:05:58.785737 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0292493b-d0f3-40c5-b6ee-26df120d9c18 admin admin] PATH_INFO: `/v3/projects/cf918c53643e4301b365e4732a444787/users/905b8b26a981445bbdec1622622261d6/roles/153539819e5542df99269d2913bbecfb` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:05:58.787728 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0292493b-d0f3-40c5-b6ee-26df120d9c18 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cf918c53643e4301b365e4732a444787, user_id=905b8b26a981445bbdec1622622261d6, role_id=153539819e5542df99269d2913bbecfb)` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:05:58.790421 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0292493b-d0f3-40c5-b6ee-26df120d9c18 admin admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:05:58.794603 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:05:58.803501 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 1360/2731] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Jul 14 11:05:58 2022] PUT /identity/v3/projects/cf918c53643e4301b365e4732a444787/users/905b8b26a981445bbdec1622622261d6/roles/153539819e5542df99269d2913bbecfb => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:05:58.813626 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fe3a57-c532-444e-b624-13dc7128f119 None None] REQUEST_METHOD: `POST` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:05:58.813919 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fe3a57-c532-444e-b624-13dc7128f119 None None] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:05:58.814199 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fe3a57-c532-444e-b624-13dc7128f119 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:05:58.842833 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.auth.core [None req-e4fe3a57-c532-444e-b624-13dc7128f119 None None] MFA Rules not processed for user `905b8b26a981445bbdec1622622261d6`. Rule list: `[]` (Enabled: `True`). {{(pid=86655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:05:58.844049 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-e4fe3a57-c532-444e-b624-13dc7128f119 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:05:58.893619 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:05:58.916322 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 1372/2732] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jul 14 11:05:58 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:05:58.927542 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0292493b-d0f3-40c5-b6ee-26df120d9c18 admin admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:05:58.929287 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-0292493b-d0f3-40c5-b6ee-26df120d9c18 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:05:58.987901 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0292493b-d0f3-40c5-b6ee-26df120d9c18 admin admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:05:58.991583 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2c7c02-94e5-4dda-8de9-b4e958036829 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68382432147a48c3b62271fd2a2eab04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59391272ecbe48b0aa736cb43807be1d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:05:58.992227 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2c7c02-94e5-4dda-8de9-b4e958036829 service cinder] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:05:58.992517 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2c7c02-94e5-4dda-8de9-b4e958036829 service cinder] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:05:58.992824 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2c7c02-94e5-4dda-8de9-b4e958036829 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:05:59.002261 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2c7c02-94e5-4dda-8de9-b4e958036829 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:05:59.003691 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2c7c02-94e5-4dda-8de9-b4e958036829 service cinder] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:05:59.014154 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 1361/2733] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jul 14 11:05:58 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 11:05:59.085863 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fe3a57-c532-444e-b624-13dc7128f119 None None] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:05:59.096626 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fe3a57-c532-444e-b624-13dc7128f119 None None] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:05:59.100311 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddb9f67-bc94-430d-bde1-b52c43930102 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68382432147a48c3b62271fd2a2eab04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59391272ecbe48b0aa736cb43807be1d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:05:59.100997 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddb9f67-bc94-430d-bde1-b52c43930102 service cinder] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:05:59.101290 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddb9f67-bc94-430d-bde1-b52c43930102 service cinder] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:05:59.101574 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddb9f67-bc94-430d-bde1-b52c43930102 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:05:59.160333 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ddb9f67-bc94-430d-bde1-b52c43930102 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:05:59.161814 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ddb9f67-bc94-430d-bde1-b52c43930102 service cinder] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:05:59.171529 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 1373/2734] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jul 14 11:05:59 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 11:06:03.191206 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2c7c02-94e5-4dda-8de9-b4e958036829 service cinder] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:06:03.251315 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2c7c02-94e5-4dda-8de9-b4e958036829 service cinder] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:06:03.255802 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9299976b-33e3-4e18-97d0-0ec8898038cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:06:03.256661 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9299976b-33e3-4e18-97d0-0ec8898038cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:06:03.256971 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9299976b-33e3-4e18-97d0-0ec8898038cc admin admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:06:03.257249 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9299976b-33e3-4e18-97d0-0ec8898038cc admin admin] PATH_INFO: `/v3/users/211ea3e2826941e68a6f17f23a7285e7` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:06:03.258417 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9299976b-33e3-4e18-97d0-0ec8898038cc admin admin] RBAC: Authorizing `identity:delete_user(user_id=211ea3e2826941e68a6f17f23a7285e7)` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:06:03.260314 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9299976b-33e3-4e18-97d0-0ec8898038cc admin admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:06:03.305907 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-9299976b-33e3-4e18-97d0-0ec8898038cc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '211ea3e2826941e68a6f17f23a7285e7'} {{(pid=86656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:06:03.313371 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-9299976b-33e3-4e18-97d0-0ec8898038cc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '211ea3e2826941e68a6f17f23a7285e7'} {{(pid=86656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:06:03.314073 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-9299976b-33e3-4e18-97d0-0ec8898038cc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '211ea3e2826941e68a6f17f23a7285e7'} {{(pid=86656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:06:03.321579 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-9299976b-33e3-4e18-97d0-0ec8898038cc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '211ea3e2826941e68a6f17f23a7285e7'} {{(pid=86656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:06:03.322268 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-9299976b-33e3-4e18-97d0-0ec8898038cc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '211ea3e2826941e68a6f17f23a7285e7'} {{(pid=86656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:06:03.340442 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 1362/2735] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Jul 14 11:06:03 2022] DELETE /identity/v3/users/211ea3e2826941e68a6f17f23a7285e7 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:06:03.344980 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599c86fd-aa9b-491e-b05e-7c59f18840b4 None None] REQUEST_METHOD: `POST` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:06:03.345496 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599c86fd-aa9b-491e-b05e-7c59f18840b4 None None] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:06:03.345606 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599c86fd-aa9b-491e-b05e-7c59f18840b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:06:03.362868 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.auth.core [None req-599c86fd-aa9b-491e-b05e-7c59f18840b4 None None] MFA Rules not processed for user `ae4bcdd8106d4bebbdcae96be33505bc`. Rule list: `[]` (Enabled: `True`). {{(pid=86655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:06:03.364075 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-599c86fd-aa9b-491e-b05e-7c59f18840b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:06:03.423413 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 1374/2736] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jul 14 11:06:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:06:03.433130 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9299976b-33e3-4e18-97d0-0ec8898038cc admin admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:06:03.434528 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-9299976b-33e3-4e18-97d0-0ec8898038cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:06:03.454960 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:06:03.492904 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9299976b-33e3-4e18-97d0-0ec8898038cc admin admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:06:03.496632 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec0e885-cc67-419d-a484-fd066c2180c7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dddf93691844886982c91fea974385d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59391272ecbe48b0aa736cb43807be1d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:06:03.497312 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec0e885-cc67-419d-a484-fd066c2180c7 service neutron] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:06:03.497595 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec0e885-cc67-419d-a484-fd066c2180c7 service neutron] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:06:03.497875 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec0e885-cc67-419d-a484-fd066c2180c7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:06:03.506778 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec0e885-cc67-419d-a484-fd066c2180c7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:06:03.508208 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec0e885-cc67-419d-a484-fd066c2180c7 service neutron] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:06:03.518188 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 1363/2737] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jul 14 11:06:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 11:06:03.810827 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599c86fd-aa9b-491e-b05e-7c59f18840b4 None None] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:06:03.812372 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-599c86fd-aa9b-491e-b05e-7c59f18840b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:06:03.824838 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599c86fd-aa9b-491e-b05e-7c59f18840b4 None None] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:06:03.830422 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d8faf6-ec3c-4daa-a1ad-662c61fcbabc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:06:03.831384 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d8faf6-ec3c-4daa-a1ad-662c61fcbabc admin admin] REQUEST_METHOD: `DELETE` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:06:03.831746 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d8faf6-ec3c-4daa-a1ad-662c61fcbabc admin admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:06:03.832097 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d8faf6-ec3c-4daa-a1ad-662c61fcbabc admin admin] PATH_INFO: `/v3/projects/3701d14bcce343bb8a2b38a8a1977c49` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:06:03.833543 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d8faf6-ec3c-4daa-a1ad-662c61fcbabc admin admin] RBAC: Authorizing `identity:delete_project(project_id=3701d14bcce343bb8a2b38a8a1977c49)` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:06:03.835564 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d8faf6-ec3c-4daa-a1ad-662c61fcbabc admin admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:06:03.885884 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-34d8faf6-ec3c-4daa-a1ad-662c61fcbabc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3701d14bcce343bb8a2b38a8a1977c49', 'request_id': 'req-34d8faf6-ec3c-4daa-a1ad-662c61fcbabc'} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:06:03.891313 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-34d8faf6-ec3c-4daa-a1ad-662c61fcbabc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3701d14bcce343bb8a2b38a8a1977c49', 'request_id': 'req-34d8faf6-ec3c-4daa-a1ad-662c61fcbabc'} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:06:03.898359 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-34d8faf6-ec3c-4daa-a1ad-662c61fcbabc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3701d14bcce343bb8a2b38a8a1977c49', 'request_id': 'req-34d8faf6-ec3c-4daa-a1ad-662c61fcbabc'} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:06:03.909937 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-34d8faf6-ec3c-4daa-a1ad-662c61fcbabc admin admin] The token cache is being invalidate because project 3701d14bcce343bb8a2b38a8a1977c49 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86655) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 11:06:03.910225 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-34d8faf6-ec3c-4daa-a1ad-662c61fcbabc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:06:03.910847 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-34d8faf6-ec3c-4daa-a1ad-662c61fcbabc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:06:03.912366 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 1375/2738] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Jul 14 11:06:03 2022] DELETE /identity/v3/projects/3701d14bcce343bb8a2b38a8a1977c49 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:06:03.916316 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec0e885-cc67-419d-a484-fd066c2180c7 service neutron] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:06:03.926696 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec0e885-cc67-419d-a484-fd066c2180c7 service neutron] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:06:03.982930 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af240f81-5ad3-400c-9434-274ab10c304f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:06:03.983807 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af240f81-5ad3-400c-9434-274ab10c304f admin admin] REQUEST_METHOD: `DELETE` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:06:03.984091 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af240f81-5ad3-400c-9434-274ab10c304f admin admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:06:03.984365 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af240f81-5ad3-400c-9434-274ab10c304f admin admin] PATH_INFO: `/v3/users/905b8b26a981445bbdec1622622261d6` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:06:03.985610 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af240f81-5ad3-400c-9434-274ab10c304f admin admin] RBAC: Authorizing `identity:delete_user(user_id=905b8b26a981445bbdec1622622261d6)` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:06:03.987513 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af240f81-5ad3-400c-9434-274ab10c304f admin admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:06:04.032478 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-af240f81-5ad3-400c-9434-274ab10c304f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '905b8b26a981445bbdec1622622261d6'} {{(pid=86656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:06:04.040361 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-af240f81-5ad3-400c-9434-274ab10c304f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '905b8b26a981445bbdec1622622261d6'} {{(pid=86656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:06:04.041760 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-af240f81-5ad3-400c-9434-274ab10c304f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '905b8b26a981445bbdec1622622261d6'} {{(pid=86656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:06:04.050329 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-af240f81-5ad3-400c-9434-274ab10c304f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '905b8b26a981445bbdec1622622261d6'} {{(pid=86656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:06:04.051749 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-af240f81-5ad3-400c-9434-274ab10c304f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '905b8b26a981445bbdec1622622261d6'} {{(pid=86656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:06:04.069963 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 1364/2739] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Jul 14 11:06:03 2022] DELETE /identity/v3/users/905b8b26a981445bbdec1622622261d6 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:06:04.346242 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d8faf6-ec3c-4daa-a1ad-662c61fcbabc admin admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:06:04.347761 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-34d8faf6-ec3c-4daa-a1ad-662c61fcbabc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:06:04.362641 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d8faf6-ec3c-4daa-a1ad-662c61fcbabc admin admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:06:04.367990 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:06:04.427219 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb8f4d4-9ac8-441b-ba39-7d4647090b09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:06:04.428088 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb8f4d4-9ac8-441b-ba39-7d4647090b09 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:06:04.428377 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb8f4d4-9ac8-441b-ba39-7d4647090b09 admin admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:06:04.428662 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb8f4d4-9ac8-441b-ba39-7d4647090b09 admin admin] PATH_INFO: `/v3/projects/cf918c53643e4301b365e4732a444787` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:06:04.429892 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb8f4d4-9ac8-441b-ba39-7d4647090b09 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cf918c53643e4301b365e4732a444787)` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:06:04.431804 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb8f4d4-9ac8-441b-ba39-7d4647090b09 admin admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:06:04.478717 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-ebb8f4d4-9ac8-441b-ba39-7d4647090b09 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cf918c53643e4301b365e4732a444787', 'request_id': 'req-ebb8f4d4-9ac8-441b-ba39-7d4647090b09'} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:06:04.484281 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-ebb8f4d4-9ac8-441b-ba39-7d4647090b09 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cf918c53643e4301b365e4732a444787', 'request_id': 'req-ebb8f4d4-9ac8-441b-ba39-7d4647090b09'} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:06:04.491475 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-ebb8f4d4-9ac8-441b-ba39-7d4647090b09 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cf918c53643e4301b365e4732a444787', 'request_id': 'req-ebb8f4d4-9ac8-441b-ba39-7d4647090b09'} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:06:04.502215 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-ebb8f4d4-9ac8-441b-ba39-7d4647090b09 admin admin] The token cache is being invalidate because project cf918c53643e4301b365e4732a444787 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86655) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 11:06:04.502498 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-ebb8f4d4-9ac8-441b-ba39-7d4647090b09 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:06:04.503118 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-ebb8f4d4-9ac8-441b-ba39-7d4647090b09 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:06:04.504652 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 1376/2740] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Jul 14 11:06:04 2022] DELETE /identity/v3/projects/cf918c53643e4301b365e4732a444787 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:06:04.509530 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90feebaf-d4f7-40cb-9929-3afb753eb58f None None] REQUEST_METHOD: `POST` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:06:04.509993 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90feebaf-d4f7-40cb-9929-3afb753eb58f None None] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:06:04.510152 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90feebaf-d4f7-40cb-9929-3afb753eb58f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:06:04.529709 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.auth.core [None req-90feebaf-d4f7-40cb-9929-3afb753eb58f None None] MFA Rules not processed for user `ae4bcdd8106d4bebbdcae96be33505bc`. Rule list: `[]` (Enabled: `True`). {{(pid=86656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:06:04.530915 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-90feebaf-d4f7-40cb-9929-3afb753eb58f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:06:04.563720 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:06:04.590942 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 1365/2741] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jul 14 11:06:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:06:04.598637 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f3f55e-eaeb-4f3c-a0e9-06a17f668859 None None] REQUEST_METHOD: `POST` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:06:04.598871 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f3f55e-eaeb-4f3c-a0e9-06a17f668859 None None] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:06:04.599157 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f3f55e-eaeb-4f3c-a0e9-06a17f668859 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:06:04.617133 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.auth.core [None req-f2f3f55e-eaeb-4f3c-a0e9-06a17f668859 None None] MFA Rules not processed for user `ae4bcdd8106d4bebbdcae96be33505bc`. Rule list: `[]` (Enabled: `True`). {{(pid=86655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:06:04.618323 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-f2f3f55e-eaeb-4f3c-a0e9-06a17f668859 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:06:04.627438 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 1377/2742] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jul 14 11:06:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:06:04.631498 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90feebaf-d4f7-40cb-9929-3afb753eb58f None None] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:06:04.641801 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90feebaf-d4f7-40cb-9929-3afb753eb58f None None] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:06:04.646601 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53a9843-82ee-45b9-9b57-68bbec92094d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:06:04.647286 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53a9843-82ee-45b9-9b57-68bbec92094d admin admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:06:04.647570 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53a9843-82ee-45b9-9b57-68bbec92094d admin admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:06:04.647870 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53a9843-82ee-45b9-9b57-68bbec92094d admin admin] PATH_INFO: `/v3/domains` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:06:04.648713 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53a9843-82ee-45b9-9b57-68bbec92094d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:06:04.649088 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53a9843-82ee-45b9-9b57-68bbec92094d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:06:04.650679 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53a9843-82ee-45b9-9b57-68bbec92094d admin admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:06:04.662984 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 1366/2743] 10.222.0.16 () {58 vars in 1152 bytes} [Thu Jul 14 11:06:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:06:04.667881 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f3f55e-eaeb-4f3c-a0e9-06a17f668859 None None] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:06:04.677362 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f3f55e-eaeb-4f3c-a0e9-06a17f668859 None None] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:06:04.681905 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b72916-a0d1-489b-82d2-65196f8e0344 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:06:04.683143 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b72916-a0d1-489b-82d2-65196f8e0344 admin admin] REQUEST_METHOD: `POST` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:06:04.683467 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b72916-a0d1-489b-82d2-65196f8e0344 admin admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:06:04.683743 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b72916-a0d1-489b-82d2-65196f8e0344 admin admin] PATH_INFO: `/v3/projects` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:06:04.684443 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b72916-a0d1-489b-82d2-65196f8e0344 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:06:04.686393 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b72916-a0d1-489b-82d2-65196f8e0344 admin admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:06:04.713024 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 1378/2744] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Jul 14 11:06:04 2022] POST /identity/v3/projects => generated 387 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 11:06:04.717128 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53a9843-82ee-45b9-9b57-68bbec92094d admin admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:06:04.726955 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53a9843-82ee-45b9-9b57-68bbec92094d admin admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:06:04.783928 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6867b6f3-08c3-4268-8bcf-b5360acdc026 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:06:04.784652 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6867b6f3-08c3-4268-8bcf-b5360acdc026 admin admin] REQUEST_METHOD: `POST` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:06:04.784968 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6867b6f3-08c3-4268-8bcf-b5360acdc026 admin admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:06:04.785261 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6867b6f3-08c3-4268-8bcf-b5360acdc026 admin admin] PATH_INFO: `/v3/users` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:06:04.786538 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6867b6f3-08c3-4268-8bcf-b5360acdc026 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:06:04.788451 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6867b6f3-08c3-4268-8bcf-b5360acdc026 admin admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:06:04.815357 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 1367/2745] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Jul 14 11:06:04 2022] POST /identity/v3/users => generated 294 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 11:06:04.819481 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b72916-a0d1-489b-82d2-65196f8e0344 admin admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:06:04.830637 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b72916-a0d1-489b-82d2-65196f8e0344 admin admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:06:04.835135 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e1d694-4f47-4fbb-b247-f084ea5c418d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:06:04.835789 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e1d694-4f47-4fbb-b247-f084ea5c418d admin admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:06:04.836071 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e1d694-4f47-4fbb-b247-f084ea5c418d admin admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:06:04.836348 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e1d694-4f47-4fbb-b247-f084ea5c418d admin admin] PATH_INFO: `/v3/roles` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:06:04.837124 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e1d694-4f47-4fbb-b247-f084ea5c418d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:06:04.838740 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e1d694-4f47-4fbb-b247-f084ea5c418d admin admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:06:04.849371 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 1379/2746] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jul 14 11:06:04 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 11:06:04.853070 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6867b6f3-08c3-4268-8bcf-b5360acdc026 admin admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:06:04.864278 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6867b6f3-08c3-4268-8bcf-b5360acdc026 admin admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:06:04.869142 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7ba7dc-7481-4cd6-9012-82ce337eac7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:06:04.870304 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7ba7dc-7481-4cd6-9012-82ce337eac7d admin admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:06:04.870743 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7ba7dc-7481-4cd6-9012-82ce337eac7d admin admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:06:04.871033 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7ba7dc-7481-4cd6-9012-82ce337eac7d admin admin] PATH_INFO: `/v3/roles` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:06:04.871931 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7ba7dc-7481-4cd6-9012-82ce337eac7d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:06:04.873560 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7ba7dc-7481-4cd6-9012-82ce337eac7d admin admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:06:04.883793 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 1368/2747] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jul 14 11:06:04 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 11:06:04.888618 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e1d694-4f47-4fbb-b247-f084ea5c418d admin admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:06:04.898748 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e1d694-4f47-4fbb-b247-f084ea5c418d admin admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:06:04.903648 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b53371-f62b-4f81-9342-141dcd162d12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:06:04.904537 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b53371-f62b-4f81-9342-141dcd162d12 admin admin] REQUEST_METHOD: `PUT` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:06:04.904852 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b53371-f62b-4f81-9342-141dcd162d12 admin admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:06:04.905132 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b53371-f62b-4f81-9342-141dcd162d12 admin admin] PATH_INFO: `/v3/projects/f39c5e5bcb174284bd941e903c3fbf4a/users/c7689aae196e4f6faaeb657a5cb0074c/roles/0da46c267d354cce81495dfdd56c1ec2` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:06:04.920737 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b53371-f62b-4f81-9342-141dcd162d12 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f39c5e5bcb174284bd941e903c3fbf4a, user_id=c7689aae196e4f6faaeb657a5cb0074c, role_id=0da46c267d354cce81495dfdd56c1ec2)` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:06:04.923389 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b53371-f62b-4f81-9342-141dcd162d12 admin admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:06:04.936635 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 1380/2748] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Jul 14 11:06:04 2022] PUT /identity/v3/projects/f39c5e5bcb174284bd941e903c3fbf4a/users/c7689aae196e4f6faaeb657a5cb0074c/roles/0da46c267d354cce81495dfdd56c1ec2 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:06:04.948765 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ea77be-5343-4ce3-854f-90e8ad795bac None None] REQUEST_METHOD: `POST` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:06:04.949087 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ea77be-5343-4ce3-854f-90e8ad795bac None None] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:06:04.949367 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ea77be-5343-4ce3-854f-90e8ad795bac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:06:04.974900 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.auth.core [None req-48ea77be-5343-4ce3-854f-90e8ad795bac None None] MFA Rules not processed for user `c7689aae196e4f6faaeb657a5cb0074c`. Rule list: `[]` (Enabled: `True`). {{(pid=86656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:06:04.976144 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-48ea77be-5343-4ce3-854f-90e8ad795bac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:06:05.045528 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 1369/2749] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jul 14 11:06:04 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:06:05.050115 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b53371-f62b-4f81-9342-141dcd162d12 admin admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:06:05.085736 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:06:05.114739 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b53371-f62b-4f81-9342-141dcd162d12 admin admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:06:05.119179 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f0069b-4fb4-4a09-b47f-2ff85bca5fa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:06:05.119909 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f0069b-4fb4-4a09-b47f-2ff85bca5fa8 admin admin] REQUEST_METHOD: `POST` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:06:05.120707 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f0069b-4fb4-4a09-b47f-2ff85bca5fa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:06:05.121013 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f0069b-4fb4-4a09-b47f-2ff85bca5fa8 admin admin] PATH_INFO: `/v3/projects` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:06:05.121703 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f0069b-4fb4-4a09-b47f-2ff85bca5fa8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:06:05.123581 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f0069b-4fb4-4a09-b47f-2ff85bca5fa8 admin admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:06:05.147535 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 1381/2750] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Jul 14 11:06:05 2022] POST /identity/v3/projects => generated 385 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 11:06:05.151610 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ea77be-5343-4ce3-854f-90e8ad795bac None None] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:06:05.162377 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ea77be-5343-4ce3-854f-90e8ad795bac None None] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:06:05.194942 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:06:05.219700 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9383825e-ddd9-4a3e-b923-95a6c4e31c8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:06:05.220369 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9383825e-ddd9-4a3e-b923-95a6c4e31c8a admin admin] REQUEST_METHOD: `POST` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:06:05.220649 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9383825e-ddd9-4a3e-b923-95a6c4e31c8a admin admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:06:05.220952 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9383825e-ddd9-4a3e-b923-95a6c4e31c8a admin admin] PATH_INFO: `/v3/users` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:06:05.221648 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9383825e-ddd9-4a3e-b923-95a6c4e31c8a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:06:05.223547 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9383825e-ddd9-4a3e-b923-95a6c4e31c8a admin admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:06:05.243244 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 1370/2751] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Jul 14 11:06:05 2022] POST /identity/v3/users => generated 299 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 11:06:05.247887 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f0069b-4fb4-4a09-b47f-2ff85bca5fa8 admin admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:06:05.258051 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f0069b-4fb4-4a09-b47f-2ff85bca5fa8 admin admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:06:05.262618 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d75b18-7054-4c6c-aedc-da3801dee7fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:06:05.263272 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d75b18-7054-4c6c-aedc-da3801dee7fd admin admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:06:05.263557 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d75b18-7054-4c6c-aedc-da3801dee7fd admin admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:06:05.263837 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d75b18-7054-4c6c-aedc-da3801dee7fd admin admin] PATH_INFO: `/v3/roles` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:06:05.264562 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d75b18-7054-4c6c-aedc-da3801dee7fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:06:05.266186 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d75b18-7054-4c6c-aedc-da3801dee7fd admin admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:06:05.276461 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 1382/2752] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jul 14 11:06:05 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 11:06:05.280470 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9383825e-ddd9-4a3e-b923-95a6c4e31c8a admin admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:06:05.290528 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9383825e-ddd9-4a3e-b923-95a6c4e31c8a admin admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:06:05.296617 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f64571-6679-45d9-8d4f-6d010e1564b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:06:05.297524 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f64571-6679-45d9-8d4f-6d010e1564b2 admin admin] REQUEST_METHOD: `PUT` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:06:05.297812 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f64571-6679-45d9-8d4f-6d010e1564b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:06:05.298094 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f64571-6679-45d9-8d4f-6d010e1564b2 admin admin] PATH_INFO: `/v3/projects/369a455bae7a48e8bcbe00122ad109b2/users/34ce279d0d6343618056c50d67215152/roles/153539819e5542df99269d2913bbecfb` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:06:05.313736 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f64571-6679-45d9-8d4f-6d010e1564b2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=369a455bae7a48e8bcbe00122ad109b2, user_id=34ce279d0d6343618056c50d67215152, role_id=153539819e5542df99269d2913bbecfb)` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:06:05.316380 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f64571-6679-45d9-8d4f-6d010e1564b2 admin admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:06:05.333763 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 1371/2753] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Jul 14 11:06:05 2022] PUT /identity/v3/projects/369a455bae7a48e8bcbe00122ad109b2/users/34ce279d0d6343618056c50d67215152/roles/153539819e5542df99269d2913bbecfb => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:06:05.338007 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d75b18-7054-4c6c-aedc-da3801dee7fd admin admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:06:05.348487 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d75b18-7054-4c6c-aedc-da3801dee7fd admin admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:06:05.404203 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b48ad12-3e63-405a-b36f-ae9e3e33b038 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:06:05.404807 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b48ad12-3e63-405a-b36f-ae9e3e33b038 admin admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:06:05.405099 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b48ad12-3e63-405a-b36f-ae9e3e33b038 admin admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:06:05.405380 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b48ad12-3e63-405a-b36f-ae9e3e33b038 admin admin] PATH_INFO: `/v3/roles` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:06:05.406113 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b48ad12-3e63-405a-b36f-ae9e3e33b038 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:06:05.407709 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b48ad12-3e63-405a-b36f-ae9e3e33b038 admin admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:06:05.420832 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 1383/2754] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jul 14 11:06:05 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 11:06:05.422455 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f64571-6679-45d9-8d4f-6d010e1564b2 admin admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:06:05.432905 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f64571-6679-45d9-8d4f-6d010e1564b2 admin admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:06:05.437443 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9c9702-4bb3-41b6-8709-4ee34c186b67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:06:05.438325 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9c9702-4bb3-41b6-8709-4ee34c186b67 admin admin] REQUEST_METHOD: `PUT` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:06:05.438599 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9c9702-4bb3-41b6-8709-4ee34c186b67 admin admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:06:05.438868 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9c9702-4bb3-41b6-8709-4ee34c186b67 admin admin] PATH_INFO: `/v3/projects/369a455bae7a48e8bcbe00122ad109b2/users/34ce279d0d6343618056c50d67215152/roles/153539819e5542df99269d2913bbecfb` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:06:05.441109 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9c9702-4bb3-41b6-8709-4ee34c186b67 admin admin] RBAC: Authorizing `identity:create_grant(project_id=369a455bae7a48e8bcbe00122ad109b2, user_id=34ce279d0d6343618056c50d67215152, role_id=153539819e5542df99269d2913bbecfb)` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:06:05.443703 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9c9702-4bb3-41b6-8709-4ee34c186b67 admin admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:06:05.454325 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 1372/2755] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Jul 14 11:06:05 2022] PUT /identity/v3/projects/369a455bae7a48e8bcbe00122ad109b2/users/34ce279d0d6343618056c50d67215152/roles/153539819e5542df99269d2913bbecfb => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:06:05.465200 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47563d5-800d-4789-907a-6e57cd5bcf85 None None] REQUEST_METHOD: `POST` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:06:05.465501 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47563d5-800d-4789-907a-6e57cd5bcf85 None None] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:06:05.465790 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47563d5-800d-4789-907a-6e57cd5bcf85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:06:05.492723 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.auth.core [None req-b47563d5-800d-4789-907a-6e57cd5bcf85 None None] MFA Rules not processed for user `34ce279d0d6343618056c50d67215152`. Rule list: `[]` (Enabled: `True`). {{(pid=86655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:06:05.493978 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-b47563d5-800d-4789-907a-6e57cd5bcf85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:06:05.561177 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 1384/2756] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jul 14 11:06:05 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:06:05.571901 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9c9702-4bb3-41b6-8709-4ee34c186b67 admin admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:06:05.573644 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-fe9c9702-4bb3-41b6-8709-4ee34c186b67 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:06:05.633392 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9c9702-4bb3-41b6-8709-4ee34c186b67 admin admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:06:05.637136 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93264b87-8fc7-4fcd-bf16-0eeaccdea17d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68382432147a48c3b62271fd2a2eab04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59391272ecbe48b0aa736cb43807be1d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:06:05.637789 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93264b87-8fc7-4fcd-bf16-0eeaccdea17d service cinder] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:06:05.638074 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93264b87-8fc7-4fcd-bf16-0eeaccdea17d service cinder] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:06:05.638352 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93264b87-8fc7-4fcd-bf16-0eeaccdea17d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:06:05.647691 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93264b87-8fc7-4fcd-bf16-0eeaccdea17d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:06:05.649200 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93264b87-8fc7-4fcd-bf16-0eeaccdea17d service cinder] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:06:05.659846 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 1373/2757] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jul 14 11:06:05 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 11:06:06.178287 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47563d5-800d-4789-907a-6e57cd5bcf85 None None] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:06:06.210410 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:06:06.242905 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47563d5-800d-4789-907a-6e57cd5bcf85 None None] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:06:06.247672 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9484f846-e054-4183-8690-f36aee2a5d98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:06:06.248542 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9484f846-e054-4183-8690-f36aee2a5d98 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:06:06.248856 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9484f846-e054-4183-8690-f36aee2a5d98 admin admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:06:06.249140 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9484f846-e054-4183-8690-f36aee2a5d98 admin admin] PATH_INFO: `/v3/users/c7689aae196e4f6faaeb657a5cb0074c` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:06:06.250320 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9484f846-e054-4183-8690-f36aee2a5d98 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c7689aae196e4f6faaeb657a5cb0074c)` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:06:06.252224 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9484f846-e054-4183-8690-f36aee2a5d98 admin admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:06:06.297030 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-9484f846-e054-4183-8690-f36aee2a5d98 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c7689aae196e4f6faaeb657a5cb0074c'} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:06:06.304266 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-9484f846-e054-4183-8690-f36aee2a5d98 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c7689aae196e4f6faaeb657a5cb0074c'} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:06:06.305015 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-9484f846-e054-4183-8690-f36aee2a5d98 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c7689aae196e4f6faaeb657a5cb0074c'} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:06:06.312994 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-9484f846-e054-4183-8690-f36aee2a5d98 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c7689aae196e4f6faaeb657a5cb0074c'} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:06:06.313639 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-9484f846-e054-4183-8690-f36aee2a5d98 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c7689aae196e4f6faaeb657a5cb0074c'} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:06:06.330850 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 1385/2758] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Jul 14 11:06:06 2022] DELETE /identity/v3/users/c7689aae196e4f6faaeb657a5cb0074c => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:06:06.335327 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051919f3-e5f1-4dda-8bfb-c2b0154696be None None] REQUEST_METHOD: `POST` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:06:06.335603 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051919f3-e5f1-4dda-8bfb-c2b0154696be None None] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:06:06.335884 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051919f3-e5f1-4dda-8bfb-c2b0154696be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:06:06.353569 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.auth.core [None req-051919f3-e5f1-4dda-8bfb-c2b0154696be None None] MFA Rules not processed for user `ae4bcdd8106d4bebbdcae96be33505bc`. Rule list: `[]` (Enabled: `True`). {{(pid=86656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:06:06.355351 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-051919f3-e5f1-4dda-8bfb-c2b0154696be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:06:06.413797 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 1374/2759] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jul 14 11:06:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:06:06.423819 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9484f846-e054-4183-8690-f36aee2a5d98 admin admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:06:06.425311 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-9484f846-e054-4183-8690-f36aee2a5d98 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:06:06.482231 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9484f846-e054-4183-8690-f36aee2a5d98 admin admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:06:06.485834 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2de13ed-cbba-423a-bc64-5ae17a4dee4f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dddf93691844886982c91fea974385d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59391272ecbe48b0aa736cb43807be1d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:06:06.486472 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2de13ed-cbba-423a-bc64-5ae17a4dee4f service neutron] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:06:06.486757 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2de13ed-cbba-423a-bc64-5ae17a4dee4f service neutron] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:06:06.487031 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2de13ed-cbba-423a-bc64-5ae17a4dee4f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:06:06.496254 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2de13ed-cbba-423a-bc64-5ae17a4dee4f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:06:06.497703 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2de13ed-cbba-423a-bc64-5ae17a4dee4f service neutron] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:06:06.506919 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 1386/2760] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jul 14 11:06:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 11:06:06.774654 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051919f3-e5f1-4dda-8bfb-c2b0154696be None None] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:06:06.776793 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-051919f3-e5f1-4dda-8bfb-c2b0154696be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:06:06.791871 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051919f3-e5f1-4dda-8bfb-c2b0154696be None None] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:06:06.796613 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac856ccf-3608-4ed4-97ef-a27cd2602f40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:06:06.797524 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac856ccf-3608-4ed4-97ef-a27cd2602f40 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:06:06.797810 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac856ccf-3608-4ed4-97ef-a27cd2602f40 admin admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:06:06.798087 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac856ccf-3608-4ed4-97ef-a27cd2602f40 admin admin] PATH_INFO: `/v3/projects/f39c5e5bcb174284bd941e903c3fbf4a` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:06:06.799302 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac856ccf-3608-4ed4-97ef-a27cd2602f40 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f39c5e5bcb174284bd941e903c3fbf4a)` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:06:06.801725 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac856ccf-3608-4ed4-97ef-a27cd2602f40 admin admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:06:06.833295 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=94,keystone:INSERT=5,keystone:DELETE=1 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:06:06.851124 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-ac856ccf-3608-4ed4-97ef-a27cd2602f40 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f39c5e5bcb174284bd941e903c3fbf4a', 'request_id': 'req-ac856ccf-3608-4ed4-97ef-a27cd2602f40'} {{(pid=86656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:06:06.858013 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-ac856ccf-3608-4ed4-97ef-a27cd2602f40 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f39c5e5bcb174284bd941e903c3fbf4a', 'request_id': 'req-ac856ccf-3608-4ed4-97ef-a27cd2602f40'} {{(pid=86656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:06:06.864092 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-ac856ccf-3608-4ed4-97ef-a27cd2602f40 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f39c5e5bcb174284bd941e903c3fbf4a', 'request_id': 'req-ac856ccf-3608-4ed4-97ef-a27cd2602f40'} {{(pid=86656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:06:06.874963 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-ac856ccf-3608-4ed4-97ef-a27cd2602f40 admin admin] The token cache is being invalidate because project f39c5e5bcb174284bd941e903c3fbf4a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86656) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 11:06:06.875248 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-ac856ccf-3608-4ed4-97ef-a27cd2602f40 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:06:06.875876 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-ac856ccf-3608-4ed4-97ef-a27cd2602f40 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:06:06.877433 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 1375/2761] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Jul 14 11:06:06 2022] DELETE /identity/v3/projects/f39c5e5bcb174284bd941e903c3fbf4a => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:06:06.881491 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2de13ed-cbba-423a-bc64-5ae17a4dee4f service neutron] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:06:06.892512 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2de13ed-cbba-423a-bc64-5ae17a4dee4f service neutron] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:06:06.939592 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:06:06.951349 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd8cb11-5257-4e79-82fa-1cdc64ea3823 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:06:06.952162 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd8cb11-5257-4e79-82fa-1cdc64ea3823 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:06:06.952451 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd8cb11-5257-4e79-82fa-1cdc64ea3823 admin admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:06:06.952738 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd8cb11-5257-4e79-82fa-1cdc64ea3823 admin admin] PATH_INFO: `/v3/users/34ce279d0d6343618056c50d67215152` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:06:06.953952 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd8cb11-5257-4e79-82fa-1cdc64ea3823 admin admin] RBAC: Authorizing `identity:delete_user(user_id=34ce279d0d6343618056c50d67215152)` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:06:06.955871 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd8cb11-5257-4e79-82fa-1cdc64ea3823 admin admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:06:06.999960 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-4bd8cb11-5257-4e79-82fa-1cdc64ea3823 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '34ce279d0d6343618056c50d67215152'} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:06:07.006906 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-4bd8cb11-5257-4e79-82fa-1cdc64ea3823 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '34ce279d0d6343618056c50d67215152'} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:06:07.007527 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-4bd8cb11-5257-4e79-82fa-1cdc64ea3823 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '34ce279d0d6343618056c50d67215152'} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:06:07.015497 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-4bd8cb11-5257-4e79-82fa-1cdc64ea3823 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '34ce279d0d6343618056c50d67215152'} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:06:07.016168 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-4bd8cb11-5257-4e79-82fa-1cdc64ea3823 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '34ce279d0d6343618056c50d67215152'} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:06:07.034146 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 1387/2762] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Jul 14 11:06:06 2022] DELETE /identity/v3/users/34ce279d0d6343618056c50d67215152 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 11:06:07.298832 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac856ccf-3608-4ed4-97ef-a27cd2602f40 admin admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:06:07.300397 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-ac856ccf-3608-4ed4-97ef-a27cd2602f40 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:06:07.314016 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac856ccf-3608-4ed4-97ef-a27cd2602f40 admin admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:06:07.369426 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdf2676-d15c-432c-83d2-f1d93bf147de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:06:07.370984 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdf2676-d15c-432c-83d2-f1d93bf147de admin admin] REQUEST_METHOD: `DELETE` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:06:07.371267 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdf2676-d15c-432c-83d2-f1d93bf147de admin admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:06:07.371545 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdf2676-d15c-432c-83d2-f1d93bf147de admin admin] PATH_INFO: `/v3/projects/369a455bae7a48e8bcbe00122ad109b2` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:06:07.372725 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfdf2676-d15c-432c-83d2-f1d93bf147de admin admin] RBAC: Authorizing `identity:delete_project(project_id=369a455bae7a48e8bcbe00122ad109b2)` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:06:07.374641 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfdf2676-d15c-432c-83d2-f1d93bf147de admin admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:06:07.420348 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-dfdf2676-d15c-432c-83d2-f1d93bf147de admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '369a455bae7a48e8bcbe00122ad109b2', 'request_id': 'req-dfdf2676-d15c-432c-83d2-f1d93bf147de'} {{(pid=86656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:06:07.429067 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-dfdf2676-d15c-432c-83d2-f1d93bf147de admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '369a455bae7a48e8bcbe00122ad109b2', 'request_id': 'req-dfdf2676-d15c-432c-83d2-f1d93bf147de'} {{(pid=86656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:06:07.436360 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-dfdf2676-d15c-432c-83d2-f1d93bf147de admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '369a455bae7a48e8bcbe00122ad109b2', 'request_id': 'req-dfdf2676-d15c-432c-83d2-f1d93bf147de'} {{(pid=86656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:06:07.447011 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-dfdf2676-d15c-432c-83d2-f1d93bf147de admin admin] The token cache is being invalidate because project 369a455bae7a48e8bcbe00122ad109b2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86656) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 11:06:07.447300 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-dfdf2676-d15c-432c-83d2-f1d93bf147de admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:06:07.448442 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-dfdf2676-d15c-432c-83d2-f1d93bf147de admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:06:07.450353 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 1376/2763] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Jul 14 11:06:07 2022] DELETE /identity/v3/projects/369a455bae7a48e8bcbe00122ad109b2 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:06:07.455200 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17b2714-5c4b-4766-bda8-caff6838cc72 None None] REQUEST_METHOD: `POST` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:06:07.455672 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17b2714-5c4b-4766-bda8-caff6838cc72 None None] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:06:07.455768 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17b2714-5c4b-4766-bda8-caff6838cc72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:06:07.474507 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.auth.core [None req-e17b2714-5c4b-4766-bda8-caff6838cc72 None None] MFA Rules not processed for user `ae4bcdd8106d4bebbdcae96be33505bc`. Rule list: `[]` (Enabled: `True`). {{(pid=86655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:06:07.475662 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-e17b2714-5c4b-4766-bda8-caff6838cc72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:06:07.534626 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 1388/2764] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jul 14 11:06:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:06:07.543000 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899e080f-c4f5-4ca2-8eac-fc2432b8343b None None] REQUEST_METHOD: `POST` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:06:07.543281 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899e080f-c4f5-4ca2-8eac-fc2432b8343b None None] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:06:07.543582 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899e080f-c4f5-4ca2-8eac-fc2432b8343b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:06:07.562931 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.auth.core [None req-899e080f-c4f5-4ca2-8eac-fc2432b8343b None None] MFA Rules not processed for user `ae4bcdd8106d4bebbdcae96be33505bc`. Rule list: `[]` (Enabled: `True`). {{(pid=86656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:06:07.564122 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-899e080f-c4f5-4ca2-8eac-fc2432b8343b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:06:07.572021 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 1377/2765] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jul 14 11:06:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 11:06:07.576632 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17b2714-5c4b-4766-bda8-caff6838cc72 None None] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:06:07.586253 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17b2714-5c4b-4766-bda8-caff6838cc72 None None] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:06:07.591812 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237a551e-e0e6-4fa4-b1d9-2e7285e5668e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:06:07.592468 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237a551e-e0e6-4fa4-b1d9-2e7285e5668e admin admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:06:07.592755 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237a551e-e0e6-4fa4-b1d9-2e7285e5668e admin admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:06:07.593072 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237a551e-e0e6-4fa4-b1d9-2e7285e5668e admin admin] PATH_INFO: `/v3/domains` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:06:07.593811 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237a551e-e0e6-4fa4-b1d9-2e7285e5668e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:06:07.594126 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237a551e-e0e6-4fa4-b1d9-2e7285e5668e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:06:07.595736 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237a551e-e0e6-4fa4-b1d9-2e7285e5668e admin admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:06:07.607959 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 1389/2766] 10.222.0.16 () {58 vars in 1152 bytes} [Thu Jul 14 11:06:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:06:07.612081 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899e080f-c4f5-4ca2-8eac-fc2432b8343b None None] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:06:07.621288 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899e080f-c4f5-4ca2-8eac-fc2432b8343b None None] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:06:07.626459 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6872ea-72db-465d-adcc-150741dc5b4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:06:07.627162 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6872ea-72db-465d-adcc-150741dc5b4c admin admin] REQUEST_METHOD: `POST` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:06:07.627503 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6872ea-72db-465d-adcc-150741dc5b4c admin admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:06:07.627780 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6872ea-72db-465d-adcc-150741dc5b4c admin admin] PATH_INFO: `/v3/projects` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:06:07.628557 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6872ea-72db-465d-adcc-150741dc5b4c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:06:07.630588 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6872ea-72db-465d-adcc-150741dc5b4c admin admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:06:07.656262 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 1378/2767] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Jul 14 11:06:07 2022] POST /identity/v3/projects => generated 375 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 11:06:07.660350 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237a551e-e0e6-4fa4-b1d9-2e7285e5668e admin admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:06:07.670847 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237a551e-e0e6-4fa4-b1d9-2e7285e5668e admin admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:06:07.721149 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:06:07.727826 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8895f2a1-b944-46a2-9f8e-bb9171033261 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:06:07.728620 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8895f2a1-b944-46a2-9f8e-bb9171033261 admin admin] REQUEST_METHOD: `POST` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:06:07.729094 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8895f2a1-b944-46a2-9f8e-bb9171033261 admin admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:06:07.730003 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8895f2a1-b944-46a2-9f8e-bb9171033261 admin admin] PATH_INFO: `/v3/users` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:06:07.731269 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8895f2a1-b944-46a2-9f8e-bb9171033261 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:06:07.733753 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8895f2a1-b944-46a2-9f8e-bb9171033261 admin admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:06:07.753109 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 1390/2768] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Jul 14 11:06:07 2022] POST /identity/v3/users => generated 288 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 11:06:07.757181 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6872ea-72db-465d-adcc-150741dc5b4c admin admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:06:07.769862 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6872ea-72db-465d-adcc-150741dc5b4c admin admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:06:07.774412 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2deb683a-97cb-48f3-8291-0155a4f4f406 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:06:07.775095 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2deb683a-97cb-48f3-8291-0155a4f4f406 admin admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:06:07.775671 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2deb683a-97cb-48f3-8291-0155a4f4f406 admin admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:06:07.775671 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2deb683a-97cb-48f3-8291-0155a4f4f406 admin admin] PATH_INFO: `/v3/roles` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:06:07.776903 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2deb683a-97cb-48f3-8291-0155a4f4f406 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:06:07.778509 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2deb683a-97cb-48f3-8291-0155a4f4f406 admin admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:06:07.789396 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 1379/2769] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jul 14 11:06:07 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 11:06:07.795775 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8895f2a1-b944-46a2-9f8e-bb9171033261 admin admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:06:07.806035 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8895f2a1-b944-46a2-9f8e-bb9171033261 admin admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:06:07.810800 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f43f8a2-7232-4924-9fec-d3359afd0d79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:06:07.811457 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f43f8a2-7232-4924-9fec-d3359afd0d79 admin admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:06:07.811741 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f43f8a2-7232-4924-9fec-d3359afd0d79 admin admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:06:07.812016 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f43f8a2-7232-4924-9fec-d3359afd0d79 admin admin] PATH_INFO: `/v3/roles` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:06:07.812742 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f43f8a2-7232-4924-9fec-d3359afd0d79 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:06:07.814455 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f43f8a2-7232-4924-9fec-d3359afd0d79 admin admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:06:07.824737 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 1391/2770] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jul 14 11:06:07 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 11:06:07.828900 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2deb683a-97cb-48f3-8291-0155a4f4f406 admin admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:06:07.835076 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:DELETE=13,keystone:SELECT=84,keystone:INSERT=3 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:06:07.839451 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2deb683a-97cb-48f3-8291-0155a4f4f406 admin admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:06:07.845411 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8130a8-8351-4bb5-8dae-f361417237fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:06:07.846584 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8130a8-8351-4bb5-8dae-f361417237fa admin admin] REQUEST_METHOD: `PUT` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:06:07.847138 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8130a8-8351-4bb5-8dae-f361417237fa admin admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:06:07.847648 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8130a8-8351-4bb5-8dae-f361417237fa admin admin] PATH_INFO: `/v3/projects/de7ac7b0302f4c5a89f839efa5562ced/users/ed511e0a0cb74db5905aafe41dd64be9/roles/0da46c267d354cce81495dfdd56c1ec2` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:06:07.862831 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8130a8-8351-4bb5-8dae-f361417237fa admin admin] RBAC: Authorizing `identity:create_grant(project_id=de7ac7b0302f4c5a89f839efa5562ced, user_id=ed511e0a0cb74db5905aafe41dd64be9, role_id=0da46c267d354cce81495dfdd56c1ec2)` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:06:07.865524 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8130a8-8351-4bb5-8dae-f361417237fa admin admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:06:07.877966 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 1380/2771] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Jul 14 11:06:07 2022] PUT /identity/v3/projects/de7ac7b0302f4c5a89f839efa5562ced/users/ed511e0a0cb74db5905aafe41dd64be9/roles/0da46c267d354cce81495dfdd56c1ec2 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:06:07.889463 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4c6de5-3bfe-483b-b78f-316fe7564a68 None None] REQUEST_METHOD: `POST` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:06:07.889756 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4c6de5-3bfe-483b-b78f-316fe7564a68 None None] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:06:07.890051 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4c6de5-3bfe-483b-b78f-316fe7564a68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:06:07.916514 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.auth.core [None req-5f4c6de5-3bfe-483b-b78f-316fe7564a68 None None] MFA Rules not processed for user `ed511e0a0cb74db5905aafe41dd64be9`. Rule list: `[]` (Enabled: `True`). {{(pid=86655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:06:07.918313 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-5f4c6de5-3bfe-483b-b78f-316fe7564a68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:06:07.982199 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 1392/2772] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jul 14 11:06:07 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:06:07.992802 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8130a8-8351-4bb5-8dae-f361417237fa admin admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:06:07.994519 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-2f8130a8-8351-4bb5-8dae-f361417237fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:06:08.050793 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8130a8-8351-4bb5-8dae-f361417237fa admin admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:06:08.054455 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8051234e-e8e8-469e-a9f4-c123f7d5806e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68382432147a48c3b62271fd2a2eab04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59391272ecbe48b0aa736cb43807be1d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:06:08.055097 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8051234e-e8e8-469e-a9f4-c123f7d5806e service cinder] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:06:08.055386 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8051234e-e8e8-469e-a9f4-c123f7d5806e service cinder] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:06:08.055668 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8051234e-e8e8-469e-a9f4-c123f7d5806e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:06:08.064302 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8051234e-e8e8-469e-a9f4-c123f7d5806e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:06:08.065766 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8051234e-e8e8-469e-a9f4-c123f7d5806e service cinder] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:06:08.076330 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 1381/2773] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jul 14 11:06:07 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 11:06:09.415519 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9bd3f5-6dab-46d5-ac7a-92530758ae1c None None] REQUEST_METHOD: `POST` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:06:09.416064 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9bd3f5-6dab-46d5-ac7a-92530758ae1c None None] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:06:09.416184 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9bd3f5-6dab-46d5-ac7a-92530758ae1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:06:09.435154 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.auth.core [None req-1e9bd3f5-6dab-46d5-ac7a-92530758ae1c None None] MFA Rules not processed for user `ed511e0a0cb74db5905aafe41dd64be9`. Rule list: `[]` (Enabled: `True`). {{(pid=86655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:06:09.436374 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-1e9bd3f5-6dab-46d5-ac7a-92530758ae1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:06:09.443443 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 1393/2774] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jul 14 11:06:09 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:06:18.071627 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=34,keystone:INSERT=1 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:06:19.429321 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=43,keystone:INSERT=3 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:06:25.141124 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fccb60-2831-4abe-ba8b-c9c2937902fc None None] REQUEST_METHOD: `POST` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:06:25.141627 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fccb60-2831-4abe-ba8b-c9c2937902fc None None] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:06:25.141745 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fccb60-2831-4abe-ba8b-c9c2937902fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:06:25.191520 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.auth.core [None req-46fccb60-2831-4abe-ba8b-c9c2937902fc None None] MFA Rules not processed for user `0dfc7cd9c05e4f268d2ce316d531c4bd`. Rule list: `[]` (Enabled: `True`). {{(pid=86656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:06:25.192807 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-46fccb60-2831-4abe-ba8b-c9c2937902fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:06:25.255720 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 1382/2775] 10.222.0.16 () {58 vars in 1009 bytes} [Thu Jul 14 11:06:25 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:06:25.300795 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9bd3f5-6dab-46d5-ac7a-92530758ae1c None None] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:06:25.302219 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-1e9bd3f5-6dab-46d5-ac7a-92530758ae1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:06:25.391015 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9bd3f5-6dab-46d5-ac7a-92530758ae1c None None] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:06:25.395942 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40be80d4-01c9-4fdf-ad72-eb88fdd8cd6b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a23de49b80643eaab7a212f2884d62e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59391272ecbe48b0aa736cb43807be1d', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:06:25.396588 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40be80d4-01c9-4fdf-ad72-eb88fdd8cd6b service swift] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:06:25.396933 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40be80d4-01c9-4fdf-ad72-eb88fdd8cd6b service swift] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:06:25.397197 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40be80d4-01c9-4fdf-ad72-eb88fdd8cd6b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:06:25.405909 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40be80d4-01c9-4fdf-ad72-eb88fdd8cd6b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:06:25.407485 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40be80d4-01c9-4fdf-ad72-eb88fdd8cd6b service swift] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:06:25.415461 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 1394/2776] 10.222.0.16 () {60 vars in 1384 bytes} [Thu Jul 14 11:06:25 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 14 11:06:25.911980 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbf9398-7c22-44a8-9104-d5f34778887e None None] REQUEST_METHOD: `POST` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:06:25.912282 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbf9398-7c22-44a8-9104-d5f34778887e None None] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:06:25.912644 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbf9398-7c22-44a8-9104-d5f34778887e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:06:25.930071 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.auth.core [None req-bbbf9398-7c22-44a8-9104-d5f34778887e None None] MFA Rules not processed for user `0dfc7cd9c05e4f268d2ce316d531c4bd`. Rule list: `[]` (Enabled: `True`). {{(pid=86656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:06:25.931269 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-bbbf9398-7c22-44a8-9104-d5f34778887e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:06:25.938898 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 1383/2777] 10.222.0.16 () {58 vars in 967 bytes} [Thu Jul 14 11:06:25 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:06:25.951660 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40be80d4-01c9-4fdf-ad72-eb88fdd8cd6b service swift] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:06:25.962164 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40be80d4-01c9-4fdf-ad72-eb88fdd8cd6b service swift] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:06:25.967263 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8567bf64-b3e1-49f8-a245-e1680609a274 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a23de49b80643eaab7a212f2884d62e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59391272ecbe48b0aa736cb43807be1d', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:06:25.967892 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8567bf64-b3e1-49f8-a245-e1680609a274 service swift] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:06:25.968174 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8567bf64-b3e1-49f8-a245-e1680609a274 service swift] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:06:25.968452 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8567bf64-b3e1-49f8-a245-e1680609a274 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:06:25.976375 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8567bf64-b3e1-49f8-a245-e1680609a274 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:06:25.977978 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8567bf64-b3e1-49f8-a245-e1680609a274 service swift] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:06:25.986494 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 1395/2778] 10.222.0.16 () {60 vars in 1384 bytes} [Thu Jul 14 11:06:25 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 14 11:06:26.178098 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ea22d1-4962-4259-b31e-0ced02620109 None None] REQUEST_METHOD: `POST` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:06:26.178567 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ea22d1-4962-4259-b31e-0ced02620109 None None] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:06:26.178659 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ea22d1-4962-4259-b31e-0ced02620109 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:06:26.200030 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.auth.core [None req-81ea22d1-4962-4259-b31e-0ced02620109 None None] MFA Rules not processed for user `0dfc7cd9c05e4f268d2ce316d531c4bd`. Rule list: `[]` (Enabled: `True`). {{(pid=86656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:06:26.201291 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-81ea22d1-4962-4259-b31e-0ced02620109 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:06:26.208431 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 1384/2779] 10.222.0.16 () {58 vars in 1009 bytes} [Thu Jul 14 11:06:26 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:06:26.222013 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8567bf64-b3e1-49f8-a245-e1680609a274 service swift] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:06:26.233289 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8567bf64-b3e1-49f8-a245-e1680609a274 service swift] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:06:26.238270 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5437dc4-104e-45b7-ab35-6b982899c1f1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a23de49b80643eaab7a212f2884d62e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59391272ecbe48b0aa736cb43807be1d', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:06:26.238901 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5437dc4-104e-45b7-ab35-6b982899c1f1 service swift] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:06:26.239186 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5437dc4-104e-45b7-ab35-6b982899c1f1 service swift] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:06:26.239464 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5437dc4-104e-45b7-ab35-6b982899c1f1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:06:26.248199 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5437dc4-104e-45b7-ab35-6b982899c1f1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:06:26.249788 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5437dc4-104e-45b7-ab35-6b982899c1f1 service swift] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:06:26.257711 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 1396/2780] 10.222.0.16 () {60 vars in 1384 bytes} [Thu Jul 14 11:06:26 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 14 11:06:26.571971 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3147f2b6-9e5d-4c16-bb37-b324a4c57de4 None None] REQUEST_METHOD: `POST` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:06:26.572268 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3147f2b6-9e5d-4c16-bb37-b324a4c57de4 None None] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:06:26.572555 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3147f2b6-9e5d-4c16-bb37-b324a4c57de4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:06:26.590359 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.auth.core [None req-3147f2b6-9e5d-4c16-bb37-b324a4c57de4 None None] MFA Rules not processed for user `0dfc7cd9c05e4f268d2ce316d531c4bd`. Rule list: `[]` (Enabled: `True`). {{(pid=86656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:06:26.591545 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-3147f2b6-9e5d-4c16-bb37-b324a4c57de4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:06:26.598708 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 1385/2781] 10.222.0.16 () {58 vars in 967 bytes} [Thu Jul 14 11:06:26 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:06:26.611634 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5437dc4-104e-45b7-ab35-6b982899c1f1 service swift] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:06:26.623147 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5437dc4-104e-45b7-ab35-6b982899c1f1 service swift] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:06:26.629495 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f6a433-c1ae-4fb8-9a43-16bfc43975c0 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a23de49b80643eaab7a212f2884d62e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59391272ecbe48b0aa736cb43807be1d', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:06:26.630205 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f6a433-c1ae-4fb8-9a43-16bfc43975c0 service swift] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:06:26.630500 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f6a433-c1ae-4fb8-9a43-16bfc43975c0 service swift] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:06:26.630785 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f6a433-c1ae-4fb8-9a43-16bfc43975c0 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:06:26.639266 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f6a433-c1ae-4fb8-9a43-16bfc43975c0 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:06:26.640880 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f6a433-c1ae-4fb8-9a43-16bfc43975c0 service swift] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:06:26.649041 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 1397/2782] 10.222.0.16 () {60 vars in 1384 bytes} [Thu Jul 14 11:06:26 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 14 11:06:28.681499 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3147f2b6-9e5d-4c16-bb37-b324a4c57de4 None None] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:06:28.743234 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3147f2b6-9e5d-4c16-bb37-b324a4c57de4 None None] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:06:28.748310 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7141b54-3e45-4c51-879b-744bbd8839f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:06:28.749202 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7141b54-3e45-4c51-879b-744bbd8839f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:06:28.749488 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7141b54-3e45-4c51-879b-744bbd8839f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:06:28.749765 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7141b54-3e45-4c51-879b-744bbd8839f4 admin admin] PATH_INFO: `/v3/users/ed511e0a0cb74db5905aafe41dd64be9` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:06:28.750951 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7141b54-3e45-4c51-879b-744bbd8839f4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ed511e0a0cb74db5905aafe41dd64be9)` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:06:28.752890 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7141b54-3e45-4c51-879b-744bbd8839f4 admin admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:06:28.800380 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-e7141b54-3e45-4c51-879b-744bbd8839f4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ed511e0a0cb74db5905aafe41dd64be9'} {{(pid=86656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:06:28.808333 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-e7141b54-3e45-4c51-879b-744bbd8839f4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ed511e0a0cb74db5905aafe41dd64be9'} {{(pid=86656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:06:28.809310 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-e7141b54-3e45-4c51-879b-744bbd8839f4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ed511e0a0cb74db5905aafe41dd64be9'} {{(pid=86656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:06:28.810677 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:06:28.818801 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-e7141b54-3e45-4c51-879b-744bbd8839f4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ed511e0a0cb74db5905aafe41dd64be9'} {{(pid=86656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:06:28.819548 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-e7141b54-3e45-4c51-879b-744bbd8839f4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ed511e0a0cb74db5905aafe41dd64be9'} {{(pid=86656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:06:28.837369 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 1386/2783] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Jul 14 11:06:28 2022] DELETE /identity/v3/users/ed511e0a0cb74db5905aafe41dd64be9 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:06:28.841833 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5300bd3b-d7d5-4940-8cb7-236ac1dac92e None None] REQUEST_METHOD: `POST` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:06:28.842328 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5300bd3b-d7d5-4940-8cb7-236ac1dac92e None None] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:06:28.842444 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5300bd3b-d7d5-4940-8cb7-236ac1dac92e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:06:28.859698 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.auth.core [None req-5300bd3b-d7d5-4940-8cb7-236ac1dac92e None None] MFA Rules not processed for user `ae4bcdd8106d4bebbdcae96be33505bc`. Rule list: `[]` (Enabled: `True`). {{(pid=86655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:06:28.860924 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-5300bd3b-d7d5-4940-8cb7-236ac1dac92e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:06:28.918898 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 1398/2784] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jul 14 11:06:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:06:28.928244 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7141b54-3e45-4c51-879b-744bbd8839f4 admin admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:06:28.929678 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-e7141b54-3e45-4c51-879b-744bbd8839f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:06:28.987048 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7141b54-3e45-4c51-879b-744bbd8839f4 admin admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:06:28.990663 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d2dd59-5164-4ddf-a8ee-2ad1357a328d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dddf93691844886982c91fea974385d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59391272ecbe48b0aa736cb43807be1d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:06:28.991306 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d2dd59-5164-4ddf-a8ee-2ad1357a328d service neutron] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:06:28.991603 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d2dd59-5164-4ddf-a8ee-2ad1357a328d service neutron] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:06:28.991860 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d2dd59-5164-4ddf-a8ee-2ad1357a328d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:06:29.001360 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d2dd59-5164-4ddf-a8ee-2ad1357a328d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:06:29.002777 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d2dd59-5164-4ddf-a8ee-2ad1357a328d service neutron] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:06:29.011974 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 1387/2785] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jul 14 11:06:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 11:06:29.176793 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5300bd3b-d7d5-4940-8cb7-236ac1dac92e None None] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:06:29.178258 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-5300bd3b-d7d5-4940-8cb7-236ac1dac92e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:06:29.193060 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5300bd3b-d7d5-4940-8cb7-236ac1dac92e None None] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:06:29.198554 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9421b1-3ee9-4b09-9b5c-70549e3f04e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:06:29.199828 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9421b1-3ee9-4b09-9b5c-70549e3f04e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:06:29.199973 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9421b1-3ee9-4b09-9b5c-70549e3f04e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:06:29.200365 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9421b1-3ee9-4b09-9b5c-70549e3f04e7 admin admin] PATH_INFO: `/v3/projects/de7ac7b0302f4c5a89f839efa5562ced` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:06:29.201713 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9421b1-3ee9-4b09-9b5c-70549e3f04e7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=de7ac7b0302f4c5a89f839efa5562ced)` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:06:29.203638 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9421b1-3ee9-4b09-9b5c-70549e3f04e7 admin admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:06:29.234884 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:06:29.251863 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-fb9421b1-3ee9-4b09-9b5c-70549e3f04e7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'de7ac7b0302f4c5a89f839efa5562ced', 'request_id': 'req-fb9421b1-3ee9-4b09-9b5c-70549e3f04e7'} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:06:29.257208 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-fb9421b1-3ee9-4b09-9b5c-70549e3f04e7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'de7ac7b0302f4c5a89f839efa5562ced', 'request_id': 'req-fb9421b1-3ee9-4b09-9b5c-70549e3f04e7'} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:06:29.264514 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-fb9421b1-3ee9-4b09-9b5c-70549e3f04e7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'de7ac7b0302f4c5a89f839efa5562ced', 'request_id': 'req-fb9421b1-3ee9-4b09-9b5c-70549e3f04e7'} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:06:29.275561 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-fb9421b1-3ee9-4b09-9b5c-70549e3f04e7 admin admin] The token cache is being invalidate because project de7ac7b0302f4c5a89f839efa5562ced was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86655) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 11:06:29.275853 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-fb9421b1-3ee9-4b09-9b5c-70549e3f04e7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:06:29.276508 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-fb9421b1-3ee9-4b09-9b5c-70549e3f04e7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:06:29.278182 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 1399/2786] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Jul 14 11:06:29 2022] DELETE /identity/v3/projects/de7ac7b0302f4c5a89f839efa5562ced => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:06:39.007985 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=37,keystone:DELETE=2 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:06:39.272602 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:DELETE=6,keystone:SELECT=14,keystone:INSERT=1 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:07:12.743163 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9585f764-aa5c-4963-8f39-062febecaa32 None None] REQUEST_METHOD: `POST` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:07:12.743686 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9585f764-aa5c-4963-8f39-062febecaa32 None None] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:07:12.743812 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9585f764-aa5c-4963-8f39-062febecaa32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:07:12.762673 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.auth.core [None req-9585f764-aa5c-4963-8f39-062febecaa32 None None] MFA Rules not processed for user `8b7f601f6ca242a4811ae36e0395ef3c`. Rule list: `[]` (Enabled: `True`). {{(pid=86656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:07:12.763898 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-9585f764-aa5c-4963-8f39-062febecaa32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:07:12.818546 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 1388/2787] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jul 14 11:07:12 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:07:13.116514 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9421b1-3ee9-4b09-9b5c-70549e3f04e7 admin admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:07:13.118010 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-fb9421b1-3ee9-4b09-9b5c-70549e3f04e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:07:13.174061 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9421b1-3ee9-4b09-9b5c-70549e3f04e7 admin admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:07:13.177643 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36a178c-e822-4b6b-861b-0f884743ef5b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dddf93691844886982c91fea974385d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59391272ecbe48b0aa736cb43807be1d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:07:13.178309 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36a178c-e822-4b6b-861b-0f884743ef5b service neutron] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:07:13.178601 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36a178c-e822-4b6b-861b-0f884743ef5b service neutron] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:07:13.178889 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36a178c-e822-4b6b-861b-0f884743ef5b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:07:13.180656 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-b36a178c-e822-4b6b-861b-0f884743ef5b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:07:13.190247 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36a178c-e822-4b6b-861b-0f884743ef5b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:07:13.191668 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36a178c-e822-4b6b-861b-0f884743ef5b service neutron] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:07:13.199831 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 1400/2788] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jul 14 11:07:13 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 11:07:22.811825 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=25 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:07:23.196009 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=26 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:08:30.838346 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9585f764-aa5c-4963-8f39-062febecaa32 None None] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:08:30.839887 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-9585f764-aa5c-4963-8f39-062febecaa32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:08:30.912429 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9585f764-aa5c-4963-8f39-062febecaa32 None None] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:08:30.917883 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4210c3-17c0-4187-a967-933e0e9446da service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26aa294c913c408499a913ec25bb677d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59391272ecbe48b0aa736cb43807be1d', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:08:30.918527 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4210c3-17c0-4187-a967-933e0e9446da service nova] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:08:30.918808 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4210c3-17c0-4187-a967-933e0e9446da service nova] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:08:30.919085 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4210c3-17c0-4187-a967-933e0e9446da service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:08:30.920933 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-fc4210c3-17c0-4187-a967-933e0e9446da service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:08:30.931729 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4210c3-17c0-4187-a967-933e0e9446da service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:08:30.933319 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4210c3-17c0-4187-a967-933e0e9446da service nova] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:08:30.942617 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 1389/2789] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jul 14 11:08:30 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 11:08:32.345734 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36a178c-e822-4b6b-861b-0f884743ef5b service neutron] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:08:32.347179 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-b36a178c-e822-4b6b-861b-0f884743ef5b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:08:32.411076 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36a178c-e822-4b6b-861b-0f884743ef5b service neutron] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:08:32.415695 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14fccba-c0c1-4322-a86f-a433fcf9681e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68382432147a48c3b62271fd2a2eab04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59391272ecbe48b0aa736cb43807be1d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:08:32.416354 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14fccba-c0c1-4322-a86f-a433fcf9681e service cinder] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:08:32.416643 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14fccba-c0c1-4322-a86f-a433fcf9681e service cinder] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:08:32.416952 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14fccba-c0c1-4322-a86f-a433fcf9681e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:08:32.418774 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-f14fccba-c0c1-4322-a86f-a433fcf9681e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:08:32.433480 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14fccba-c0c1-4322-a86f-a433fcf9681e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:08:32.434937 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14fccba-c0c1-4322-a86f-a433fcf9681e service cinder] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:08:32.446539 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 1401/2790] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jul 14 11:08:32 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 11:08:36.307414 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4210c3-17c0-4187-a967-933e0e9446da service nova] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:08:36.308851 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-fc4210c3-17c0-4187-a967-933e0e9446da service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:08:36.320927 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4210c3-17c0-4187-a967-933e0e9446da service nova] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:08:36.325202 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d94d459-f841-4c7e-ae75-bb59153b9964 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68382432147a48c3b62271fd2a2eab04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59391272ecbe48b0aa736cb43807be1d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:08:36.326149 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d94d459-f841-4c7e-ae75-bb59153b9964 service cinder] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:08:36.326435 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d94d459-f841-4c7e-ae75-bb59153b9964 service cinder] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:08:36.326708 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d94d459-f841-4c7e-ae75-bb59153b9964 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:08:36.328407 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-0d94d459-f841-4c7e-ae75-bb59153b9964 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:08:36.342841 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d94d459-f841-4c7e-ae75-bb59153b9964 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:08:36.344249 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d94d459-f841-4c7e-ae75-bb59153b9964 service cinder] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:08:36.354981 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 1390/2791] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jul 14 11:08:36 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 11:08:42.441095 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=26 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:08:46.350260 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=40 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:08:50.808843 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14fccba-c0c1-4322-a86f-a433fcf9681e service cinder] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:08:50.818765 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14fccba-c0c1-4322-a86f-a433fcf9681e service cinder] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:08:50.822361 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d92ae9-6121-4694-82ec-efc8b308952c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dddf93691844886982c91fea974385d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59391272ecbe48b0aa736cb43807be1d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:08:50.823003 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d92ae9-6121-4694-82ec-efc8b308952c service neutron] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:08:50.823288 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d92ae9-6121-4694-82ec-efc8b308952c service neutron] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:08:50.823591 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d92ae9-6121-4694-82ec-efc8b308952c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:08:50.825699 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-66d92ae9-6121-4694-82ec-efc8b308952c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:08:50.888227 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d92ae9-6121-4694-82ec-efc8b308952c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:08:50.889697 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d92ae9-6121-4694-82ec-efc8b308952c service neutron] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:08:50.901155 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 1402/2792] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jul 14 11:08:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 11:08:53.945823 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d94d459-f841-4c7e-ae75-bb59153b9964 service cinder] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:08:53.947410 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-0d94d459-f841-4c7e-ae75-bb59153b9964 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:08:53.961189 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d94d459-f841-4c7e-ae75-bb59153b9964 service cinder] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:08:53.965739 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdbc699-09a9-47f7-bcfb-ba010e98773c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:08:53.966630 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdbc699-09a9-47f7-bcfb-ba010e98773c admin admin] REQUEST_METHOD: `DELETE` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:08:53.966916 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdbc699-09a9-47f7-bcfb-ba010e98773c admin admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:08:53.967194 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdbc699-09a9-47f7-bcfb-ba010e98773c admin admin] PATH_INFO: `/v3/users/8b7f601f6ca242a4811ae36e0395ef3c` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:08:53.968463 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbdbc699-09a9-47f7-bcfb-ba010e98773c admin admin] RBAC: Authorizing `identity:delete_user(user_id=8b7f601f6ca242a4811ae36e0395ef3c)` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:08:53.970416 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbdbc699-09a9-47f7-bcfb-ba010e98773c admin admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:08:54.028858 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-bbdbc699-09a9-47f7-bcfb-ba010e98773c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8b7f601f6ca242a4811ae36e0395ef3c'} {{(pid=86656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:08:54.037277 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-bbdbc699-09a9-47f7-bcfb-ba010e98773c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8b7f601f6ca242a4811ae36e0395ef3c'} {{(pid=86656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:08:54.037897 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-bbdbc699-09a9-47f7-bcfb-ba010e98773c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8b7f601f6ca242a4811ae36e0395ef3c'} {{(pid=86656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:08:54.045232 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-bbdbc699-09a9-47f7-bcfb-ba010e98773c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8b7f601f6ca242a4811ae36e0395ef3c'} {{(pid=86656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:08:54.046085 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-bbdbc699-09a9-47f7-bcfb-ba010e98773c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8b7f601f6ca242a4811ae36e0395ef3c'} {{(pid=86656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:08:54.064414 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 1391/2793] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Jul 14 11:08:53 2022] DELETE /identity/v3/users/8b7f601f6ca242a4811ae36e0395ef3c => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:08:54.257040 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d92ae9-6121-4694-82ec-efc8b308952c service neutron] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:08:54.267649 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d92ae9-6121-4694-82ec-efc8b308952c service neutron] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:08:54.329669 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac05b7af-291d-433f-ba14-0aed994e2b42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:08:54.330545 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac05b7af-291d-433f-ba14-0aed994e2b42 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:08:54.330828 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac05b7af-291d-433f-ba14-0aed994e2b42 admin admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:08:54.331100 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac05b7af-291d-433f-ba14-0aed994e2b42 admin admin] PATH_INFO: `/v3/projects/c85377e530444a8ea8db75abe369ffc6` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:08:54.332652 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac05b7af-291d-433f-ba14-0aed994e2b42 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c85377e530444a8ea8db75abe369ffc6)` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:08:54.334806 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac05b7af-291d-433f-ba14-0aed994e2b42 admin admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:08:54.379504 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-ac05b7af-291d-433f-ba14-0aed994e2b42 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c85377e530444a8ea8db75abe369ffc6', 'request_id': 'req-ac05b7af-291d-433f-ba14-0aed994e2b42'} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:08:54.384758 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-ac05b7af-291d-433f-ba14-0aed994e2b42 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c85377e530444a8ea8db75abe369ffc6', 'request_id': 'req-ac05b7af-291d-433f-ba14-0aed994e2b42'} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:08:54.391541 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-ac05b7af-291d-433f-ba14-0aed994e2b42 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c85377e530444a8ea8db75abe369ffc6', 'request_id': 'req-ac05b7af-291d-433f-ba14-0aed994e2b42'} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:08:54.402273 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-ac05b7af-291d-433f-ba14-0aed994e2b42 admin admin] The token cache is being invalidate because project c85377e530444a8ea8db75abe369ffc6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86655) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 11:08:54.402561 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-ac05b7af-291d-433f-ba14-0aed994e2b42 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:08:54.403176 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-ac05b7af-291d-433f-ba14-0aed994e2b42 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:08:54.404717 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 1403/2794] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Jul 14 11:08:54 2022] DELETE /identity/v3/projects/c85377e530444a8ea8db75abe369ffc6 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:08:54.411054 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9521cb3d-5c04-4cde-af6b-e35b9ad056e0 None None] REQUEST_METHOD: `POST` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:08:54.411347 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9521cb3d-5c04-4cde-af6b-e35b9ad056e0 None None] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:08:54.411631 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9521cb3d-5c04-4cde-af6b-e35b9ad056e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:08:54.431044 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.auth.core [None req-9521cb3d-5c04-4cde-af6b-e35b9ad056e0 None None] MFA Rules not processed for user `ae4bcdd8106d4bebbdcae96be33505bc`. Rule list: `[]` (Enabled: `True`). {{(pid=86656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:08:54.432262 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-9521cb3d-5c04-4cde-af6b-e35b9ad056e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:08:54.493384 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 1392/2795] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jul 14 11:08:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:08:54.501151 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d76122-b9df-4415-9d40-8d405eddc06e None None] REQUEST_METHOD: `POST` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:08:54.501443 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d76122-b9df-4415-9d40-8d405eddc06e None None] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:08:54.501721 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d76122-b9df-4415-9d40-8d405eddc06e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:08:54.520383 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.auth.core [None req-c9d76122-b9df-4415-9d40-8d405eddc06e None None] MFA Rules not processed for user `ae4bcdd8106d4bebbdcae96be33505bc`. Rule list: `[]` (Enabled: `True`). {{(pid=86655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:08:54.521628 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-c9d76122-b9df-4415-9d40-8d405eddc06e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:08:54.529404 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 1404/2796] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jul 14 11:08:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:08:54.533478 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9521cb3d-5c04-4cde-af6b-e35b9ad056e0 None None] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:08:54.545632 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9521cb3d-5c04-4cde-af6b-e35b9ad056e0 None None] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:08:54.550748 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09726ea-3a67-4894-ad0e-01fde9593679 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:08:54.551469 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09726ea-3a67-4894-ad0e-01fde9593679 admin admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:08:54.551758 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09726ea-3a67-4894-ad0e-01fde9593679 admin admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:08:54.552046 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09726ea-3a67-4894-ad0e-01fde9593679 admin admin] PATH_INFO: `/v3/domains` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:08:54.552837 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09726ea-3a67-4894-ad0e-01fde9593679 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:08:54.553152 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09726ea-3a67-4894-ad0e-01fde9593679 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:08:54.554748 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09726ea-3a67-4894-ad0e-01fde9593679 admin admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:08:54.566891 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 1393/2797] 10.222.0.16 () {58 vars in 1152 bytes} [Thu Jul 14 11:08:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:08:54.571169 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d76122-b9df-4415-9d40-8d405eddc06e None None] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:08:54.580691 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d76122-b9df-4415-9d40-8d405eddc06e None None] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:08:54.585965 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38997a3d-c8f1-4508-95a1-1a7b966fd914 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:08:54.586618 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38997a3d-c8f1-4508-95a1-1a7b966fd914 admin admin] REQUEST_METHOD: `POST` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:08:54.586909 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38997a3d-c8f1-4508-95a1-1a7b966fd914 admin admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:08:54.587189 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38997a3d-c8f1-4508-95a1-1a7b966fd914 admin admin] PATH_INFO: `/v3/projects` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:08:54.587896 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38997a3d-c8f1-4508-95a1-1a7b966fd914 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:08:54.589842 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38997a3d-c8f1-4508-95a1-1a7b966fd914 admin admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:08:54.604438 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:08:54.621179 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 1405/2798] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Jul 14 11:08:54 2022] POST /identity/v3/projects => generated 369 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 11:08:54.622267 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09726ea-3a67-4894-ad0e-01fde9593679 admin admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:08:54.633461 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09726ea-3a67-4894-ad0e-01fde9593679 admin admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:08:54.689846 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a60766b-b07c-4a81-9ea1-5aa82e03bb2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:08:54.690517 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a60766b-b07c-4a81-9ea1-5aa82e03bb2b admin admin] REQUEST_METHOD: `POST` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:08:54.690850 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a60766b-b07c-4a81-9ea1-5aa82e03bb2b admin admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:08:54.691153 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a60766b-b07c-4a81-9ea1-5aa82e03bb2b admin admin] PATH_INFO: `/v3/users` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:08:54.691837 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a60766b-b07c-4a81-9ea1-5aa82e03bb2b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:08:54.693788 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a60766b-b07c-4a81-9ea1-5aa82e03bb2b admin admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:08:54.700484 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:08:54.715070 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 1394/2799] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Jul 14 11:08:54 2022] POST /identity/v3/users => generated 285 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 11:08:54.719144 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38997a3d-c8f1-4508-95a1-1a7b966fd914 admin admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:08:54.729969 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38997a3d-c8f1-4508-95a1-1a7b966fd914 admin admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:08:54.734592 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd0c101-960f-4583-802d-76894f0bfff1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:08:54.735251 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd0c101-960f-4583-802d-76894f0bfff1 admin admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:08:54.735580 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd0c101-960f-4583-802d-76894f0bfff1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:08:54.735894 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd0c101-960f-4583-802d-76894f0bfff1 admin admin] PATH_INFO: `/v3/roles` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:08:54.736803 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd0c101-960f-4583-802d-76894f0bfff1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:08:54.739327 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd0c101-960f-4583-802d-76894f0bfff1 admin admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:08:54.749722 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 1406/2800] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jul 14 11:08:54 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 11:08:54.753818 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a60766b-b07c-4a81-9ea1-5aa82e03bb2b admin admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:08:54.763733 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a60766b-b07c-4a81-9ea1-5aa82e03bb2b admin admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:08:54.768269 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4f5995-35f1-467f-a07e-40dc5f642e4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:08:54.769054 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4f5995-35f1-467f-a07e-40dc5f642e4d admin admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:08:54.769341 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4f5995-35f1-467f-a07e-40dc5f642e4d admin admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:08:54.769619 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4f5995-35f1-467f-a07e-40dc5f642e4d admin admin] PATH_INFO: `/v3/roles` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:08:54.770334 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4f5995-35f1-467f-a07e-40dc5f642e4d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:08:54.771942 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4f5995-35f1-467f-a07e-40dc5f642e4d admin admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:08:54.782265 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 1395/2801] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jul 14 11:08:54 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 11:08:54.787004 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd0c101-960f-4583-802d-76894f0bfff1 admin admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:08:54.797477 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd0c101-960f-4583-802d-76894f0bfff1 admin admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:08:54.802961 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da54b8da-f116-453b-89d6-881d3bc48a05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:08:54.803858 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da54b8da-f116-453b-89d6-881d3bc48a05 admin admin] REQUEST_METHOD: `PUT` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:08:54.804166 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da54b8da-f116-453b-89d6-881d3bc48a05 admin admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:08:54.804446 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da54b8da-f116-453b-89d6-881d3bc48a05 admin admin] PATH_INFO: `/v3/projects/9649543564944929ae00adb927eacb5e/users/6150bbfba7484afa9ce004976b2cc705/roles/0da46c267d354cce81495dfdd56c1ec2` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:08:54.820593 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da54b8da-f116-453b-89d6-881d3bc48a05 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9649543564944929ae00adb927eacb5e, user_id=6150bbfba7484afa9ce004976b2cc705, role_id=0da46c267d354cce81495dfdd56c1ec2)` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:08:54.823266 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da54b8da-f116-453b-89d6-881d3bc48a05 admin admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:08:54.836562 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 1407/2802] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Jul 14 11:08:54 2022] PUT /identity/v3/projects/9649543564944929ae00adb927eacb5e/users/6150bbfba7484afa9ce004976b2cc705/roles/0da46c267d354cce81495dfdd56c1ec2 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:08:54.847958 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cd76e4-e5f0-4d3b-ae97-757685dcb9e1 None None] REQUEST_METHOD: `POST` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:08:54.848251 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cd76e4-e5f0-4d3b-ae97-757685dcb9e1 None None] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:08:54.848526 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cd76e4-e5f0-4d3b-ae97-757685dcb9e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:08:54.875126 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.auth.core [None req-59cd76e4-e5f0-4d3b-ae97-757685dcb9e1 None None] MFA Rules not processed for user `6150bbfba7484afa9ce004976b2cc705`. Rule list: `[]` (Enabled: `True`). {{(pid=86656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:08:54.876367 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-59cd76e4-e5f0-4d3b-ae97-757685dcb9e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:08:54.938584 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 1396/2803] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jul 14 11:08:54 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:08:54.942960 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da54b8da-f116-453b-89d6-881d3bc48a05 admin admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:08:55.007801 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da54b8da-f116-453b-89d6-881d3bc48a05 admin admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:08:55.012529 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7e66e7-0117-465f-bc8a-aa47ffe3f227 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:08:55.013220 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7e66e7-0117-465f-bc8a-aa47ffe3f227 admin admin] REQUEST_METHOD: `POST` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:08:55.013510 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7e66e7-0117-465f-bc8a-aa47ffe3f227 admin admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:08:55.013790 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7e66e7-0117-465f-bc8a-aa47ffe3f227 admin admin] PATH_INFO: `/v3/projects` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:08:55.014509 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7e66e7-0117-465f-bc8a-aa47ffe3f227 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:08:55.016408 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7e66e7-0117-465f-bc8a-aa47ffe3f227 admin admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:08:55.046118 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 1408/2804] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Jul 14 11:08:54 2022] POST /identity/v3/projects => generated 367 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 11:08:55.050798 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59cd76e4-e5f0-4d3b-ae97-757685dcb9e1 None None] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:08:55.061922 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59cd76e4-e5f0-4d3b-ae97-757685dcb9e1 None None] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:08:55.120279 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c46942-ce93-48c6-96ab-f6e3bb9aac6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:08:55.120991 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c46942-ce93-48c6-96ab-f6e3bb9aac6e admin admin] REQUEST_METHOD: `POST` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:08:55.121274 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c46942-ce93-48c6-96ab-f6e3bb9aac6e admin admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:08:55.121550 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c46942-ce93-48c6-96ab-f6e3bb9aac6e admin admin] PATH_INFO: `/v3/users` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:08:55.122242 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c46942-ce93-48c6-96ab-f6e3bb9aac6e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:08:55.124180 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c46942-ce93-48c6-96ab-f6e3bb9aac6e admin admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:08:55.144290 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 1397/2805] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Jul 14 11:08:55 2022] POST /identity/v3/users => generated 290 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 11:08:55.148263 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7e66e7-0117-465f-bc8a-aa47ffe3f227 admin admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:08:55.158515 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7e66e7-0117-465f-bc8a-aa47ffe3f227 admin admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:08:55.163447 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc0ab95-8587-467f-acdd-9d68f60fb7db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:08:55.164110 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc0ab95-8587-467f-acdd-9d68f60fb7db admin admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:08:55.164401 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc0ab95-8587-467f-acdd-9d68f60fb7db admin admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:08:55.164708 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc0ab95-8587-467f-acdd-9d68f60fb7db admin admin] PATH_INFO: `/v3/roles` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:08:55.165474 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc0ab95-8587-467f-acdd-9d68f60fb7db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:08:55.167059 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc0ab95-8587-467f-acdd-9d68f60fb7db admin admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:08:55.178106 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 1409/2806] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jul 14 11:08:55 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 11:08:55.182133 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c46942-ce93-48c6-96ab-f6e3bb9aac6e admin admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:08:55.192938 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c46942-ce93-48c6-96ab-f6e3bb9aac6e admin admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:08:55.197571 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356c0773-bd19-4c44-978d-819bf35e8a6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:08:55.198455 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356c0773-bd19-4c44-978d-819bf35e8a6c admin admin] REQUEST_METHOD: `PUT` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:08:55.198743 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356c0773-bd19-4c44-978d-819bf35e8a6c admin admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:08:55.199023 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356c0773-bd19-4c44-978d-819bf35e8a6c admin admin] PATH_INFO: `/v3/projects/6c35f1ba00244d1285f11dc4f6e145c5/users/06fcdbd76fad48d29ec81c6bd9050d22/roles/153539819e5542df99269d2913bbecfb` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:08:55.213717 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356c0773-bd19-4c44-978d-819bf35e8a6c admin admin] RBAC: Authorizing `identity:create_grant(project_id=6c35f1ba00244d1285f11dc4f6e145c5, user_id=06fcdbd76fad48d29ec81c6bd9050d22, role_id=153539819e5542df99269d2913bbecfb)` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:08:55.216373 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356c0773-bd19-4c44-978d-819bf35e8a6c admin admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:08:55.229292 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 1398/2807] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Jul 14 11:08:55 2022] PUT /identity/v3/projects/6c35f1ba00244d1285f11dc4f6e145c5/users/06fcdbd76fad48d29ec81c6bd9050d22/roles/153539819e5542df99269d2913bbecfb => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 11:08:55.233135 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc0ab95-8587-467f-acdd-9d68f60fb7db admin admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:08:55.245035 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc0ab95-8587-467f-acdd-9d68f60fb7db admin admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:08:55.302672 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288155f0-5087-45d9-b731-d4944137119a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:08:55.303338 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288155f0-5087-45d9-b731-d4944137119a admin admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:08:55.303632 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288155f0-5087-45d9-b731-d4944137119a admin admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:08:55.303903 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288155f0-5087-45d9-b731-d4944137119a admin admin] PATH_INFO: `/v3/roles` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:08:55.304638 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288155f0-5087-45d9-b731-d4944137119a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:08:55.306263 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288155f0-5087-45d9-b731-d4944137119a admin admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:08:55.316440 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 1410/2808] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jul 14 11:08:55 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 11:08:55.320589 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356c0773-bd19-4c44-978d-819bf35e8a6c admin admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:08:55.331002 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356c0773-bd19-4c44-978d-819bf35e8a6c admin admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:08:55.335932 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af102ace-5363-48b0-a55a-e8bb952f6af3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:08:55.336846 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af102ace-5363-48b0-a55a-e8bb952f6af3 admin admin] REQUEST_METHOD: `PUT` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:08:55.337140 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af102ace-5363-48b0-a55a-e8bb952f6af3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:08:55.337423 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af102ace-5363-48b0-a55a-e8bb952f6af3 admin admin] PATH_INFO: `/v3/projects/6c35f1ba00244d1285f11dc4f6e145c5/users/06fcdbd76fad48d29ec81c6bd9050d22/roles/153539819e5542df99269d2913bbecfb` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:08:55.339427 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af102ace-5363-48b0-a55a-e8bb952f6af3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6c35f1ba00244d1285f11dc4f6e145c5, user_id=06fcdbd76fad48d29ec81c6bd9050d22, role_id=153539819e5542df99269d2913bbecfb)` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:08:55.342104 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af102ace-5363-48b0-a55a-e8bb952f6af3 admin admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:08:55.352869 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 1399/2809] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Jul 14 11:08:55 2022] PUT /identity/v3/projects/6c35f1ba00244d1285f11dc4f6e145c5/users/06fcdbd76fad48d29ec81c6bd9050d22/roles/153539819e5542df99269d2913bbecfb => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:08:55.362616 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65c9430-a25d-4bab-81c6-e0a2df1be280 None None] REQUEST_METHOD: `POST` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:08:55.362939 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65c9430-a25d-4bab-81c6-e0a2df1be280 None None] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:08:55.363248 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65c9430-a25d-4bab-81c6-e0a2df1be280 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:08:55.389412 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.auth.core [None req-e65c9430-a25d-4bab-81c6-e0a2df1be280 None None] MFA Rules not processed for user `06fcdbd76fad48d29ec81c6bd9050d22`. Rule list: `[]` (Enabled: `True`). {{(pid=86655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:08:55.390676 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-e65c9430-a25d-4bab-81c6-e0a2df1be280 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:08:55.410752 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:08:55.461170 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 1411/2810] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jul 14 11:08:55 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:08:55.471602 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af102ace-5363-48b0-a55a-e8bb952f6af3 admin admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:08:55.474106 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-af102ace-5363-48b0-a55a-e8bb952f6af3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:08:55.498000 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:INSERT=8,keystone:SELECT=92 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:08:55.532898 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af102ace-5363-48b0-a55a-e8bb952f6af3 admin admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:08:55.537109 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad119824-9cb6-4683-9e07-e89d0def21fa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68382432147a48c3b62271fd2a2eab04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59391272ecbe48b0aa736cb43807be1d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:08:55.537753 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad119824-9cb6-4683-9e07-e89d0def21fa service cinder] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:08:55.538039 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad119824-9cb6-4683-9e07-e89d0def21fa service cinder] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:08:55.538325 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad119824-9cb6-4683-9e07-e89d0def21fa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:08:55.547233 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad119824-9cb6-4683-9e07-e89d0def21fa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:08:55.548656 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad119824-9cb6-4683-9e07-e89d0def21fa service cinder] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:08:55.558296 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 1400/2811] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jul 14 11:08:55 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 11:08:56.845693 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65c9430-a25d-4bab-81c6-e0a2df1be280 None None] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:08:56.906327 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65c9430-a25d-4bab-81c6-e0a2df1be280 None None] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:08:56.911270 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503818fb-6d4c-4176-bb7c-266e4e7f81fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:08:56.912131 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503818fb-6d4c-4176-bb7c-266e4e7f81fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:08:56.912415 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503818fb-6d4c-4176-bb7c-266e4e7f81fc admin admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:08:56.912689 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503818fb-6d4c-4176-bb7c-266e4e7f81fc admin admin] PATH_INFO: `/v3/users/6150bbfba7484afa9ce004976b2cc705` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:08:56.913896 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503818fb-6d4c-4176-bb7c-266e4e7f81fc admin admin] RBAC: Authorizing `identity:delete_user(user_id=6150bbfba7484afa9ce004976b2cc705)` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:08:56.915798 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503818fb-6d4c-4176-bb7c-266e4e7f81fc admin admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:08:56.961182 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-503818fb-6d4c-4176-bb7c-266e4e7f81fc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6150bbfba7484afa9ce004976b2cc705'} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:08:56.968431 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-503818fb-6d4c-4176-bb7c-266e4e7f81fc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6150bbfba7484afa9ce004976b2cc705'} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:08:56.969111 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-503818fb-6d4c-4176-bb7c-266e4e7f81fc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6150bbfba7484afa9ce004976b2cc705'} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:08:56.977200 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-503818fb-6d4c-4176-bb7c-266e4e7f81fc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6150bbfba7484afa9ce004976b2cc705'} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:08:56.977840 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-503818fb-6d4c-4176-bb7c-266e4e7f81fc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6150bbfba7484afa9ce004976b2cc705'} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:08:56.995276 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 1412/2812] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Jul 14 11:08:56 2022] DELETE /identity/v3/users/6150bbfba7484afa9ce004976b2cc705 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:08:56.999733 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02e3c23-3b36-496a-9399-0545978a5819 None None] REQUEST_METHOD: `POST` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:08:57.000203 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02e3c23-3b36-496a-9399-0545978a5819 None None] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:08:57.000331 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02e3c23-3b36-496a-9399-0545978a5819 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:08:57.017619 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.auth.core [None req-b02e3c23-3b36-496a-9399-0545978a5819 None None] MFA Rules not processed for user `ae4bcdd8106d4bebbdcae96be33505bc`. Rule list: `[]` (Enabled: `True`). {{(pid=86656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:08:57.018751 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-b02e3c23-3b36-496a-9399-0545978a5819 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:08:57.076236 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 1401/2813] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jul 14 11:08:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:08:57.086379 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503818fb-6d4c-4176-bb7c-266e4e7f81fc admin admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:08:57.087841 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-503818fb-6d4c-4176-bb7c-266e4e7f81fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:08:57.129052 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:08:57.148255 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503818fb-6d4c-4176-bb7c-266e4e7f81fc admin admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:08:57.151840 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28f3696-098c-4309-afd9-68c96e6d627f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dddf93691844886982c91fea974385d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59391272ecbe48b0aa736cb43807be1d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:08:57.152517 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28f3696-098c-4309-afd9-68c96e6d627f service neutron] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:08:57.152828 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28f3696-098c-4309-afd9-68c96e6d627f service neutron] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:08:57.153108 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28f3696-098c-4309-afd9-68c96e6d627f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:08:57.162055 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28f3696-098c-4309-afd9-68c96e6d627f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:08:57.163469 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28f3696-098c-4309-afd9-68c96e6d627f service neutron] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:08:57.173768 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 1413/2814] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jul 14 11:08:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 11:08:57.439480 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02e3c23-3b36-496a-9399-0545978a5819 None None] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:08:57.441003 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-b02e3c23-3b36-496a-9399-0545978a5819 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:08:57.453594 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02e3c23-3b36-496a-9399-0545978a5819 None None] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:08:57.458330 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28faacc5-fbd2-4525-9305-592ba9509b89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:08:57.459261 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28faacc5-fbd2-4525-9305-592ba9509b89 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:08:57.459607 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28faacc5-fbd2-4525-9305-592ba9509b89 admin admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:08:57.459886 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28faacc5-fbd2-4525-9305-592ba9509b89 admin admin] PATH_INFO: `/v3/projects/9649543564944929ae00adb927eacb5e` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:08:57.461108 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28faacc5-fbd2-4525-9305-592ba9509b89 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9649543564944929ae00adb927eacb5e)` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:08:57.463136 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28faacc5-fbd2-4525-9305-592ba9509b89 admin admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:08:57.509921 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-28faacc5-fbd2-4525-9305-592ba9509b89 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9649543564944929ae00adb927eacb5e', 'request_id': 'req-28faacc5-fbd2-4525-9305-592ba9509b89'} {{(pid=86656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:08:57.516722 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-28faacc5-fbd2-4525-9305-592ba9509b89 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9649543564944929ae00adb927eacb5e', 'request_id': 'req-28faacc5-fbd2-4525-9305-592ba9509b89'} {{(pid=86656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:08:57.523888 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-28faacc5-fbd2-4525-9305-592ba9509b89 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9649543564944929ae00adb927eacb5e', 'request_id': 'req-28faacc5-fbd2-4525-9305-592ba9509b89'} {{(pid=86656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:08:57.534436 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-28faacc5-fbd2-4525-9305-592ba9509b89 admin admin] The token cache is being invalidate because project 9649543564944929ae00adb927eacb5e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86656) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 11:08:57.535348 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-28faacc5-fbd2-4525-9305-592ba9509b89 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:08:57.536024 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-28faacc5-fbd2-4525-9305-592ba9509b89 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:08:57.537646 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 1402/2815] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Jul 14 11:08:57 2022] DELETE /identity/v3/projects/9649543564944929ae00adb927eacb5e => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:08:57.541738 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28f3696-098c-4309-afd9-68c96e6d627f service neutron] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:08:57.552223 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28f3696-098c-4309-afd9-68c96e6d627f service neutron] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:08:57.606970 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16b69d1-fd4d-4a98-bcef-35e1f1b72a1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:08:57.607840 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16b69d1-fd4d-4a98-bcef-35e1f1b72a1c admin admin] REQUEST_METHOD: `DELETE` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:08:57.608131 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16b69d1-fd4d-4a98-bcef-35e1f1b72a1c admin admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:08:57.608412 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16b69d1-fd4d-4a98-bcef-35e1f1b72a1c admin admin] PATH_INFO: `/v3/users/06fcdbd76fad48d29ec81c6bd9050d22` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:08:57.609633 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16b69d1-fd4d-4a98-bcef-35e1f1b72a1c admin admin] RBAC: Authorizing `identity:delete_user(user_id=06fcdbd76fad48d29ec81c6bd9050d22)` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:08:57.611540 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16b69d1-fd4d-4a98-bcef-35e1f1b72a1c admin admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:08:57.656902 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-d16b69d1-fd4d-4a98-bcef-35e1f1b72a1c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '06fcdbd76fad48d29ec81c6bd9050d22'} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:08:57.665123 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-d16b69d1-fd4d-4a98-bcef-35e1f1b72a1c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '06fcdbd76fad48d29ec81c6bd9050d22'} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:08:57.665762 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-d16b69d1-fd4d-4a98-bcef-35e1f1b72a1c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '06fcdbd76fad48d29ec81c6bd9050d22'} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:08:57.672716 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-d16b69d1-fd4d-4a98-bcef-35e1f1b72a1c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '06fcdbd76fad48d29ec81c6bd9050d22'} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:08:57.673378 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-d16b69d1-fd4d-4a98-bcef-35e1f1b72a1c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '06fcdbd76fad48d29ec81c6bd9050d22'} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:08:57.691137 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 1414/2816] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Jul 14 11:08:57 2022] DELETE /identity/v3/users/06fcdbd76fad48d29ec81c6bd9050d22 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 11:08:57.957280 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28faacc5-fbd2-4525-9305-592ba9509b89 admin admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:08:57.959266 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-28faacc5-fbd2-4525-9305-592ba9509b89 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:08:57.975737 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28faacc5-fbd2-4525-9305-592ba9509b89 admin admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:08:58.018233 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:08:58.032854 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9427b7c7-29b2-4eeb-857d-3e2d9a0669e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:08:58.033670 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9427b7c7-29b2-4eeb-857d-3e2d9a0669e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:08:58.033956 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9427b7c7-29b2-4eeb-857d-3e2d9a0669e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:08:58.034234 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9427b7c7-29b2-4eeb-857d-3e2d9a0669e6 admin admin] PATH_INFO: `/v3/projects/6c35f1ba00244d1285f11dc4f6e145c5` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:08:58.036376 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9427b7c7-29b2-4eeb-857d-3e2d9a0669e6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6c35f1ba00244d1285f11dc4f6e145c5)` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:08:58.038323 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9427b7c7-29b2-4eeb-857d-3e2d9a0669e6 admin admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:08:58.084236 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-9427b7c7-29b2-4eeb-857d-3e2d9a0669e6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6c35f1ba00244d1285f11dc4f6e145c5', 'request_id': 'req-9427b7c7-29b2-4eeb-857d-3e2d9a0669e6'} {{(pid=86656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:08:58.091196 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-9427b7c7-29b2-4eeb-857d-3e2d9a0669e6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6c35f1ba00244d1285f11dc4f6e145c5', 'request_id': 'req-9427b7c7-29b2-4eeb-857d-3e2d9a0669e6'} {{(pid=86656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:08:58.097452 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-9427b7c7-29b2-4eeb-857d-3e2d9a0669e6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6c35f1ba00244d1285f11dc4f6e145c5', 'request_id': 'req-9427b7c7-29b2-4eeb-857d-3e2d9a0669e6'} {{(pid=86656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:08:58.107880 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-9427b7c7-29b2-4eeb-857d-3e2d9a0669e6 admin admin] The token cache is being invalidate because project 6c35f1ba00244d1285f11dc4f6e145c5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86656) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 11:08:58.108166 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-9427b7c7-29b2-4eeb-857d-3e2d9a0669e6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:08:58.108825 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-9427b7c7-29b2-4eeb-857d-3e2d9a0669e6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:08:58.110356 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 1403/2817] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Jul 14 11:08:57 2022] DELETE /identity/v3/projects/6c35f1ba00244d1285f11dc4f6e145c5 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 11:08:58.115429 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368007fd-c2dd-4efa-a79f-c6a7e7eb3a29 None None] REQUEST_METHOD: `POST` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:08:58.115904 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368007fd-c2dd-4efa-a79f-c6a7e7eb3a29 None None] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:08:58.116003 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368007fd-c2dd-4efa-a79f-c6a7e7eb3a29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:08:58.133734 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.auth.core [None req-368007fd-c2dd-4efa-a79f-c6a7e7eb3a29 None None] MFA Rules not processed for user `ae4bcdd8106d4bebbdcae96be33505bc`. Rule list: `[]` (Enabled: `True`). {{(pid=86655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:08:58.134936 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-368007fd-c2dd-4efa-a79f-c6a7e7eb3a29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:08:58.186928 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:08:58.198512 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 1415/2818] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jul 14 11:08:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:08:58.208790 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbd27cf-54d5-42cd-965a-52ba38b1378e None None] REQUEST_METHOD: `POST` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:08:58.209093 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbd27cf-54d5-42cd-965a-52ba38b1378e None None] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:08:58.209373 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbd27cf-54d5-42cd-965a-52ba38b1378e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:08:58.227429 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.auth.core [None req-4cbd27cf-54d5-42cd-965a-52ba38b1378e None None] MFA Rules not processed for user `ae4bcdd8106d4bebbdcae96be33505bc`. Rule list: `[]` (Enabled: `True`). {{(pid=86656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:08:58.228625 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-4cbd27cf-54d5-42cd-965a-52ba38b1378e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:08:58.236475 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 1404/2819] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jul 14 11:08:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:08:58.240627 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368007fd-c2dd-4efa-a79f-c6a7e7eb3a29 None None] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:08:58.250472 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368007fd-c2dd-4efa-a79f-c6a7e7eb3a29 None None] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:08:58.256194 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0c8e47-507f-42bf-b8e5-a7018b50208e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:08:58.256892 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0c8e47-507f-42bf-b8e5-a7018b50208e admin admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:08:58.257185 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0c8e47-507f-42bf-b8e5-a7018b50208e admin admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:08:58.257471 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0c8e47-507f-42bf-b8e5-a7018b50208e admin admin] PATH_INFO: `/v3/domains` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:08:58.258216 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0c8e47-507f-42bf-b8e5-a7018b50208e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:08:58.258530 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0c8e47-507f-42bf-b8e5-a7018b50208e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:08:58.260129 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0c8e47-507f-42bf-b8e5-a7018b50208e admin admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:08:58.272590 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 1416/2820] 10.222.0.16 () {58 vars in 1152 bytes} [Thu Jul 14 11:08:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:08:58.276604 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbd27cf-54d5-42cd-965a-52ba38b1378e None None] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:08:58.286165 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbd27cf-54d5-42cd-965a-52ba38b1378e None None] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:08:58.290676 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200d4cd7-57e4-4822-814e-e92f2c4977b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:08:58.291321 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200d4cd7-57e4-4822-814e-e92f2c4977b1 admin admin] REQUEST_METHOD: `POST` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:08:58.291626 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200d4cd7-57e4-4822-814e-e92f2c4977b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:08:58.291901 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200d4cd7-57e4-4822-814e-e92f2c4977b1 admin admin] PATH_INFO: `/v3/projects` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:08:58.292586 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200d4cd7-57e4-4822-814e-e92f2c4977b1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:08:58.294513 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200d4cd7-57e4-4822-814e-e92f2c4977b1 admin admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:08:58.323311 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 1405/2821] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Jul 14 11:08:58 2022] POST /identity/v3/projects => generated 377 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 11:08:58.324702 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0c8e47-507f-42bf-b8e5-a7018b50208e admin admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:08:58.335250 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0c8e47-507f-42bf-b8e5-a7018b50208e admin admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:08:58.389564 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e890b2f5-0ae2-4b3c-88d5-7d3e73a78a9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:08:58.390226 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e890b2f5-0ae2-4b3c-88d5-7d3e73a78a9a admin admin] REQUEST_METHOD: `POST` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:08:58.390512 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e890b2f5-0ae2-4b3c-88d5-7d3e73a78a9a admin admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:08:58.390789 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e890b2f5-0ae2-4b3c-88d5-7d3e73a78a9a admin admin] PATH_INFO: `/v3/users` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:08:58.391481 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e890b2f5-0ae2-4b3c-88d5-7d3e73a78a9a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:08:58.393405 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e890b2f5-0ae2-4b3c-88d5-7d3e73a78a9a admin admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:08:58.413028 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 1417/2822] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Jul 14 11:08:58 2022] POST /identity/v3/users => generated 289 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 11:08:58.417085 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200d4cd7-57e4-4822-814e-e92f2c4977b1 admin admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:08:58.427697 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200d4cd7-57e4-4822-814e-e92f2c4977b1 admin admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:08:58.432269 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169b7a6e-ae9f-4905-925d-8b2be3cbd4f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:08:58.432972 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169b7a6e-ae9f-4905-925d-8b2be3cbd4f5 admin admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:08:58.433260 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169b7a6e-ae9f-4905-925d-8b2be3cbd4f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:08:58.433539 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169b7a6e-ae9f-4905-925d-8b2be3cbd4f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:08:58.434276 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169b7a6e-ae9f-4905-925d-8b2be3cbd4f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:08:58.435876 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169b7a6e-ae9f-4905-925d-8b2be3cbd4f5 admin admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:08:58.447703 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 1406/2823] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jul 14 11:08:58 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 11:08:58.452159 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e890b2f5-0ae2-4b3c-88d5-7d3e73a78a9a admin admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:08:58.462507 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e890b2f5-0ae2-4b3c-88d5-7d3e73a78a9a admin admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:08:58.467081 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7df52be-70a1-4ded-b607-13cd1d79ddf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:08:58.467735 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7df52be-70a1-4ded-b607-13cd1d79ddf0 admin admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:08:58.468012 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7df52be-70a1-4ded-b607-13cd1d79ddf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:08:58.468290 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7df52be-70a1-4ded-b607-13cd1d79ddf0 admin admin] PATH_INFO: `/v3/roles` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:08:58.469061 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7df52be-70a1-4ded-b607-13cd1d79ddf0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:08:58.470647 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7df52be-70a1-4ded-b607-13cd1d79ddf0 admin admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:08:58.481083 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 1418/2824] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jul 14 11:08:58 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 11:08:58.486123 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169b7a6e-ae9f-4905-925d-8b2be3cbd4f5 admin admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:08:58.496751 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169b7a6e-ae9f-4905-925d-8b2be3cbd4f5 admin admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:08:58.501367 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd8c6d7-79d4-4752-a005-6ec0e84cbcf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:08:58.502248 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd8c6d7-79d4-4752-a005-6ec0e84cbcf4 admin admin] REQUEST_METHOD: `PUT` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:08:58.502531 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd8c6d7-79d4-4752-a005-6ec0e84cbcf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:08:58.502807 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd8c6d7-79d4-4752-a005-6ec0e84cbcf4 admin admin] PATH_INFO: `/v3/projects/7cd80122e23b4bce9ae0add075d3f8e7/users/9841182b6de1429fa9f8b851649ee201/roles/0da46c267d354cce81495dfdd56c1ec2` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:08:58.518369 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd8c6d7-79d4-4752-a005-6ec0e84cbcf4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7cd80122e23b4bce9ae0add075d3f8e7, user_id=9841182b6de1429fa9f8b851649ee201, role_id=0da46c267d354cce81495dfdd56c1ec2)` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:08:58.521226 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd8c6d7-79d4-4752-a005-6ec0e84cbcf4 admin admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:08:58.533666 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 1407/2825] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Jul 14 11:08:58 2022] PUT /identity/v3/projects/7cd80122e23b4bce9ae0add075d3f8e7/users/9841182b6de1429fa9f8b851649ee201/roles/0da46c267d354cce81495dfdd56c1ec2 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:08:58.544366 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef075bc-9608-4865-baf3-d1b1dde18a89 None None] REQUEST_METHOD: `POST` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:08:58.544624 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef075bc-9608-4865-baf3-d1b1dde18a89 None None] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:08:58.544946 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef075bc-9608-4865-baf3-d1b1dde18a89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:08:58.574770 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.auth.core [None req-1ef075bc-9608-4865-baf3-d1b1dde18a89 None None] MFA Rules not processed for user `9841182b6de1429fa9f8b851649ee201`. Rule list: `[]` (Enabled: `True`). {{(pid=86655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:08:58.576020 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-1ef075bc-9608-4865-baf3-d1b1dde18a89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:08:58.639153 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 1419/2826] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jul 14 11:08:58 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:08:58.644006 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd8c6d7-79d4-4752-a005-6ec0e84cbcf4 admin admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:08:58.706653 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd8c6d7-79d4-4752-a005-6ec0e84cbcf4 admin admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:08:58.711200 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990af1b3-424f-4d71-b260-eef489e34ee1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:08:58.711857 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990af1b3-424f-4d71-b260-eef489e34ee1 admin admin] REQUEST_METHOD: `POST` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:08:58.712140 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990af1b3-424f-4d71-b260-eef489e34ee1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:08:58.712418 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990af1b3-424f-4d71-b260-eef489e34ee1 admin admin] PATH_INFO: `/v3/projects` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:08:58.713146 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990af1b3-424f-4d71-b260-eef489e34ee1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:08:58.715028 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990af1b3-424f-4d71-b260-eef489e34ee1 admin admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:08:58.733144 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:08:58.741400 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 1408/2827] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Jul 14 11:08:58 2022] POST /identity/v3/projects => generated 377 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 11:08:58.745459 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef075bc-9608-4865-baf3-d1b1dde18a89 None None] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:08:58.756657 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef075bc-9608-4865-baf3-d1b1dde18a89 None None] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:08:58.804514 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:08:58.814537 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14b1023-bf4d-4745-8baf-098f0f81c4dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:08:58.815224 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14b1023-bf4d-4745-8baf-098f0f81c4dc admin admin] REQUEST_METHOD: `POST` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:08:58.815519 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14b1023-bf4d-4745-8baf-098f0f81c4dc admin admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:08:58.817067 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14b1023-bf4d-4745-8baf-098f0f81c4dc admin admin] PATH_INFO: `/v3/users` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:08:58.817783 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14b1023-bf4d-4745-8baf-098f0f81c4dc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:08:58.819720 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14b1023-bf4d-4745-8baf-098f0f81c4dc admin admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:08:58.839300 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 1420/2828] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Jul 14 11:08:58 2022] POST /identity/v3/users => generated 295 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 11:08:58.843318 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990af1b3-424f-4d71-b260-eef489e34ee1 admin admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:08:58.854141 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990af1b3-424f-4d71-b260-eef489e34ee1 admin admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:08:58.858650 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb322288-ee76-4ffc-bdab-470a546dfe99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:08:58.859338 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb322288-ee76-4ffc-bdab-470a546dfe99 admin admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:08:58.859622 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb322288-ee76-4ffc-bdab-470a546dfe99 admin admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:08:58.859898 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb322288-ee76-4ffc-bdab-470a546dfe99 admin admin] PATH_INFO: `/v3/roles` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:08:58.860621 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb322288-ee76-4ffc-bdab-470a546dfe99 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:08:58.862242 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb322288-ee76-4ffc-bdab-470a546dfe99 admin admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:08:58.873207 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 1409/2829] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jul 14 11:08:58 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 11:08:58.877092 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14b1023-bf4d-4745-8baf-098f0f81c4dc admin admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:08:58.887014 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14b1023-bf4d-4745-8baf-098f0f81c4dc admin admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:08:58.891609 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd70d5b-c0d8-4e3b-8905-51b26d9d8332 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:08:58.892480 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd70d5b-c0d8-4e3b-8905-51b26d9d8332 admin admin] REQUEST_METHOD: `PUT` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:08:58.892787 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd70d5b-c0d8-4e3b-8905-51b26d9d8332 admin admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:08:58.893075 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd70d5b-c0d8-4e3b-8905-51b26d9d8332 admin admin] PATH_INFO: `/v3/projects/06377f94cdea47f7abf0203b46b40f10/users/1cf5a7e976bd492c8257d160591b0b3a/roles/153539819e5542df99269d2913bbecfb` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:08:58.907897 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd70d5b-c0d8-4e3b-8905-51b26d9d8332 admin admin] RBAC: Authorizing `identity:create_grant(project_id=06377f94cdea47f7abf0203b46b40f10, user_id=1cf5a7e976bd492c8257d160591b0b3a, role_id=153539819e5542df99269d2913bbecfb)` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:08:58.911122 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd70d5b-c0d8-4e3b-8905-51b26d9d8332 admin admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:08:58.923577 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 1421/2830] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Jul 14 11:08:58 2022] PUT /identity/v3/projects/06377f94cdea47f7abf0203b46b40f10/users/1cf5a7e976bd492c8257d160591b0b3a/roles/153539819e5542df99269d2913bbecfb => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:08:58.928097 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb322288-ee76-4ffc-bdab-470a546dfe99 admin admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:08:58.937913 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb322288-ee76-4ffc-bdab-470a546dfe99 admin admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:08:58.993371 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c67bf5-2e3b-45a8-9213-65dbfdf56bc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:08:58.994042 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c67bf5-2e3b-45a8-9213-65dbfdf56bc4 admin admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:08:58.994324 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c67bf5-2e3b-45a8-9213-65dbfdf56bc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:08:58.994598 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c67bf5-2e3b-45a8-9213-65dbfdf56bc4 admin admin] PATH_INFO: `/v3/roles` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:08:58.995319 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c67bf5-2e3b-45a8-9213-65dbfdf56bc4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:08:58.996930 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c67bf5-2e3b-45a8-9213-65dbfdf56bc4 admin admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:08:59.007204 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 1410/2831] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jul 14 11:08:58 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 11:08:59.011242 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd70d5b-c0d8-4e3b-8905-51b26d9d8332 admin admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:08:59.021785 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd70d5b-c0d8-4e3b-8905-51b26d9d8332 admin admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:08:59.026368 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7fb35e-6a13-4b11-bae9-8107fe777cca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:08:59.027250 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7fb35e-6a13-4b11-bae9-8107fe777cca admin admin] REQUEST_METHOD: `PUT` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:08:59.027539 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7fb35e-6a13-4b11-bae9-8107fe777cca admin admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:08:59.027820 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7fb35e-6a13-4b11-bae9-8107fe777cca admin admin] PATH_INFO: `/v3/projects/06377f94cdea47f7abf0203b46b40f10/users/1cf5a7e976bd492c8257d160591b0b3a/roles/153539819e5542df99269d2913bbecfb` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:08:59.029830 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7fb35e-6a13-4b11-bae9-8107fe777cca admin admin] RBAC: Authorizing `identity:create_grant(project_id=06377f94cdea47f7abf0203b46b40f10, user_id=1cf5a7e976bd492c8257d160591b0b3a, role_id=153539819e5542df99269d2913bbecfb)` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:08:59.032476 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7fb35e-6a13-4b11-bae9-8107fe777cca admin admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:08:59.042955 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 1422/2832] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Jul 14 11:08:59 2022] PUT /identity/v3/projects/06377f94cdea47f7abf0203b46b40f10/users/1cf5a7e976bd492c8257d160591b0b3a/roles/153539819e5542df99269d2913bbecfb => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:08:59.053664 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf5db82-73a2-4134-a6e3-2e83de3b7324 None None] REQUEST_METHOD: `POST` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:08:59.054182 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf5db82-73a2-4134-a6e3-2e83de3b7324 None None] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:08:59.054478 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf5db82-73a2-4134-a6e3-2e83de3b7324 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:08:59.082665 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.auth.core [None req-bbf5db82-73a2-4134-a6e3-2e83de3b7324 None None] MFA Rules not processed for user `1cf5a7e976bd492c8257d160591b0b3a`. Rule list: `[]` (Enabled: `True`). {{(pid=86656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:08:59.083818 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-bbf5db82-73a2-4134-a6e3-2e83de3b7324 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:08:59.151340 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 1411/2833] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jul 14 11:08:59 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:08:59.163407 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7fb35e-6a13-4b11-bae9-8107fe777cca admin admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:08:59.165213 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-2e7fb35e-6a13-4b11-bae9-8107fe777cca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:08:59.221980 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7fb35e-6a13-4b11-bae9-8107fe777cca admin admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:08:59.226494 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741ccc48-d6a8-44d8-9152-1a22098d5166 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68382432147a48c3b62271fd2a2eab04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59391272ecbe48b0aa736cb43807be1d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:08:59.227135 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741ccc48-d6a8-44d8-9152-1a22098d5166 service cinder] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:08:59.227423 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741ccc48-d6a8-44d8-9152-1a22098d5166 service cinder] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:08:59.227702 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741ccc48-d6a8-44d8-9152-1a22098d5166 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:08:59.282382 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741ccc48-d6a8-44d8-9152-1a22098d5166 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:08:59.283821 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741ccc48-d6a8-44d8-9152-1a22098d5166 service cinder] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:08:59.293206 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 1423/2834] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jul 14 11:08:59 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 11:09:00.626840 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf5db82-73a2-4134-a6e3-2e83de3b7324 None None] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:09:00.628467 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-bbf5db82-73a2-4134-a6e3-2e83de3b7324 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:09:00.641500 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf5db82-73a2-4134-a6e3-2e83de3b7324 None None] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:09:00.645228 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2460245-0df2-4119-838d-a1d9fa1b8b2d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68382432147a48c3b62271fd2a2eab04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59391272ecbe48b0aa736cb43807be1d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:09:00.645870 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2460245-0df2-4119-838d-a1d9fa1b8b2d service cinder] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:09:00.646156 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2460245-0df2-4119-838d-a1d9fa1b8b2d service cinder] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:09:00.646431 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2460245-0df2-4119-838d-a1d9fa1b8b2d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:09:00.655409 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2460245-0df2-4119-838d-a1d9fa1b8b2d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:09:00.656854 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2460245-0df2-4119-838d-a1d9fa1b8b2d service cinder] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:09:00.666807 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 1412/2835] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jul 14 11:09:00 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 11:09:04.375661 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741ccc48-d6a8-44d8-9152-1a22098d5166 service cinder] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:09:04.440087 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741ccc48-d6a8-44d8-9152-1a22098d5166 service cinder] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:09:04.445320 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e38ec8-9ca1-4440-a218-1dce40448221 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:09:04.446207 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e38ec8-9ca1-4440-a218-1dce40448221 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:09:04.446493 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e38ec8-9ca1-4440-a218-1dce40448221 admin admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:09:04.446772 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e38ec8-9ca1-4440-a218-1dce40448221 admin admin] PATH_INFO: `/v3/users/9841182b6de1429fa9f8b851649ee201` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:09:04.448192 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e38ec8-9ca1-4440-a218-1dce40448221 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9841182b6de1429fa9f8b851649ee201)` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:09:04.450583 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e38ec8-9ca1-4440-a218-1dce40448221 admin admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:09:04.452266 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:09:04.501566 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-b5e38ec8-9ca1-4440-a218-1dce40448221 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9841182b6de1429fa9f8b851649ee201'} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:09:04.509220 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-b5e38ec8-9ca1-4440-a218-1dce40448221 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9841182b6de1429fa9f8b851649ee201'} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:09:04.509842 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-b5e38ec8-9ca1-4440-a218-1dce40448221 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9841182b6de1429fa9f8b851649ee201'} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:09:04.516755 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-b5e38ec8-9ca1-4440-a218-1dce40448221 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9841182b6de1429fa9f8b851649ee201'} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:09:04.517444 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-b5e38ec8-9ca1-4440-a218-1dce40448221 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9841182b6de1429fa9f8b851649ee201'} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:09:04.539857 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 1424/2836] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Jul 14 11:09:04 2022] DELETE /identity/v3/users/9841182b6de1429fa9f8b851649ee201 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:09:04.544406 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7cc4a5-3202-4a01-aa80-d34e39c44bbb None None] REQUEST_METHOD: `POST` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:09:04.544927 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7cc4a5-3202-4a01-aa80-d34e39c44bbb None None] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:09:04.545026 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7cc4a5-3202-4a01-aa80-d34e39c44bbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:09:04.562344 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.auth.core [None req-cd7cc4a5-3202-4a01-aa80-d34e39c44bbb None None] MFA Rules not processed for user `ae4bcdd8106d4bebbdcae96be33505bc`. Rule list: `[]` (Enabled: `True`). {{(pid=86656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:09:04.563537 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-cd7cc4a5-3202-4a01-aa80-d34e39c44bbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:09:04.615870 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=100 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:09:04.626988 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 1413/2837] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jul 14 11:09:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:09:04.637155 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e38ec8-9ca1-4440-a218-1dce40448221 admin admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:09:04.638618 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-b5e38ec8-9ca1-4440-a218-1dce40448221 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:09:04.696895 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e38ec8-9ca1-4440-a218-1dce40448221 admin admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:09:04.700965 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8818ccf0-6f42-43f6-8798-0458d17dfad0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dddf93691844886982c91fea974385d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59391272ecbe48b0aa736cb43807be1d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:09:04.701648 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8818ccf0-6f42-43f6-8798-0458d17dfad0 service neutron] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:09:04.701936 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8818ccf0-6f42-43f6-8798-0458d17dfad0 service neutron] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:09:04.702218 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8818ccf0-6f42-43f6-8798-0458d17dfad0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:09:04.711937 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8818ccf0-6f42-43f6-8798-0458d17dfad0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:09:04.713407 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8818ccf0-6f42-43f6-8798-0458d17dfad0 service neutron] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:09:04.723419 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 1425/2838] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jul 14 11:09:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 11:09:05.013965 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7cc4a5-3202-4a01-aa80-d34e39c44bbb None None] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:09:05.015437 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-cd7cc4a5-3202-4a01-aa80-d34e39c44bbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:09:05.028100 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7cc4a5-3202-4a01-aa80-d34e39c44bbb None None] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:09:05.032821 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5375df8e-edb3-4b6f-ad5f-1c8b22bdaa6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:09:05.033690 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5375df8e-edb3-4b6f-ad5f-1c8b22bdaa6b admin admin] REQUEST_METHOD: `DELETE` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:09:05.033974 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5375df8e-edb3-4b6f-ad5f-1c8b22bdaa6b admin admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:09:05.034246 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5375df8e-edb3-4b6f-ad5f-1c8b22bdaa6b admin admin] PATH_INFO: `/v3/projects/7cd80122e23b4bce9ae0add075d3f8e7` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:09:05.035492 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5375df8e-edb3-4b6f-ad5f-1c8b22bdaa6b admin admin] RBAC: Authorizing `identity:delete_project(project_id=7cd80122e23b4bce9ae0add075d3f8e7)` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:09:05.037529 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5375df8e-edb3-4b6f-ad5f-1c8b22bdaa6b admin admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:09:05.084251 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-5375df8e-edb3-4b6f-ad5f-1c8b22bdaa6b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7cd80122e23b4bce9ae0add075d3f8e7', 'request_id': 'req-5375df8e-edb3-4b6f-ad5f-1c8b22bdaa6b'} {{(pid=86656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:09:05.091602 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-5375df8e-edb3-4b6f-ad5f-1c8b22bdaa6b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7cd80122e23b4bce9ae0add075d3f8e7', 'request_id': 'req-5375df8e-edb3-4b6f-ad5f-1c8b22bdaa6b'} {{(pid=86656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:09:05.097979 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-5375df8e-edb3-4b6f-ad5f-1c8b22bdaa6b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7cd80122e23b4bce9ae0add075d3f8e7', 'request_id': 'req-5375df8e-edb3-4b6f-ad5f-1c8b22bdaa6b'} {{(pid=86656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:09:05.108096 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-5375df8e-edb3-4b6f-ad5f-1c8b22bdaa6b admin admin] The token cache is being invalidate because project 7cd80122e23b4bce9ae0add075d3f8e7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86656) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 11:09:05.108389 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-5375df8e-edb3-4b6f-ad5f-1c8b22bdaa6b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:09:05.109064 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-5375df8e-edb3-4b6f-ad5f-1c8b22bdaa6b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:09:05.110591 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 1414/2839] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Jul 14 11:09:05 2022] DELETE /identity/v3/projects/7cd80122e23b4bce9ae0add075d3f8e7 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:09:05.114828 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8818ccf0-6f42-43f6-8798-0458d17dfad0 service neutron] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:09:05.124459 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8818ccf0-6f42-43f6-8798-0458d17dfad0 service neutron] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:09:05.181270 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9878b57-3f2a-417c-bac2-366c0a1cc5e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:09:05.182152 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9878b57-3f2a-417c-bac2-366c0a1cc5e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:09:05.182440 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9878b57-3f2a-417c-bac2-366c0a1cc5e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:09:05.182719 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9878b57-3f2a-417c-bac2-366c0a1cc5e6 admin admin] PATH_INFO: `/v3/users/1cf5a7e976bd492c8257d160591b0b3a` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:09:05.183928 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9878b57-3f2a-417c-bac2-366c0a1cc5e6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1cf5a7e976bd492c8257d160591b0b3a)` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:09:05.185869 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9878b57-3f2a-417c-bac2-366c0a1cc5e6 admin admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:09:05.208166 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:09:05.231762 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-a9878b57-3f2a-417c-bac2-366c0a1cc5e6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1cf5a7e976bd492c8257d160591b0b3a'} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:09:05.239139 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-a9878b57-3f2a-417c-bac2-366c0a1cc5e6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1cf5a7e976bd492c8257d160591b0b3a'} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:09:05.239834 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-a9878b57-3f2a-417c-bac2-366c0a1cc5e6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1cf5a7e976bd492c8257d160591b0b3a'} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:09:05.246809 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-a9878b57-3f2a-417c-bac2-366c0a1cc5e6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1cf5a7e976bd492c8257d160591b0b3a'} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:09:05.247498 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-a9878b57-3f2a-417c-bac2-366c0a1cc5e6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1cf5a7e976bd492c8257d160591b0b3a'} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:09:05.264821 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 1426/2840] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Jul 14 11:09:05 2022] DELETE /identity/v3/users/1cf5a7e976bd492c8257d160591b0b3a => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:09:05.542627 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5375df8e-edb3-4b6f-ad5f-1c8b22bdaa6b admin admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:09:05.544153 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-5375df8e-edb3-4b6f-ad5f-1c8b22bdaa6b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:09:05.561315 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5375df8e-edb3-4b6f-ad5f-1c8b22bdaa6b admin admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:09:05.619711 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7fc742b-a896-46e4-b57a-7a9ca97a451b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:09:05.620574 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fc742b-a896-46e4-b57a-7a9ca97a451b admin admin] REQUEST_METHOD: `DELETE` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:09:05.620887 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fc742b-a896-46e4-b57a-7a9ca97a451b admin admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:09:05.621166 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fc742b-a896-46e4-b57a-7a9ca97a451b admin admin] PATH_INFO: `/v3/projects/06377f94cdea47f7abf0203b46b40f10` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:09:05.622334 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7fc742b-a896-46e4-b57a-7a9ca97a451b admin admin] RBAC: Authorizing `identity:delete_project(project_id=06377f94cdea47f7abf0203b46b40f10)` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:09:05.624222 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7fc742b-a896-46e4-b57a-7a9ca97a451b admin admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:09:05.671433 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-b7fc742b-a896-46e4-b57a-7a9ca97a451b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '06377f94cdea47f7abf0203b46b40f10', 'request_id': 'req-b7fc742b-a896-46e4-b57a-7a9ca97a451b'} {{(pid=86656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:09:05.678755 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-b7fc742b-a896-46e4-b57a-7a9ca97a451b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '06377f94cdea47f7abf0203b46b40f10', 'request_id': 'req-b7fc742b-a896-46e4-b57a-7a9ca97a451b'} {{(pid=86656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:09:05.685005 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-b7fc742b-a896-46e4-b57a-7a9ca97a451b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '06377f94cdea47f7abf0203b46b40f10', 'request_id': 'req-b7fc742b-a896-46e4-b57a-7a9ca97a451b'} {{(pid=86656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:09:05.695771 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-b7fc742b-a896-46e4-b57a-7a9ca97a451b admin admin] The token cache is being invalidate because project 06377f94cdea47f7abf0203b46b40f10 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86656) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 11:09:05.696076 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-b7fc742b-a896-46e4-b57a-7a9ca97a451b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:09:05.696694 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-b7fc742b-a896-46e4-b57a-7a9ca97a451b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:09:05.698249 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 1415/2841] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Jul 14 11:09:05 2022] DELETE /identity/v3/projects/06377f94cdea47f7abf0203b46b40f10 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:09:05.703405 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c56772-ddb1-4705-8aa7-62c7a6deab18 None None] REQUEST_METHOD: `POST` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:09:05.703906 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c56772-ddb1-4705-8aa7-62c7a6deab18 None None] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:09:05.704017 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c56772-ddb1-4705-8aa7-62c7a6deab18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:09:05.721609 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.auth.core [None req-50c56772-ddb1-4705-8aa7-62c7a6deab18 None None] MFA Rules not processed for user `ae4bcdd8106d4bebbdcae96be33505bc`. Rule list: `[]` (Enabled: `True`). {{(pid=86655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:09:05.722824 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-50c56772-ddb1-4705-8aa7-62c7a6deab18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:09:05.781244 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 1427/2842] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jul 14 11:09:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 11:09:05.843381 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a529bf-0885-4275-8a35-df8bfb2c666b None None] REQUEST_METHOD: `POST` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:09:05.843674 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a529bf-0885-4275-8a35-df8bfb2c666b None None] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:09:05.843954 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a529bf-0885-4275-8a35-df8bfb2c666b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:09:05.863384 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.auth.core [None req-f8a529bf-0885-4275-8a35-df8bfb2c666b None None] MFA Rules not processed for user `ae4bcdd8106d4bebbdcae96be33505bc`. Rule list: `[]` (Enabled: `True`). {{(pid=86656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:09:05.864725 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-f8a529bf-0885-4275-8a35-df8bfb2c666b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:09:05.872672 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 1416/2843] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jul 14 11:09:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:09:05.876787 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c56772-ddb1-4705-8aa7-62c7a6deab18 None None] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:09:05.886968 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c56772-ddb1-4705-8aa7-62c7a6deab18 None None] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:09:05.891515 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bd48de-5d3d-40f6-92b3-fc1a2e585794 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:09:05.892171 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bd48de-5d3d-40f6-92b3-fc1a2e585794 admin admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:09:05.892460 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bd48de-5d3d-40f6-92b3-fc1a2e585794 admin admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:09:05.892742 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bd48de-5d3d-40f6-92b3-fc1a2e585794 admin admin] PATH_INFO: `/v3/domains` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:09:05.893513 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6bd48de-5d3d-40f6-92b3-fc1a2e585794 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:09:05.893854 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6bd48de-5d3d-40f6-92b3-fc1a2e585794 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:09:05.895535 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6bd48de-5d3d-40f6-92b3-fc1a2e585794 admin admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:09:05.906993 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 1428/2844] 10.222.0.16 () {58 vars in 1152 bytes} [Thu Jul 14 11:09:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:09:05.911790 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a529bf-0885-4275-8a35-df8bfb2c666b None None] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:09:05.916258 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:09:05.922620 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a529bf-0885-4275-8a35-df8bfb2c666b None None] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:09:05.928920 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e468239-6483-4c28-9ba7-637e57790517 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:09:05.929573 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e468239-6483-4c28-9ba7-637e57790517 admin admin] REQUEST_METHOD: `POST` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:09:05.929858 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e468239-6483-4c28-9ba7-637e57790517 admin admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:09:05.930136 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e468239-6483-4c28-9ba7-637e57790517 admin admin] PATH_INFO: `/v3/projects` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:09:05.930865 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e468239-6483-4c28-9ba7-637e57790517 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:09:05.932764 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e468239-6483-4c28-9ba7-637e57790517 admin admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:09:05.957881 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 1417/2845] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Jul 14 11:09:05 2022] POST /identity/v3/projects => generated 365 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 11:09:05.962013 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bd48de-5d3d-40f6-92b3-fc1a2e585794 admin admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:09:05.972003 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bd48de-5d3d-40f6-92b3-fc1a2e585794 admin admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:09:06.027401 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebc152c-53e9-4903-afab-9799fb7e360b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:09:06.028064 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebc152c-53e9-4903-afab-9799fb7e360b admin admin] REQUEST_METHOD: `POST` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:09:06.028350 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebc152c-53e9-4903-afab-9799fb7e360b admin admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:09:06.028627 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebc152c-53e9-4903-afab-9799fb7e360b admin admin] PATH_INFO: `/v3/users` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:09:06.029362 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebc152c-53e9-4903-afab-9799fb7e360b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:09:06.031255 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebc152c-53e9-4903-afab-9799fb7e360b admin admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:09:06.051086 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 1429/2846] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Jul 14 11:09:05 2022] POST /identity/v3/users => generated 283 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 11:09:06.055493 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e468239-6483-4c28-9ba7-637e57790517 admin admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:09:06.065652 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e468239-6483-4c28-9ba7-637e57790517 admin admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:09:06.070455 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136d7d21-b6b7-4413-96c5-21b7661c3d06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:09:06.071111 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136d7d21-b6b7-4413-96c5-21b7661c3d06 admin admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:09:06.071395 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136d7d21-b6b7-4413-96c5-21b7661c3d06 admin admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:09:06.071671 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136d7d21-b6b7-4413-96c5-21b7661c3d06 admin admin] PATH_INFO: `/v3/roles` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:09:06.072390 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136d7d21-b6b7-4413-96c5-21b7661c3d06 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:09:06.074018 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136d7d21-b6b7-4413-96c5-21b7661c3d06 admin admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:09:06.085422 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 1418/2847] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jul 14 11:09:06 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 11:09:06.089354 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebc152c-53e9-4903-afab-9799fb7e360b admin admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:09:06.100294 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebc152c-53e9-4903-afab-9799fb7e360b admin admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:09:06.104922 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476183c7-bd9e-45e1-be23-d7199db441b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:09:06.105604 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476183c7-bd9e-45e1-be23-d7199db441b8 admin admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:09:06.105891 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476183c7-bd9e-45e1-be23-d7199db441b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:09:06.106168 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476183c7-bd9e-45e1-be23-d7199db441b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:09:06.106900 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476183c7-bd9e-45e1-be23-d7199db441b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:09:06.108503 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476183c7-bd9e-45e1-be23-d7199db441b8 admin admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:09:06.118591 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 1430/2848] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jul 14 11:09:06 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 11:09:06.122465 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136d7d21-b6b7-4413-96c5-21b7661c3d06 admin admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:09:06.132303 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136d7d21-b6b7-4413-96c5-21b7661c3d06 admin admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:09:06.136761 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f07858e-9c9e-4ba8-9bd9-60877a7c0337 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:09:06.137650 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f07858e-9c9e-4ba8-9bd9-60877a7c0337 admin admin] REQUEST_METHOD: `PUT` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:09:06.137929 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f07858e-9c9e-4ba8-9bd9-60877a7c0337 admin admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:09:06.138199 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f07858e-9c9e-4ba8-9bd9-60877a7c0337 admin admin] PATH_INFO: `/v3/projects/04e4836349184a2187e83bff178ad4ef/users/a93075596edd4849bbb0b1646cd63c74/roles/0da46c267d354cce81495dfdd56c1ec2` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:09:06.153451 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f07858e-9c9e-4ba8-9bd9-60877a7c0337 admin admin] RBAC: Authorizing `identity:create_grant(project_id=04e4836349184a2187e83bff178ad4ef, user_id=a93075596edd4849bbb0b1646cd63c74, role_id=0da46c267d354cce81495dfdd56c1ec2)` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:09:06.156126 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f07858e-9c9e-4ba8-9bd9-60877a7c0337 admin admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:09:06.169764 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 1419/2849] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Jul 14 11:09:06 2022] PUT /identity/v3/projects/04e4836349184a2187e83bff178ad4ef/users/a93075596edd4849bbb0b1646cd63c74/roles/0da46c267d354cce81495dfdd56c1ec2 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:09:06.180129 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a26e76a-fa68-434a-b519-85a05ee8401d None None] REQUEST_METHOD: `POST` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:09:06.180366 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a26e76a-fa68-434a-b519-85a05ee8401d None None] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:09:06.180653 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a26e76a-fa68-434a-b519-85a05ee8401d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:09:06.193330 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=90,keystone:DELETE=6,keystone:INSERT=4 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:09:06.211115 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.auth.core [None req-3a26e76a-fa68-434a-b519-85a05ee8401d None None] MFA Rules not processed for user `a93075596edd4849bbb0b1646cd63c74`. Rule list: `[]` (Enabled: `True`). {{(pid=86655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:09:06.212372 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-3a26e76a-fa68-434a-b519-85a05ee8401d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:09:06.277115 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 1431/2850] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jul 14 11:09:06 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:09:06.281719 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f07858e-9c9e-4ba8-9bd9-60877a7c0337 admin admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:09:06.343461 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f07858e-9c9e-4ba8-9bd9-60877a7c0337 admin admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:09:06.348314 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e82b660-3c09-4984-ae57-95d230d7d99a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:09:06.349015 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e82b660-3c09-4984-ae57-95d230d7d99a admin admin] REQUEST_METHOD: `POST` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:09:06.349303 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e82b660-3c09-4984-ae57-95d230d7d99a admin admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:09:06.349584 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e82b660-3c09-4984-ae57-95d230d7d99a admin admin] PATH_INFO: `/v3/projects` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:09:06.350292 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e82b660-3c09-4984-ae57-95d230d7d99a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:09:06.352184 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e82b660-3c09-4984-ae57-95d230d7d99a admin admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:09:06.376340 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 1420/2851] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Jul 14 11:09:06 2022] POST /identity/v3/projects => generated 365 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 11:09:06.380905 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a26e76a-fa68-434a-b519-85a05ee8401d None None] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:09:06.391603 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a26e76a-fa68-434a-b519-85a05ee8401d None None] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:09:06.447205 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4f84c8-764d-4662-8de4-54a4e1e44452 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:09:06.447837 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4f84c8-764d-4662-8de4-54a4e1e44452 admin admin] REQUEST_METHOD: `POST` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:09:06.448128 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4f84c8-764d-4662-8de4-54a4e1e44452 admin admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:09:06.448414 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4f84c8-764d-4662-8de4-54a4e1e44452 admin admin] PATH_INFO: `/v3/users` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:09:06.449147 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4f84c8-764d-4662-8de4-54a4e1e44452 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:09:06.451347 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4f84c8-764d-4662-8de4-54a4e1e44452 admin admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:09:06.472746 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 1432/2852] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Jul 14 11:09:06 2022] POST /identity/v3/users => generated 289 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 11:09:06.476163 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e82b660-3c09-4984-ae57-95d230d7d99a admin admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:09:06.486209 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e82b660-3c09-4984-ae57-95d230d7d99a admin admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:09:06.490858 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e93463-7bec-45a9-b87d-9ef7ce4e34b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:09:06.491511 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e93463-7bec-45a9-b87d-9ef7ce4e34b3 admin admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:09:06.491792 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e93463-7bec-45a9-b87d-9ef7ce4e34b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:09:06.492068 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e93463-7bec-45a9-b87d-9ef7ce4e34b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:09:06.492801 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e93463-7bec-45a9-b87d-9ef7ce4e34b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:09:06.494836 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e93463-7bec-45a9-b87d-9ef7ce4e34b3 admin admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:09:06.506500 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 1421/2853] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jul 14 11:09:06 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 11:09:06.510727 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4f84c8-764d-4662-8de4-54a4e1e44452 admin admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:09:06.521861 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4f84c8-764d-4662-8de4-54a4e1e44452 admin admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:09:06.526460 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4556a8c-b6d8-49e1-afdd-13f2456b8ebc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:09:06.527342 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4556a8c-b6d8-49e1-afdd-13f2456b8ebc admin admin] REQUEST_METHOD: `PUT` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:09:06.527643 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4556a8c-b6d8-49e1-afdd-13f2456b8ebc admin admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:09:06.527913 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4556a8c-b6d8-49e1-afdd-13f2456b8ebc admin admin] PATH_INFO: `/v3/projects/3ac13ef6e6494aa39a9c7c4dfb0fa431/users/9ca48fc80bc44f699fc717ced51d5bec/roles/153539819e5542df99269d2913bbecfb` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:09:06.542798 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4556a8c-b6d8-49e1-afdd-13f2456b8ebc admin admin] RBAC: Authorizing `identity:create_grant(project_id=3ac13ef6e6494aa39a9c7c4dfb0fa431, user_id=9ca48fc80bc44f699fc717ced51d5bec, role_id=153539819e5542df99269d2913bbecfb)` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:09:06.545492 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4556a8c-b6d8-49e1-afdd-13f2456b8ebc admin admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:09:06.558614 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 1433/2854] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Jul 14 11:09:06 2022] PUT /identity/v3/projects/3ac13ef6e6494aa39a9c7c4dfb0fa431/users/9ca48fc80bc44f699fc717ced51d5bec/roles/153539819e5542df99269d2913bbecfb => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 11:09:06.562468 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e93463-7bec-45a9-b87d-9ef7ce4e34b3 admin admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:09:06.573220 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e93463-7bec-45a9-b87d-9ef7ce4e34b3 admin admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:09:06.634084 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88eb059e-626d-43dd-b8f8-a517e4ee31a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:09:06.634758 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88eb059e-626d-43dd-b8f8-a517e4ee31a4 admin admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:09:06.635044 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88eb059e-626d-43dd-b8f8-a517e4ee31a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:09:06.635319 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88eb059e-626d-43dd-b8f8-a517e4ee31a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:09:06.636042 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88eb059e-626d-43dd-b8f8-a517e4ee31a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:09:06.637679 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88eb059e-626d-43dd-b8f8-a517e4ee31a4 admin admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:09:06.648332 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 1422/2855] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jul 14 11:09:06 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 11:09:06.652466 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4556a8c-b6d8-49e1-afdd-13f2456b8ebc admin admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:09:06.663554 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4556a8c-b6d8-49e1-afdd-13f2456b8ebc admin admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:09:06.668192 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8520b695-e3dd-4b1d-84cd-59e537806677 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:09:06.669120 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8520b695-e3dd-4b1d-84cd-59e537806677 admin admin] REQUEST_METHOD: `PUT` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:09:06.669441 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8520b695-e3dd-4b1d-84cd-59e537806677 admin admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:09:06.669723 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8520b695-e3dd-4b1d-84cd-59e537806677 admin admin] PATH_INFO: `/v3/projects/3ac13ef6e6494aa39a9c7c4dfb0fa431/users/9ca48fc80bc44f699fc717ced51d5bec/roles/153539819e5542df99269d2913bbecfb` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:09:06.671730 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8520b695-e3dd-4b1d-84cd-59e537806677 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3ac13ef6e6494aa39a9c7c4dfb0fa431, user_id=9ca48fc80bc44f699fc717ced51d5bec, role_id=153539819e5542df99269d2913bbecfb)` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:09:06.674395 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8520b695-e3dd-4b1d-84cd-59e537806677 admin admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:09:06.685148 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 1434/2856] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Jul 14 11:09:06 2022] PUT /identity/v3/projects/3ac13ef6e6494aa39a9c7c4dfb0fa431/users/9ca48fc80bc44f699fc717ced51d5bec/roles/153539819e5542df99269d2913bbecfb => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:09:06.695860 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a562a77-22be-4764-86b4-7b4df2ef4cd0 None None] REQUEST_METHOD: `POST` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:09:06.696151 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a562a77-22be-4764-86b4-7b4df2ef4cd0 None None] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:09:06.696444 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a562a77-22be-4764-86b4-7b4df2ef4cd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:09:06.722657 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.auth.core [None req-6a562a77-22be-4764-86b4-7b4df2ef4cd0 None None] MFA Rules not processed for user `9ca48fc80bc44f699fc717ced51d5bec`. Rule list: `[]` (Enabled: `True`). {{(pid=86656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:09:06.723790 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-6a562a77-22be-4764-86b4-7b4df2ef4cd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:09:06.727641 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:09:06.793569 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 1423/2857] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jul 14 11:09:06 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:09:06.805187 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8520b695-e3dd-4b1d-84cd-59e537806677 admin admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:09:06.806995 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-8520b695-e3dd-4b1d-84cd-59e537806677 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:09:06.860349 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:09:06.864833 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8520b695-e3dd-4b1d-84cd-59e537806677 admin admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:09:06.869373 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29376052-c50f-490f-963c-c1014e5f9240 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68382432147a48c3b62271fd2a2eab04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59391272ecbe48b0aa736cb43807be1d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:09:06.870028 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29376052-c50f-490f-963c-c1014e5f9240 service cinder] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:09:06.870321 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29376052-c50f-490f-963c-c1014e5f9240 service cinder] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:09:06.870606 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29376052-c50f-490f-963c-c1014e5f9240 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:09:06.879962 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29376052-c50f-490f-963c-c1014e5f9240 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:09:06.881443 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29376052-c50f-490f-963c-c1014e5f9240 service cinder] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:09:06.890882 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 1435/2858] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jul 14 11:09:06 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 11:09:06.967022 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a562a77-22be-4764-86b4-7b4df2ef4cd0 None None] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:09:06.977844 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a562a77-22be-4764-86b4-7b4df2ef4cd0 None None] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:09:06.981495 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9116b8b-a995-4276-b311-d9ccd8c32f25 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68382432147a48c3b62271fd2a2eab04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59391272ecbe48b0aa736cb43807be1d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:09:06.982135 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9116b8b-a995-4276-b311-d9ccd8c32f25 service cinder] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:09:06.982421 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9116b8b-a995-4276-b311-d9ccd8c32f25 service cinder] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:09:06.982699 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9116b8b-a995-4276-b311-d9ccd8c32f25 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:09:07.038739 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9116b8b-a995-4276-b311-d9ccd8c32f25 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:09:07.040170 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9116b8b-a995-4276-b311-d9ccd8c32f25 service cinder] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:09:07.048956 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 1424/2859] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jul 14 11:09:06 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 11:09:11.677142 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29376052-c50f-490f-963c-c1014e5f9240 service cinder] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:09:11.741659 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29376052-c50f-490f-963c-c1014e5f9240 service cinder] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:09:11.746207 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a9fcbf-9078-4b48-8168-14dff35244e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:09:11.747077 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a9fcbf-9078-4b48-8168-14dff35244e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:09:11.747361 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a9fcbf-9078-4b48-8168-14dff35244e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:09:11.747637 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a9fcbf-9078-4b48-8168-14dff35244e8 admin admin] PATH_INFO: `/v3/users/a93075596edd4849bbb0b1646cd63c74` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:09:11.748912 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a9fcbf-9078-4b48-8168-14dff35244e8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a93075596edd4849bbb0b1646cd63c74)` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:09:11.750829 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a9fcbf-9078-4b48-8168-14dff35244e8 admin admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:09:11.797620 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-b7a9fcbf-9078-4b48-8168-14dff35244e8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a93075596edd4849bbb0b1646cd63c74'} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:09:11.804827 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-b7a9fcbf-9078-4b48-8168-14dff35244e8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a93075596edd4849bbb0b1646cd63c74'} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:09:11.805438 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-b7a9fcbf-9078-4b48-8168-14dff35244e8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a93075596edd4849bbb0b1646cd63c74'} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:09:11.812208 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-b7a9fcbf-9078-4b48-8168-14dff35244e8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a93075596edd4849bbb0b1646cd63c74'} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:09:11.812877 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-b7a9fcbf-9078-4b48-8168-14dff35244e8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a93075596edd4849bbb0b1646cd63c74'} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:09:11.830725 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 1436/2860] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Jul 14 11:09:11 2022] DELETE /identity/v3/users/a93075596edd4849bbb0b1646cd63c74 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:09:11.835878 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36435368-2df6-4a2b-b2de-9b1d493688fa None None] REQUEST_METHOD: `POST` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:09:11.836358 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36435368-2df6-4a2b-b2de-9b1d493688fa None None] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:09:11.836470 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36435368-2df6-4a2b-b2de-9b1d493688fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:09:11.854074 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.auth.core [None req-36435368-2df6-4a2b-b2de-9b1d493688fa None None] MFA Rules not processed for user `ae4bcdd8106d4bebbdcae96be33505bc`. Rule list: `[]` (Enabled: `True`). {{(pid=86656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:09:11.855275 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-36435368-2df6-4a2b-b2de-9b1d493688fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:09:11.912841 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 1425/2861] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jul 14 11:09:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:09:11.922452 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a9fcbf-9078-4b48-8168-14dff35244e8 admin admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:09:11.923879 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-b7a9fcbf-9078-4b48-8168-14dff35244e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:09:11.981041 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a9fcbf-9078-4b48-8168-14dff35244e8 admin admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:09:11.984598 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b84ff36-6110-4911-80d5-89b2360d77b9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dddf93691844886982c91fea974385d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59391272ecbe48b0aa736cb43807be1d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:09:11.985270 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b84ff36-6110-4911-80d5-89b2360d77b9 service neutron] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:09:11.985552 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b84ff36-6110-4911-80d5-89b2360d77b9 service neutron] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:09:11.985830 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b84ff36-6110-4911-80d5-89b2360d77b9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:09:11.995313 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b84ff36-6110-4911-80d5-89b2360d77b9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:09:11.996737 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b84ff36-6110-4911-80d5-89b2360d77b9 service neutron] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:09:12.006976 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 1437/2862] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jul 14 11:09:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 11:09:12.272797 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36435368-2df6-4a2b-b2de-9b1d493688fa None None] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:09:12.274238 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-36435368-2df6-4a2b-b2de-9b1d493688fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:09:12.286422 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36435368-2df6-4a2b-b2de-9b1d493688fa None None] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:09:12.291058 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be15a330-2072-4646-8157-6e502d32c4aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:09:12.291929 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be15a330-2072-4646-8157-6e502d32c4aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:09:12.292210 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be15a330-2072-4646-8157-6e502d32c4aa admin admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:09:12.292541 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be15a330-2072-4646-8157-6e502d32c4aa admin admin] PATH_INFO: `/v3/projects/04e4836349184a2187e83bff178ad4ef` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:09:12.293719 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be15a330-2072-4646-8157-6e502d32c4aa admin admin] RBAC: Authorizing `identity:delete_project(project_id=04e4836349184a2187e83bff178ad4ef)` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:09:12.295663 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be15a330-2072-4646-8157-6e502d32c4aa admin admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:09:12.333327 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:09:12.343768 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-be15a330-2072-4646-8157-6e502d32c4aa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '04e4836349184a2187e83bff178ad4ef', 'request_id': 'req-be15a330-2072-4646-8157-6e502d32c4aa'} {{(pid=86656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:09:12.351528 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-be15a330-2072-4646-8157-6e502d32c4aa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '04e4836349184a2187e83bff178ad4ef', 'request_id': 'req-be15a330-2072-4646-8157-6e502d32c4aa'} {{(pid=86656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:09:12.358356 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-be15a330-2072-4646-8157-6e502d32c4aa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '04e4836349184a2187e83bff178ad4ef', 'request_id': 'req-be15a330-2072-4646-8157-6e502d32c4aa'} {{(pid=86656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:09:12.369223 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-be15a330-2072-4646-8157-6e502d32c4aa admin admin] The token cache is being invalidate because project 04e4836349184a2187e83bff178ad4ef was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86656) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 11:09:12.369541 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-be15a330-2072-4646-8157-6e502d32c4aa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:09:12.370192 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-be15a330-2072-4646-8157-6e502d32c4aa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:09:12.371740 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 1426/2863] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Jul 14 11:09:12 2022] DELETE /identity/v3/projects/04e4836349184a2187e83bff178ad4ef => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:09:12.375650 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b84ff36-6110-4911-80d5-89b2360d77b9 service neutron] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:09:12.385447 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b84ff36-6110-4911-80d5-89b2360d77b9 service neutron] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:09:12.394900 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:09:12.444931 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5862ab-e243-4e41-82e4-8966843eac68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:09:12.445811 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5862ab-e243-4e41-82e4-8966843eac68 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:09:12.446101 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5862ab-e243-4e41-82e4-8966843eac68 admin admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:09:12.446383 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5862ab-e243-4e41-82e4-8966843eac68 admin admin] PATH_INFO: `/v3/users/9ca48fc80bc44f699fc717ced51d5bec` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:09:12.447574 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5862ab-e243-4e41-82e4-8966843eac68 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9ca48fc80bc44f699fc717ced51d5bec)` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:09:12.449794 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5862ab-e243-4e41-82e4-8966843eac68 admin admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:09:12.495152 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-de5862ab-e243-4e41-82e4-8966843eac68 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9ca48fc80bc44f699fc717ced51d5bec'} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:09:12.502289 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-de5862ab-e243-4e41-82e4-8966843eac68 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9ca48fc80bc44f699fc717ced51d5bec'} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:09:12.502949 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-de5862ab-e243-4e41-82e4-8966843eac68 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9ca48fc80bc44f699fc717ced51d5bec'} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:09:12.510296 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-de5862ab-e243-4e41-82e4-8966843eac68 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9ca48fc80bc44f699fc717ced51d5bec'} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:09:12.510929 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-de5862ab-e243-4e41-82e4-8966843eac68 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9ca48fc80bc44f699fc717ced51d5bec'} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:09:12.528278 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 1438/2864] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Jul 14 11:09:12 2022] DELETE /identity/v3/users/9ca48fc80bc44f699fc717ced51d5bec => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:09:12.801421 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be15a330-2072-4646-8157-6e502d32c4aa admin admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:09:12.802854 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-be15a330-2072-4646-8157-6e502d32c4aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:09:12.816378 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be15a330-2072-4646-8157-6e502d32c4aa admin admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:09:12.873755 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0027299-6e24-4d50-af07-4bd135f4b195 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:09:12.874625 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0027299-6e24-4d50-af07-4bd135f4b195 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:09:12.874911 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0027299-6e24-4d50-af07-4bd135f4b195 admin admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:09:12.875208 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0027299-6e24-4d50-af07-4bd135f4b195 admin admin] PATH_INFO: `/v3/projects/3ac13ef6e6494aa39a9c7c4dfb0fa431` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:09:12.876373 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0027299-6e24-4d50-af07-4bd135f4b195 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3ac13ef6e6494aa39a9c7c4dfb0fa431)` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:09:12.878433 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0027299-6e24-4d50-af07-4bd135f4b195 admin admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:09:12.925838 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-a0027299-6e24-4d50-af07-4bd135f4b195 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3ac13ef6e6494aa39a9c7c4dfb0fa431', 'request_id': 'req-a0027299-6e24-4d50-af07-4bd135f4b195'} {{(pid=86656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:09:12.933071 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-a0027299-6e24-4d50-af07-4bd135f4b195 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3ac13ef6e6494aa39a9c7c4dfb0fa431', 'request_id': 'req-a0027299-6e24-4d50-af07-4bd135f4b195'} {{(pid=86656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:09:12.939183 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-a0027299-6e24-4d50-af07-4bd135f4b195 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3ac13ef6e6494aa39a9c7c4dfb0fa431', 'request_id': 'req-a0027299-6e24-4d50-af07-4bd135f4b195'} {{(pid=86656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:09:12.950009 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-a0027299-6e24-4d50-af07-4bd135f4b195 admin admin] The token cache is being invalidate because project 3ac13ef6e6494aa39a9c7c4dfb0fa431 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86656) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 11:09:12.950295 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-a0027299-6e24-4d50-af07-4bd135f4b195 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:09:12.950950 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-a0027299-6e24-4d50-af07-4bd135f4b195 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:09:12.952455 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 1427/2865] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Jul 14 11:09:12 2022] DELETE /identity/v3/projects/3ac13ef6e6494aa39a9c7c4dfb0fa431 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:09:12.958070 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f5de19-194f-49cc-832d-b81e939679f3 None None] REQUEST_METHOD: `POST` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:09:12.958584 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f5de19-194f-49cc-832d-b81e939679f3 None None] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:09:12.958696 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f5de19-194f-49cc-832d-b81e939679f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:09:12.980857 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.auth.core [None req-e7f5de19-194f-49cc-832d-b81e939679f3 None None] MFA Rules not processed for user `ae4bcdd8106d4bebbdcae96be33505bc`. Rule list: `[]` (Enabled: `True`). {{(pid=86655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:09:12.982072 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-e7f5de19-194f-49cc-832d-b81e939679f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:09:13.040359 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 1439/2866] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jul 14 11:09:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:09:13.048131 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb904af-c481-444f-96ac-9081a1145656 None None] REQUEST_METHOD: `POST` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:09:13.048361 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb904af-c481-444f-96ac-9081a1145656 None None] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:09:13.048640 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb904af-c481-444f-96ac-9081a1145656 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:09:13.067121 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.auth.core [None req-2bb904af-c481-444f-96ac-9081a1145656 None None] MFA Rules not processed for user `ae4bcdd8106d4bebbdcae96be33505bc`. Rule list: `[]` (Enabled: `True`). {{(pid=86656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:09:13.068321 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-2bb904af-c481-444f-96ac-9081a1145656 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:09:13.076573 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 1428/2867] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jul 14 11:09:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:09:13.080459 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f5de19-194f-49cc-832d-b81e939679f3 None None] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:09:13.090305 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f5de19-194f-49cc-832d-b81e939679f3 None None] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:09:13.095075 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390df571-dd4b-476c-9efa-d75b6a1021c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:09:13.095725 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390df571-dd4b-476c-9efa-d75b6a1021c0 admin admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:09:13.096011 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390df571-dd4b-476c-9efa-d75b6a1021c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:09:13.096290 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390df571-dd4b-476c-9efa-d75b6a1021c0 admin admin] PATH_INFO: `/v3/domains` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:09:13.097556 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390df571-dd4b-476c-9efa-d75b6a1021c0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:09:13.097863 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390df571-dd4b-476c-9efa-d75b6a1021c0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:09:13.099450 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390df571-dd4b-476c-9efa-d75b6a1021c0 admin admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:09:13.110713 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 1440/2868] 10.222.0.16 () {58 vars in 1152 bytes} [Thu Jul 14 11:09:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:09:13.115563 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb904af-c481-444f-96ac-9081a1145656 None None] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:09:13.124815 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb904af-c481-444f-96ac-9081a1145656 None None] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:09:13.129790 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415f03d0-45f8-4cfa-9af1-1f58776a1191 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:09:13.130444 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415f03d0-45f8-4cfa-9af1-1f58776a1191 admin admin] REQUEST_METHOD: `POST` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:09:13.130725 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415f03d0-45f8-4cfa-9af1-1f58776a1191 admin admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:09:13.131001 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415f03d0-45f8-4cfa-9af1-1f58776a1191 admin admin] PATH_INFO: `/v3/projects` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:09:13.131705 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415f03d0-45f8-4cfa-9af1-1f58776a1191 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:09:13.133692 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415f03d0-45f8-4cfa-9af1-1f58776a1191 admin admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:09:13.158920 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 1429/2869] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Jul 14 11:09:13 2022] POST /identity/v3/projects => generated 385 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 11:09:13.163735 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390df571-dd4b-476c-9efa-d75b6a1021c0 admin admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:09:13.173581 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390df571-dd4b-476c-9efa-d75b6a1021c0 admin admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:09:13.190704 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:09:13.231311 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6859cbc6-3a42-4845-a762-58611f293147 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:09:13.231984 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6859cbc6-3a42-4845-a762-58611f293147 admin admin] REQUEST_METHOD: `POST` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:09:13.232271 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6859cbc6-3a42-4845-a762-58611f293147 admin admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:09:13.232557 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6859cbc6-3a42-4845-a762-58611f293147 admin admin] PATH_INFO: `/v3/users` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:09:13.233296 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6859cbc6-3a42-4845-a762-58611f293147 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:09:13.235205 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6859cbc6-3a42-4845-a762-58611f293147 admin admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:09:13.255563 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 1441/2870] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Jul 14 11:09:13 2022] POST /identity/v3/users => generated 293 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 11:09:13.259692 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415f03d0-45f8-4cfa-9af1-1f58776a1191 admin admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:09:13.269752 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415f03d0-45f8-4cfa-9af1-1f58776a1191 admin admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:09:13.274294 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a128951f-efee-47f4-9a10-069bf7e77c5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:09:13.274952 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a128951f-efee-47f4-9a10-069bf7e77c5e admin admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:09:13.275238 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a128951f-efee-47f4-9a10-069bf7e77c5e admin admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:09:13.275517 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a128951f-efee-47f4-9a10-069bf7e77c5e admin admin] PATH_INFO: `/v3/roles` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:09:13.276250 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a128951f-efee-47f4-9a10-069bf7e77c5e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:09:13.277885 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a128951f-efee-47f4-9a10-069bf7e77c5e admin admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:09:13.288654 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 1430/2871] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jul 14 11:09:13 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 11:09:13.292423 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6859cbc6-3a42-4845-a762-58611f293147 admin admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:09:13.303033 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6859cbc6-3a42-4845-a762-58611f293147 admin admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:09:13.307569 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65af5931-7595-4f3a-9680-4c36be32eb9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:09:13.308214 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65af5931-7595-4f3a-9680-4c36be32eb9b admin admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:09:13.308497 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65af5931-7595-4f3a-9680-4c36be32eb9b admin admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:09:13.308792 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65af5931-7595-4f3a-9680-4c36be32eb9b admin admin] PATH_INFO: `/v3/roles` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:09:13.309529 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65af5931-7595-4f3a-9680-4c36be32eb9b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:09:13.311102 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65af5931-7595-4f3a-9680-4c36be32eb9b admin admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:09:13.321119 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 1442/2872] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jul 14 11:09:13 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 11:09:13.325191 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a128951f-efee-47f4-9a10-069bf7e77c5e admin admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:09:13.335070 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a128951f-efee-47f4-9a10-069bf7e77c5e admin admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:09:13.339639 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935f06f2-4de2-4588-926d-a83fecd84d38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:09:13.340512 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935f06f2-4de2-4588-926d-a83fecd84d38 admin admin] REQUEST_METHOD: `PUT` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:09:13.340819 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935f06f2-4de2-4588-926d-a83fecd84d38 admin admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:09:13.341101 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935f06f2-4de2-4588-926d-a83fecd84d38 admin admin] PATH_INFO: `/v3/projects/59cad604d8e84ff183f446865f753191/users/987b99f839f149c98ca1a38ad504a2f9/roles/0da46c267d354cce81495dfdd56c1ec2` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:09:13.352619 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:DELETE=12,keystone:SELECT=85,keystone:INSERT=3 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:09:13.356896 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935f06f2-4de2-4588-926d-a83fecd84d38 admin admin] RBAC: Authorizing `identity:create_grant(project_id=59cad604d8e84ff183f446865f753191, user_id=987b99f839f149c98ca1a38ad504a2f9, role_id=0da46c267d354cce81495dfdd56c1ec2)` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:09:13.359914 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935f06f2-4de2-4588-926d-a83fecd84d38 admin admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:09:13.374015 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 1431/2873] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Jul 14 11:09:13 2022] PUT /identity/v3/projects/59cad604d8e84ff183f446865f753191/users/987b99f839f149c98ca1a38ad504a2f9/roles/0da46c267d354cce81495dfdd56c1ec2 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 11:09:13.384318 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c51706-7df9-42e7-928b-fcb8e4e96c43 None None] REQUEST_METHOD: `POST` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:09:13.384612 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c51706-7df9-42e7-928b-fcb8e4e96c43 None None] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:09:13.384936 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c51706-7df9-42e7-928b-fcb8e4e96c43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:09:13.410947 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.auth.core [None req-a7c51706-7df9-42e7-928b-fcb8e4e96c43 None None] MFA Rules not processed for user `987b99f839f149c98ca1a38ad504a2f9`. Rule list: `[]` (Enabled: `True`). {{(pid=86655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:09:13.412143 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-a7c51706-7df9-42e7-928b-fcb8e4e96c43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:09:13.477645 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 1443/2874] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jul 14 11:09:13 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:09:13.482272 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935f06f2-4de2-4588-926d-a83fecd84d38 admin admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:09:13.543825 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935f06f2-4de2-4588-926d-a83fecd84d38 admin admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:09:13.548350 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7915ba64-1436-426a-9f34-02ae06e226be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:09:13.549031 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7915ba64-1436-426a-9f34-02ae06e226be admin admin] REQUEST_METHOD: `POST` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:09:13.549319 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7915ba64-1436-426a-9f34-02ae06e226be admin admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:09:13.549592 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7915ba64-1436-426a-9f34-02ae06e226be admin admin] PATH_INFO: `/v3/projects` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:09:13.550378 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7915ba64-1436-426a-9f34-02ae06e226be admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:09:13.552264 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7915ba64-1436-426a-9f34-02ae06e226be admin admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:09:13.576544 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 1432/2875] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Jul 14 11:09:13 2022] POST /identity/v3/projects => generated 385 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 11:09:13.580572 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c51706-7df9-42e7-928b-fcb8e4e96c43 None None] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:09:13.591809 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c51706-7df9-42e7-928b-fcb8e4e96c43 None None] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:09:13.647306 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eddaf332-f8f1-46e3-bf55-76cfdee5877e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:09:13.647982 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddaf332-f8f1-46e3-bf55-76cfdee5877e admin admin] REQUEST_METHOD: `POST` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:09:13.648270 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddaf332-f8f1-46e3-bf55-76cfdee5877e admin admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:09:13.648551 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddaf332-f8f1-46e3-bf55-76cfdee5877e admin admin] PATH_INFO: `/v3/users` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:09:13.649274 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eddaf332-f8f1-46e3-bf55-76cfdee5877e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:09:13.651178 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eddaf332-f8f1-46e3-bf55-76cfdee5877e admin admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:09:13.670465 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 1444/2876] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Jul 14 11:09:13 2022] POST /identity/v3/users => generated 299 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 11:09:13.674413 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7915ba64-1436-426a-9f34-02ae06e226be admin admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:09:13.684453 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7915ba64-1436-426a-9f34-02ae06e226be admin admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:09:13.689042 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df177357-ea7c-448d-9d42-eb85d60faf85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:09:13.689694 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df177357-ea7c-448d-9d42-eb85d60faf85 admin admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:09:13.689977 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df177357-ea7c-448d-9d42-eb85d60faf85 admin admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:09:13.690255 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df177357-ea7c-448d-9d42-eb85d60faf85 admin admin] PATH_INFO: `/v3/roles` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:09:13.690993 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df177357-ea7c-448d-9d42-eb85d60faf85 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:09:13.692671 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df177357-ea7c-448d-9d42-eb85d60faf85 admin admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:09:13.703302 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 1433/2877] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jul 14 11:09:13 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 11:09:13.707854 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eddaf332-f8f1-46e3-bf55-76cfdee5877e admin admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:09:13.717751 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eddaf332-f8f1-46e3-bf55-76cfdee5877e admin admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:09:13.722941 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194aeb88-3c30-49c3-a3f3-a255bd7bcd09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:09:13.723812 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194aeb88-3c30-49c3-a3f3-a255bd7bcd09 admin admin] REQUEST_METHOD: `PUT` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:09:13.724102 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194aeb88-3c30-49c3-a3f3-a255bd7bcd09 admin admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:09:13.724413 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194aeb88-3c30-49c3-a3f3-a255bd7bcd09 admin admin] PATH_INFO: `/v3/projects/8b873428748545a39c29981a90d43907/users/a9619823f9ce4811be2864f4956c0f77/roles/153539819e5542df99269d2913bbecfb` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:09:13.739011 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194aeb88-3c30-49c3-a3f3-a255bd7bcd09 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8b873428748545a39c29981a90d43907, user_id=a9619823f9ce4811be2864f4956c0f77, role_id=153539819e5542df99269d2913bbecfb)` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:09:13.741717 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194aeb88-3c30-49c3-a3f3-a255bd7bcd09 admin admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:09:13.743932 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:09:13.754889 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 1445/2878] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Jul 14 11:09:13 2022] PUT /identity/v3/projects/8b873428748545a39c29981a90d43907/users/a9619823f9ce4811be2864f4956c0f77/roles/153539819e5542df99269d2913bbecfb => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:09:13.758974 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df177357-ea7c-448d-9d42-eb85d60faf85 admin admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:09:13.769407 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df177357-ea7c-448d-9d42-eb85d60faf85 admin admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:09:13.827452 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2c8730-b429-48aa-824b-3f1a7b6bb68c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:09:13.828044 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2c8730-b429-48aa-824b-3f1a7b6bb68c admin admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:09:13.828325 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2c8730-b429-48aa-824b-3f1a7b6bb68c admin admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:09:13.828600 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2c8730-b429-48aa-824b-3f1a7b6bb68c admin admin] PATH_INFO: `/v3/roles` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:09:13.829432 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2c8730-b429-48aa-824b-3f1a7b6bb68c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:09:13.831013 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2c8730-b429-48aa-824b-3f1a7b6bb68c admin admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:09:13.841293 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 1434/2879] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jul 14 11:09:13 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 11:09:13.845529 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194aeb88-3c30-49c3-a3f3-a255bd7bcd09 admin admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:09:13.855908 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194aeb88-3c30-49c3-a3f3-a255bd7bcd09 admin admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:09:13.860593 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891cce93-122d-4973-a514-049bada18304 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:09:13.861519 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891cce93-122d-4973-a514-049bada18304 admin admin] REQUEST_METHOD: `PUT` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:09:13.861809 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891cce93-122d-4973-a514-049bada18304 admin admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:09:13.862090 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891cce93-122d-4973-a514-049bada18304 admin admin] PATH_INFO: `/v3/projects/8b873428748545a39c29981a90d43907/users/a9619823f9ce4811be2864f4956c0f77/roles/153539819e5542df99269d2913bbecfb` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:09:13.864327 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891cce93-122d-4973-a514-049bada18304 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8b873428748545a39c29981a90d43907, user_id=a9619823f9ce4811be2864f4956c0f77, role_id=153539819e5542df99269d2913bbecfb)` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:09:13.866982 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891cce93-122d-4973-a514-049bada18304 admin admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:09:13.877147 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 1446/2880] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Jul 14 11:09:13 2022] PUT /identity/v3/projects/8b873428748545a39c29981a90d43907/users/a9619823f9ce4811be2864f4956c0f77/roles/153539819e5542df99269d2913bbecfb => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:09:13.888637 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb82a04b-8de6-4d89-8e21-36da13eb1550 None None] REQUEST_METHOD: `POST` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:09:13.889154 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb82a04b-8de6-4d89-8e21-36da13eb1550 None None] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:09:13.889386 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb82a04b-8de6-4d89-8e21-36da13eb1550 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:09:13.918190 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.auth.core [None req-cb82a04b-8de6-4d89-8e21-36da13eb1550 None None] MFA Rules not processed for user `a9619823f9ce4811be2864f4956c0f77`. Rule list: `[]` (Enabled: `True`). {{(pid=86656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:09:13.919401 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-cb82a04b-8de6-4d89-8e21-36da13eb1550 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:09:13.964713 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:09:13.987112 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 1435/2881] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jul 14 11:09:13 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:09:13.997861 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891cce93-122d-4973-a514-049bada18304 admin admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:09:13.999570 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-891cce93-122d-4973-a514-049bada18304 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:09:14.057441 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891cce93-122d-4973-a514-049bada18304 admin admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:09:14.061051 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1615fdeb-7b6a-4039-a773-da1997a0eb9e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68382432147a48c3b62271fd2a2eab04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59391272ecbe48b0aa736cb43807be1d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:09:14.061701 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1615fdeb-7b6a-4039-a773-da1997a0eb9e service cinder] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:09:14.061984 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1615fdeb-7b6a-4039-a773-da1997a0eb9e service cinder] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:09:14.062262 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1615fdeb-7b6a-4039-a773-da1997a0eb9e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:09:14.117451 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1615fdeb-7b6a-4039-a773-da1997a0eb9e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:09:14.118804 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1615fdeb-7b6a-4039-a773-da1997a0eb9e service cinder] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:09:14.127902 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 1447/2882] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jul 14 11:09:13 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 11:09:18.278522 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb82a04b-8de6-4d89-8e21-36da13eb1550 None None] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:09:18.279997 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-cb82a04b-8de6-4d89-8e21-36da13eb1550 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:09:18.292356 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb82a04b-8de6-4d89-8e21-36da13eb1550 None None] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:09:18.296192 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b28d8c-5620-4a37-87b8-4f9705d5e72b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68382432147a48c3b62271fd2a2eab04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59391272ecbe48b0aa736cb43807be1d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:09:18.296859 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b28d8c-5620-4a37-87b8-4f9705d5e72b service cinder] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:09:18.297143 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b28d8c-5620-4a37-87b8-4f9705d5e72b service cinder] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:09:18.297415 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b28d8c-5620-4a37-87b8-4f9705d5e72b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:09:18.306785 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b28d8c-5620-4a37-87b8-4f9705d5e72b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:09:18.308286 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b28d8c-5620-4a37-87b8-4f9705d5e72b service cinder] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:09:18.317975 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 1436/2883] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jul 14 11:09:18 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 11:09:23.168654 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1615fdeb-7b6a-4039-a773-da1997a0eb9e service cinder] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:09:23.230769 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1615fdeb-7b6a-4039-a773-da1997a0eb9e service cinder] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:09:23.235282 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f165588-5f64-4ba3-a9d0-a7969f4a1ea8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:09:23.236142 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f165588-5f64-4ba3-a9d0-a7969f4a1ea8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:09:23.236420 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f165588-5f64-4ba3-a9d0-a7969f4a1ea8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:09:23.236688 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f165588-5f64-4ba3-a9d0-a7969f4a1ea8 admin admin] PATH_INFO: `/v3/users/987b99f839f149c98ca1a38ad504a2f9` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:09:23.237892 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f165588-5f64-4ba3-a9d0-a7969f4a1ea8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=987b99f839f149c98ca1a38ad504a2f9)` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:09:23.240326 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f165588-5f64-4ba3-a9d0-a7969f4a1ea8 admin admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:09:23.277522 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:INSERT=2,keystone:SELECT=93,keystone:DELETE=5 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:09:23.286197 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-0f165588-5f64-4ba3-a9d0-a7969f4a1ea8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '987b99f839f149c98ca1a38ad504a2f9'} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:09:23.294042 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-0f165588-5f64-4ba3-a9d0-a7969f4a1ea8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '987b99f839f149c98ca1a38ad504a2f9'} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:09:23.294659 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-0f165588-5f64-4ba3-a9d0-a7969f4a1ea8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '987b99f839f149c98ca1a38ad504a2f9'} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:09:23.302049 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-0f165588-5f64-4ba3-a9d0-a7969f4a1ea8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '987b99f839f149c98ca1a38ad504a2f9'} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:09:23.302705 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-0f165588-5f64-4ba3-a9d0-a7969f4a1ea8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '987b99f839f149c98ca1a38ad504a2f9'} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:09:23.320155 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 1448/2884] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Jul 14 11:09:23 2022] DELETE /identity/v3/users/987b99f839f149c98ca1a38ad504a2f9 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:09:23.325026 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95389315-13c6-4a79-b536-3fcd1c7cfa75 None None] REQUEST_METHOD: `POST` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:09:23.325496 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95389315-13c6-4a79-b536-3fcd1c7cfa75 None None] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:09:23.325597 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95389315-13c6-4a79-b536-3fcd1c7cfa75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:09:23.343521 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.auth.core [None req-95389315-13c6-4a79-b536-3fcd1c7cfa75 None None] MFA Rules not processed for user `ae4bcdd8106d4bebbdcae96be33505bc`. Rule list: `[]` (Enabled: `True`). {{(pid=86656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:09:23.344729 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-95389315-13c6-4a79-b536-3fcd1c7cfa75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:09:23.403261 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 1437/2885] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jul 14 11:09:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:09:23.412924 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f165588-5f64-4ba3-a9d0-a7969f4a1ea8 admin admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:09:23.414326 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-0f165588-5f64-4ba3-a9d0-a7969f4a1ea8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:09:23.471099 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f165588-5f64-4ba3-a9d0-a7969f4a1ea8 admin admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:09:23.474897 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8420284a-5c9b-4395-99cb-50f295a97888 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dddf93691844886982c91fea974385d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59391272ecbe48b0aa736cb43807be1d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:09:23.475536 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8420284a-5c9b-4395-99cb-50f295a97888 service neutron] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:09:23.475821 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8420284a-5c9b-4395-99cb-50f295a97888 service neutron] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:09:23.476097 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8420284a-5c9b-4395-99cb-50f295a97888 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:09:23.484984 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8420284a-5c9b-4395-99cb-50f295a97888 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:09:23.486401 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8420284a-5c9b-4395-99cb-50f295a97888 service neutron] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:09:23.496403 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 1449/2886] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jul 14 11:09:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 11:09:23.762121 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95389315-13c6-4a79-b536-3fcd1c7cfa75 None None] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:09:23.763595 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-95389315-13c6-4a79-b536-3fcd1c7cfa75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:09:23.778865 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95389315-13c6-4a79-b536-3fcd1c7cfa75 None None] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:09:23.787966 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f4f235-4903-4595-8b8f-bde9eea1ac47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:09:23.788880 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f4f235-4903-4595-8b8f-bde9eea1ac47 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:09:23.789178 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f4f235-4903-4595-8b8f-bde9eea1ac47 admin admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:09:23.789511 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f4f235-4903-4595-8b8f-bde9eea1ac47 admin admin] PATH_INFO: `/v3/projects/59cad604d8e84ff183f446865f753191` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:09:23.790850 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f4f235-4903-4595-8b8f-bde9eea1ac47 admin admin] RBAC: Authorizing `identity:delete_project(project_id=59cad604d8e84ff183f446865f753191)` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:09:23.793117 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f4f235-4903-4595-8b8f-bde9eea1ac47 admin admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:09:23.841819 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-64f4f235-4903-4595-8b8f-bde9eea1ac47 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '59cad604d8e84ff183f446865f753191', 'request_id': 'req-64f4f235-4903-4595-8b8f-bde9eea1ac47'} {{(pid=86656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:09:23.850824 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-64f4f235-4903-4595-8b8f-bde9eea1ac47 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '59cad604d8e84ff183f446865f753191', 'request_id': 'req-64f4f235-4903-4595-8b8f-bde9eea1ac47'} {{(pid=86656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:09:23.857169 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-64f4f235-4903-4595-8b8f-bde9eea1ac47 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '59cad604d8e84ff183f446865f753191', 'request_id': 'req-64f4f235-4903-4595-8b8f-bde9eea1ac47'} {{(pid=86656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:09:23.868659 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-64f4f235-4903-4595-8b8f-bde9eea1ac47 admin admin] The token cache is being invalidate because project 59cad604d8e84ff183f446865f753191 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86656) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 11:09:23.868984 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-64f4f235-4903-4595-8b8f-bde9eea1ac47 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:09:23.869650 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-64f4f235-4903-4595-8b8f-bde9eea1ac47 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:09:23.871192 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 1438/2887] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Jul 14 11:09:23 2022] DELETE /identity/v3/projects/59cad604d8e84ff183f446865f753191 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:09:23.875129 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8420284a-5c9b-4395-99cb-50f295a97888 service neutron] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:09:23.884991 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8420284a-5c9b-4395-99cb-50f295a97888 service neutron] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:09:23.940630 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9d2a1e-87d0-4ece-a98c-ffdf5261800e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:09:23.941538 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9d2a1e-87d0-4ece-a98c-ffdf5261800e admin admin] REQUEST_METHOD: `DELETE` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:09:23.941828 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9d2a1e-87d0-4ece-a98c-ffdf5261800e admin admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:09:23.942146 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9d2a1e-87d0-4ece-a98c-ffdf5261800e admin admin] PATH_INFO: `/v3/users/a9619823f9ce4811be2864f4956c0f77` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:09:23.943409 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9d2a1e-87d0-4ece-a98c-ffdf5261800e admin admin] RBAC: Authorizing `identity:delete_user(user_id=a9619823f9ce4811be2864f4956c0f77)` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:09:23.945443 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9d2a1e-87d0-4ece-a98c-ffdf5261800e admin admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:09:23.992225 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-0d9d2a1e-87d0-4ece-a98c-ffdf5261800e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a9619823f9ce4811be2864f4956c0f77'} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:09:23.999518 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-0d9d2a1e-87d0-4ece-a98c-ffdf5261800e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a9619823f9ce4811be2864f4956c0f77'} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:09:24.000146 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-0d9d2a1e-87d0-4ece-a98c-ffdf5261800e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a9619823f9ce4811be2864f4956c0f77'} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:09:24.004659 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:09:24.007757 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-0d9d2a1e-87d0-4ece-a98c-ffdf5261800e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a9619823f9ce4811be2864f4956c0f77'} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:09:24.008474 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-0d9d2a1e-87d0-4ece-a98c-ffdf5261800e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a9619823f9ce4811be2864f4956c0f77'} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:09:24.028495 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 1450/2888] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Jul 14 11:09:23 2022] DELETE /identity/v3/users/a9619823f9ce4811be2864f4956c0f77 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:09:24.294336 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f4f235-4903-4595-8b8f-bde9eea1ac47 admin admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:09:24.295837 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-64f4f235-4903-4595-8b8f-bde9eea1ac47 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:09:24.309600 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f4f235-4903-4595-8b8f-bde9eea1ac47 admin admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:09:24.360565 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:09:24.368750 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8541bb-2810-4fc8-ab62-07c27a6485ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:09:24.369868 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8541bb-2810-4fc8-ab62-07c27a6485ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:09:24.370259 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8541bb-2810-4fc8-ab62-07c27a6485ad admin admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:09:24.370697 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8541bb-2810-4fc8-ab62-07c27a6485ad admin admin] PATH_INFO: `/v3/projects/8b873428748545a39c29981a90d43907` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:09:24.371985 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8541bb-2810-4fc8-ab62-07c27a6485ad admin admin] RBAC: Authorizing `identity:delete_project(project_id=8b873428748545a39c29981a90d43907)` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:09:24.373920 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8541bb-2810-4fc8-ab62-07c27a6485ad admin admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:09:24.419212 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-ba8541bb-2810-4fc8-ab62-07c27a6485ad admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8b873428748545a39c29981a90d43907', 'request_id': 'req-ba8541bb-2810-4fc8-ab62-07c27a6485ad'} {{(pid=86656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:09:24.426753 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-ba8541bb-2810-4fc8-ab62-07c27a6485ad admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8b873428748545a39c29981a90d43907', 'request_id': 'req-ba8541bb-2810-4fc8-ab62-07c27a6485ad'} {{(pid=86656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:09:24.433327 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-ba8541bb-2810-4fc8-ab62-07c27a6485ad admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8b873428748545a39c29981a90d43907', 'request_id': 'req-ba8541bb-2810-4fc8-ab62-07c27a6485ad'} {{(pid=86656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:09:24.443979 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-ba8541bb-2810-4fc8-ab62-07c27a6485ad admin admin] The token cache is being invalidate because project 8b873428748545a39c29981a90d43907 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86656) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 11:09:24.444265 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-ba8541bb-2810-4fc8-ab62-07c27a6485ad admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:09:24.444933 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-ba8541bb-2810-4fc8-ab62-07c27a6485ad admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:09:24.446467 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 1439/2889] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Jul 14 11:09:24 2022] DELETE /identity/v3/projects/8b873428748545a39c29981a90d43907 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:09:24.452527 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b04c290-8ac8-41e6-b030-1195d23caa31 None None] REQUEST_METHOD: `POST` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:09:24.453144 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b04c290-8ac8-41e6-b030-1195d23caa31 None None] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:09:24.453144 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b04c290-8ac8-41e6-b030-1195d23caa31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:09:24.471466 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.auth.core [None req-3b04c290-8ac8-41e6-b030-1195d23caa31 None None] MFA Rules not processed for user `ae4bcdd8106d4bebbdcae96be33505bc`. Rule list: `[]` (Enabled: `True`). {{(pid=86655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:09:24.472684 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-3b04c290-8ac8-41e6-b030-1195d23caa31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:09:24.530997 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 1451/2890] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jul 14 11:09:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:09:24.539342 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408f7115-d399-4120-8743-7c92aebd00ad None None] REQUEST_METHOD: `POST` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:09:24.539634 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408f7115-d399-4120-8743-7c92aebd00ad None None] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:09:24.539916 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408f7115-d399-4120-8743-7c92aebd00ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:09:24.557869 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.auth.core [None req-408f7115-d399-4120-8743-7c92aebd00ad None None] MFA Rules not processed for user `ae4bcdd8106d4bebbdcae96be33505bc`. Rule list: `[]` (Enabled: `True`). {{(pid=86656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:09:24.559066 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-408f7115-d399-4120-8743-7c92aebd00ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:09:24.566784 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 1440/2891] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jul 14 11:09:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:09:24.571437 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b04c290-8ac8-41e6-b030-1195d23caa31 None None] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:09:24.581621 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b04c290-8ac8-41e6-b030-1195d23caa31 None None] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:09:24.586888 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9d551a-285f-4faf-be9e-e5f4c5550700 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:09:24.587560 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9d551a-285f-4faf-be9e-e5f4c5550700 admin admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:09:24.588016 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9d551a-285f-4faf-be9e-e5f4c5550700 admin admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:09:24.588299 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9d551a-285f-4faf-be9e-e5f4c5550700 admin admin] PATH_INFO: `/v3/domains` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:09:24.589079 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9d551a-285f-4faf-be9e-e5f4c5550700 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:09:24.589392 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9d551a-285f-4faf-be9e-e5f4c5550700 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:09:24.591036 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9d551a-285f-4faf-be9e-e5f4c5550700 admin admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:09:24.604009 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 1452/2892] 10.222.0.16 () {58 vars in 1152 bytes} [Thu Jul 14 11:09:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:09:24.608409 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408f7115-d399-4120-8743-7c92aebd00ad None None] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:09:24.618495 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408f7115-d399-4120-8743-7c92aebd00ad None None] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:09:24.624222 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89766a65-5424-4355-95f0-0a0098f6d734 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:09:24.625202 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89766a65-5424-4355-95f0-0a0098f6d734 admin admin] REQUEST_METHOD: `POST` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:09:24.625202 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89766a65-5424-4355-95f0-0a0098f6d734 admin admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:09:24.625408 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89766a65-5424-4355-95f0-0a0098f6d734 admin admin] PATH_INFO: `/v3/projects` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:09:24.626078 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89766a65-5424-4355-95f0-0a0098f6d734 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:09:24.627979 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89766a65-5424-4355-95f0-0a0098f6d734 admin admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:09:24.655750 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 1441/2893] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Jul 14 11:09:24 2022] POST /identity/v3/projects => generated 383 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 11:09:24.659753 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9d551a-285f-4faf-be9e-e5f4c5550700 admin admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:09:24.671504 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9d551a-285f-4faf-be9e-e5f4c5550700 admin admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:09:24.729265 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a910ebdc-af86-4d2b-b549-24008711132c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:09:24.729940 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a910ebdc-af86-4d2b-b549-24008711132c admin admin] REQUEST_METHOD: `POST` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:09:24.730231 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a910ebdc-af86-4d2b-b549-24008711132c admin admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:09:24.730516 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a910ebdc-af86-4d2b-b549-24008711132c admin admin] PATH_INFO: `/v3/users` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:09:24.731222 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a910ebdc-af86-4d2b-b549-24008711132c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:09:24.733182 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a910ebdc-af86-4d2b-b549-24008711132c admin admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:09:24.753107 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 1453/2894] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Jul 14 11:09:24 2022] POST /identity/v3/users => generated 292 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 11:09:24.757187 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89766a65-5424-4355-95f0-0a0098f6d734 admin admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:09:24.767410 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89766a65-5424-4355-95f0-0a0098f6d734 admin admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:09:24.772558 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2cdf174-a88e-44eb-925a-47dd9223269f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:09:24.773256 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cdf174-a88e-44eb-925a-47dd9223269f admin admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:09:24.773542 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cdf174-a88e-44eb-925a-47dd9223269f admin admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:09:24.773822 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cdf174-a88e-44eb-925a-47dd9223269f admin admin] PATH_INFO: `/v3/roles` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:09:24.774550 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2cdf174-a88e-44eb-925a-47dd9223269f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:09:24.776143 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2cdf174-a88e-44eb-925a-47dd9223269f admin admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:09:24.787472 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 1442/2895] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jul 14 11:09:24 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 11:09:24.791412 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a910ebdc-af86-4d2b-b549-24008711132c admin admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:09:24.801475 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a910ebdc-af86-4d2b-b549-24008711132c admin admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:09:24.806028 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8063d44-09bf-4e0a-90ed-6d224af22c31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:09:24.806688 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8063d44-09bf-4e0a-90ed-6d224af22c31 admin admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:09:24.806972 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8063d44-09bf-4e0a-90ed-6d224af22c31 admin admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:09:24.807253 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8063d44-09bf-4e0a-90ed-6d224af22c31 admin admin] PATH_INFO: `/v3/roles` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:09:24.807983 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8063d44-09bf-4e0a-90ed-6d224af22c31 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:09:24.809601 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8063d44-09bf-4e0a-90ed-6d224af22c31 admin admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:09:24.819954 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 1454/2896] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jul 14 11:09:24 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 11:09:24.824211 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2cdf174-a88e-44eb-925a-47dd9223269f admin admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:09:24.835615 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2cdf174-a88e-44eb-925a-47dd9223269f admin admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:09:24.840177 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d089d4dc-2a17-447f-8c00-a13f7cc65a3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:09:24.841101 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d089d4dc-2a17-447f-8c00-a13f7cc65a3b admin admin] REQUEST_METHOD: `PUT` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:09:24.841388 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d089d4dc-2a17-447f-8c00-a13f7cc65a3b admin admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:09:24.841669 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d089d4dc-2a17-447f-8c00-a13f7cc65a3b admin admin] PATH_INFO: `/v3/projects/664f1b38aa4a4b42bf944bb46f92280f/users/24c3e35d2b8f44b191ee643a361cc096/roles/0da46c267d354cce81495dfdd56c1ec2` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:09:24.857508 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d089d4dc-2a17-447f-8c00-a13f7cc65a3b admin admin] RBAC: Authorizing `identity:create_grant(project_id=664f1b38aa4a4b42bf944bb46f92280f, user_id=24c3e35d2b8f44b191ee643a361cc096, role_id=0da46c267d354cce81495dfdd56c1ec2)` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:09:24.860153 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d089d4dc-2a17-447f-8c00-a13f7cc65a3b admin admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:09:24.872824 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 1443/2897] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Jul 14 11:09:24 2022] PUT /identity/v3/projects/664f1b38aa4a4b42bf944bb46f92280f/users/24c3e35d2b8f44b191ee643a361cc096/roles/0da46c267d354cce81495dfdd56c1ec2 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:09:24.884208 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04925e7b-ce88-45ff-bde6-cebffc1fb28b None None] REQUEST_METHOD: `POST` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:09:24.884444 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04925e7b-ce88-45ff-bde6-cebffc1fb28b None None] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:09:24.884731 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04925e7b-ce88-45ff-bde6-cebffc1fb28b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:09:24.912646 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.auth.core [None req-04925e7b-ce88-45ff-bde6-cebffc1fb28b None None] MFA Rules not processed for user `24c3e35d2b8f44b191ee643a361cc096`. Rule list: `[]` (Enabled: `True`). {{(pid=86655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:09:24.913906 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-04925e7b-ce88-45ff-bde6-cebffc1fb28b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:09:24.951004 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:09:24.988665 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 1455/2898] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jul 14 11:09:24 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 11:09:24.993167 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d089d4dc-2a17-447f-8c00-a13f7cc65a3b admin admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:09:25.053948 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d089d4dc-2a17-447f-8c00-a13f7cc65a3b admin admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:09:25.058576 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3297208a-d905-49ba-aa77-d34ea0690681 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:09:25.059237 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3297208a-d905-49ba-aa77-d34ea0690681 admin admin] REQUEST_METHOD: `POST` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:09:25.059522 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3297208a-d905-49ba-aa77-d34ea0690681 admin admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:09:25.059800 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3297208a-d905-49ba-aa77-d34ea0690681 admin admin] PATH_INFO: `/v3/projects` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:09:25.060499 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3297208a-d905-49ba-aa77-d34ea0690681 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:09:25.062434 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3297208a-d905-49ba-aa77-d34ea0690681 admin admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:09:25.088613 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 1444/2899] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Jul 14 11:09:24 2022] POST /identity/v3/projects => generated 383 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 11:09:25.092299 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04925e7b-ce88-45ff-bde6-cebffc1fb28b None None] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:09:25.103116 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04925e7b-ce88-45ff-bde6-cebffc1fb28b None None] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:09:25.158448 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e114396-08c6-48b3-b04b-16df810a4a9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:09:25.159032 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e114396-08c6-48b3-b04b-16df810a4a9d admin admin] REQUEST_METHOD: `POST` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:09:25.159316 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e114396-08c6-48b3-b04b-16df810a4a9d admin admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:09:25.159596 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e114396-08c6-48b3-b04b-16df810a4a9d admin admin] PATH_INFO: `/v3/users` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:09:25.160296 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e114396-08c6-48b3-b04b-16df810a4a9d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:09:25.162305 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e114396-08c6-48b3-b04b-16df810a4a9d admin admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:09:25.184342 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 1456/2900] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Jul 14 11:09:25 2022] POST /identity/v3/users => generated 292 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 11:09:25.185794 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3297208a-d905-49ba-aa77-d34ea0690681 admin admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:09:25.196458 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3297208a-d905-49ba-aa77-d34ea0690681 admin admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:09:25.201270 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c7d99c-9c34-4626-9296-b94f36aaa678 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:09:25.201926 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c7d99c-9c34-4626-9296-b94f36aaa678 admin admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:09:25.202210 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c7d99c-9c34-4626-9296-b94f36aaa678 admin admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:09:25.202489 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c7d99c-9c34-4626-9296-b94f36aaa678 admin admin] PATH_INFO: `/v3/roles` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:09:25.203218 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c7d99c-9c34-4626-9296-b94f36aaa678 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:09:25.204835 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c7d99c-9c34-4626-9296-b94f36aaa678 admin admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:09:25.206068 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:09:25.217697 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 1445/2901] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jul 14 11:09:25 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 11:09:25.221144 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e114396-08c6-48b3-b04b-16df810a4a9d admin admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:09:25.231684 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e114396-08c6-48b3-b04b-16df810a4a9d admin admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:09:25.236233 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178dd918-8d5c-48be-b08e-211ef596153f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:09:25.236931 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178dd918-8d5c-48be-b08e-211ef596153f admin admin] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:09:25.237218 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178dd918-8d5c-48be-b08e-211ef596153f admin admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:09:25.237498 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178dd918-8d5c-48be-b08e-211ef596153f admin admin] PATH_INFO: `/v3/roles` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:09:25.238233 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178dd918-8d5c-48be-b08e-211ef596153f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:09:25.239893 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178dd918-8d5c-48be-b08e-211ef596153f admin admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:09:25.252359 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 1457/2902] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jul 14 11:09:25 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 11:09:25.257037 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c7d99c-9c34-4626-9296-b94f36aaa678 admin admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:09:25.267547 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c7d99c-9c34-4626-9296-b94f36aaa678 admin admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:09:25.273226 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f720d8-c8a4-458c-a85c-3e3b857c5483 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:09:25.274121 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f720d8-c8a4-458c-a85c-3e3b857c5483 admin admin] REQUEST_METHOD: `PUT` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:09:25.274409 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f720d8-c8a4-458c-a85c-3e3b857c5483 admin admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:09:25.274729 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f720d8-c8a4-458c-a85c-3e3b857c5483 admin admin] PATH_INFO: `/v3/projects/c60ee014124b43a9b016b79f08cc8f3f/users/423a51291cdb4ae5b2047b7b511f4791/roles/0da46c267d354cce81495dfdd56c1ec2` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:09:25.289551 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f720d8-c8a4-458c-a85c-3e3b857c5483 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c60ee014124b43a9b016b79f08cc8f3f, user_id=423a51291cdb4ae5b2047b7b511f4791, role_id=0da46c267d354cce81495dfdd56c1ec2)` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:09:25.292223 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f720d8-c8a4-458c-a85c-3e3b857c5483 admin admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:09:25.305993 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 1446/2903] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Jul 14 11:09:25 2022] PUT /identity/v3/projects/c60ee014124b43a9b016b79f08cc8f3f/users/423a51291cdb4ae5b2047b7b511f4791/roles/0da46c267d354cce81495dfdd56c1ec2 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:09:25.316922 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a4cefd-e0d8-444f-8822-4fa95e4c2182 None None] REQUEST_METHOD: `POST` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:09:25.317741 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a4cefd-e0d8-444f-8822-4fa95e4c2182 None None] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:09:25.318026 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a4cefd-e0d8-444f-8822-4fa95e4c2182 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:09:25.344611 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.auth.core [None req-c7a4cefd-e0d8-444f-8822-4fa95e4c2182 None None] MFA Rules not processed for user `423a51291cdb4ae5b2047b7b511f4791`. Rule list: `[]` (Enabled: `True`). {{(pid=86655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:09:25.345846 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-c7a4cefd-e0d8-444f-8822-4fa95e4c2182 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:09:25.410258 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 1458/2904] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jul 14 11:09:25 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:09:25.414727 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f720d8-c8a4-458c-a85c-3e3b857c5483 admin admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:09:25.476172 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f720d8-c8a4-458c-a85c-3e3b857c5483 admin admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:09:25.480796 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c0a1fe-0b21-43e9-90b7-a31254385cc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:09:25.481458 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c0a1fe-0b21-43e9-90b7-a31254385cc5 admin admin] REQUEST_METHOD: `POST` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:09:25.481746 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c0a1fe-0b21-43e9-90b7-a31254385cc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:09:25.482025 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c0a1fe-0b21-43e9-90b7-a31254385cc5 admin admin] PATH_INFO: `/v3/projects` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:09:25.482714 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c0a1fe-0b21-43e9-90b7-a31254385cc5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:09:25.484606 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c0a1fe-0b21-43e9-90b7-a31254385cc5 admin admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:09:25.510943 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 1447/2905] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Jul 14 11:09:25 2022] POST /identity/v3/projects => generated 383 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 11:09:25.515154 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a4cefd-e0d8-444f-8822-4fa95e4c2182 None None] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:09:25.526514 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a4cefd-e0d8-444f-8822-4fa95e4c2182 None None] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:09:25.565652 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:09:25.588696 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978f22cd-5e42-4606-9d23-2874d7236785 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:09:25.589417 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978f22cd-5e42-4606-9d23-2874d7236785 admin admin] REQUEST_METHOD: `POST` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:09:25.589703 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978f22cd-5e42-4606-9d23-2874d7236785 admin admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:09:25.589985 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978f22cd-5e42-4606-9d23-2874d7236785 admin admin] PATH_INFO: `/v3/users` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:09:25.590692 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978f22cd-5e42-4606-9d23-2874d7236785 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:09:25.592626 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978f22cd-5e42-4606-9d23-2874d7236785 admin admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:09:25.612338 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 1459/2906] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Jul 14 11:09:25 2022] POST /identity/v3/users => generated 298 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 11:09:25.616966 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c0a1fe-0b21-43e9-90b7-a31254385cc5 admin admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:09:25.627212 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c0a1fe-0b21-43e9-90b7-a31254385cc5 admin admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:09:25.632435 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d8cac6-9a8b-4752-93e4-36ae947f6a67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:09:25.633127 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d8cac6-9a8b-4752-93e4-36ae947f6a67 admin admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:09:25.633416 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d8cac6-9a8b-4752-93e4-36ae947f6a67 admin admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:09:25.633726 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d8cac6-9a8b-4752-93e4-36ae947f6a67 admin admin] PATH_INFO: `/v3/roles` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:09:25.634501 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d8cac6-9a8b-4752-93e4-36ae947f6a67 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:09:25.636101 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d8cac6-9a8b-4752-93e4-36ae947f6a67 admin admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:09:25.649325 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 1448/2907] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jul 14 11:09:25 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 11:09:25.653325 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978f22cd-5e42-4606-9d23-2874d7236785 admin admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:09:25.663473 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978f22cd-5e42-4606-9d23-2874d7236785 admin admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:09:25.668114 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11764312-0f0e-431c-8f0f-e83c87c1fc9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:09:25.669070 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11764312-0f0e-431c-8f0f-e83c87c1fc9d admin admin] REQUEST_METHOD: `PUT` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:09:25.669357 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11764312-0f0e-431c-8f0f-e83c87c1fc9d admin admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:09:25.669635 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11764312-0f0e-431c-8f0f-e83c87c1fc9d admin admin] PATH_INFO: `/v3/projects/3f3213eb535b4208babd98867255cccb/users/c0608246014243ba9a979212d11389d6/roles/153539819e5542df99269d2913bbecfb` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:09:25.685229 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11764312-0f0e-431c-8f0f-e83c87c1fc9d admin admin] RBAC: Authorizing `identity:create_grant(project_id=3f3213eb535b4208babd98867255cccb, user_id=c0608246014243ba9a979212d11389d6, role_id=153539819e5542df99269d2913bbecfb)` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:09:25.687893 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11764312-0f0e-431c-8f0f-e83c87c1fc9d admin admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:09:25.701316 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 1460/2908] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Jul 14 11:09:25 2022] PUT /identity/v3/projects/3f3213eb535b4208babd98867255cccb/users/c0608246014243ba9a979212d11389d6/roles/153539819e5542df99269d2913bbecfb => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:09:25.705104 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d8cac6-9a8b-4752-93e4-36ae947f6a67 admin admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:09:25.715101 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d8cac6-9a8b-4752-93e4-36ae947f6a67 admin admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:09:25.769657 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83b65a1-3e38-4746-ae5f-5d9ce9166a1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:09:25.770460 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83b65a1-3e38-4746-ae5f-5d9ce9166a1d admin admin] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:09:25.770816 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83b65a1-3e38-4746-ae5f-5d9ce9166a1d admin admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:09:25.771027 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83b65a1-3e38-4746-ae5f-5d9ce9166a1d admin admin] PATH_INFO: `/v3/roles` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:09:25.771749 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83b65a1-3e38-4746-ae5f-5d9ce9166a1d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:09:25.773683 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83b65a1-3e38-4746-ae5f-5d9ce9166a1d admin admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:09:25.786278 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 1449/2909] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jul 14 11:09:25 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 11:09:25.790657 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11764312-0f0e-431c-8f0f-e83c87c1fc9d admin admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:09:25.801173 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11764312-0f0e-431c-8f0f-e83c87c1fc9d admin admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:09:25.806452 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de154e1-a757-4a4a-95c3-6f88d31aaab4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:09:25.807355 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de154e1-a757-4a4a-95c3-6f88d31aaab4 admin admin] REQUEST_METHOD: `PUT` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:09:25.807633 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de154e1-a757-4a4a-95c3-6f88d31aaab4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:09:25.807913 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de154e1-a757-4a4a-95c3-6f88d31aaab4 admin admin] PATH_INFO: `/v3/projects/3f3213eb535b4208babd98867255cccb/users/c0608246014243ba9a979212d11389d6/roles/153539819e5542df99269d2913bbecfb` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:09:25.809951 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de154e1-a757-4a4a-95c3-6f88d31aaab4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3f3213eb535b4208babd98867255cccb, user_id=c0608246014243ba9a979212d11389d6, role_id=153539819e5542df99269d2913bbecfb)` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:09:25.812584 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de154e1-a757-4a4a-95c3-6f88d31aaab4 admin admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:09:25.822842 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 1461/2910] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Jul 14 11:09:25 2022] PUT /identity/v3/projects/3f3213eb535b4208babd98867255cccb/users/c0608246014243ba9a979212d11389d6/roles/153539819e5542df99269d2913bbecfb => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:09:25.833164 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d107448d-8349-46aa-a624-86c638adcaca None None] REQUEST_METHOD: `POST` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:09:25.833466 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d107448d-8349-46aa-a624-86c638adcaca None None] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:09:25.833751 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d107448d-8349-46aa-a624-86c638adcaca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:09:25.859715 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.auth.core [None req-d107448d-8349-46aa-a624-86c638adcaca None None] MFA Rules not processed for user `c0608246014243ba9a979212d11389d6`. Rule list: `[]` (Enabled: `True`). {{(pid=86656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:09:25.860969 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-d107448d-8349-46aa-a624-86c638adcaca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:09:25.891130 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:09:25.931377 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 1450/2911] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jul 14 11:09:25 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 11:09:25.942933 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de154e1-a757-4a4a-95c3-6f88d31aaab4 admin admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:09:25.944690 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-4de154e1-a757-4a4a-95c3-6f88d31aaab4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:09:26.001420 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de154e1-a757-4a4a-95c3-6f88d31aaab4 admin admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:09:26.005085 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016a9d7e-c5d5-4e8b-8fa9-9623310fee48 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68382432147a48c3b62271fd2a2eab04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59391272ecbe48b0aa736cb43807be1d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:09:26.005721 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016a9d7e-c5d5-4e8b-8fa9-9623310fee48 service cinder] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:09:26.006004 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016a9d7e-c5d5-4e8b-8fa9-9623310fee48 service cinder] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:09:26.006280 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016a9d7e-c5d5-4e8b-8fa9-9623310fee48 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:09:26.061464 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016a9d7e-c5d5-4e8b-8fa9-9623310fee48 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:09:26.062888 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016a9d7e-c5d5-4e8b-8fa9-9623310fee48 service cinder] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:09:26.072115 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 1462/2912] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jul 14 11:09:25 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 11:09:27.542761 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d107448d-8349-46aa-a624-86c638adcaca None None] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:09:27.544186 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-d107448d-8349-46aa-a624-86c638adcaca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:09:27.556405 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d107448d-8349-46aa-a624-86c638adcaca None None] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:09:27.559940 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d21df6-eae6-4285-9c1e-6accc74749bc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68382432147a48c3b62271fd2a2eab04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59391272ecbe48b0aa736cb43807be1d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:09:27.560581 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d21df6-eae6-4285-9c1e-6accc74749bc service cinder] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:09:27.560904 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d21df6-eae6-4285-9c1e-6accc74749bc service cinder] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:09:27.561188 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d21df6-eae6-4285-9c1e-6accc74749bc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:09:27.617729 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d21df6-eae6-4285-9c1e-6accc74749bc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:09:27.619084 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d21df6-eae6-4285-9c1e-6accc74749bc service cinder] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:09:27.627869 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 1451/2913] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jul 14 11:09:27 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 11:09:28.123984 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016a9d7e-c5d5-4e8b-8fa9-9623310fee48 service cinder] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:09:28.133250 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016a9d7e-c5d5-4e8b-8fa9-9623310fee48 service cinder] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:09:28.137359 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb85aaa-735f-4009-8015-49d9c9042c66 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68382432147a48c3b62271fd2a2eab04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59391272ecbe48b0aa736cb43807be1d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:09:28.137944 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb85aaa-735f-4009-8015-49d9c9042c66 service cinder] REQUEST_METHOD: `GET` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:09:28.138229 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb85aaa-735f-4009-8015-49d9c9042c66 service cinder] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:09:28.138506 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb85aaa-735f-4009-8015-49d9c9042c66 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:09:28.148107 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb85aaa-735f-4009-8015-49d9c9042c66 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:09:28.149568 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb85aaa-735f-4009-8015-49d9c9042c66 service cinder] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:09:28.158920 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 1463/2914] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jul 14 11:09:28 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 11:09:31.998629 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d21df6-eae6-4285-9c1e-6accc74749bc service cinder] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:09:32.059976 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d21df6-eae6-4285-9c1e-6accc74749bc service cinder] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:09:32.064394 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b13743-764a-48f4-adf3-94c78d8032aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:09:32.065299 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b13743-764a-48f4-adf3-94c78d8032aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:09:32.065581 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b13743-764a-48f4-adf3-94c78d8032aa admin admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:09:32.065854 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b13743-764a-48f4-adf3-94c78d8032aa admin admin] PATH_INFO: `/v3/users/24c3e35d2b8f44b191ee643a361cc096` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:09:32.067028 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b13743-764a-48f4-adf3-94c78d8032aa admin admin] RBAC: Authorizing `identity:delete_user(user_id=24c3e35d2b8f44b191ee643a361cc096)` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:09:32.069715 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b13743-764a-48f4-adf3-94c78d8032aa admin admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:09:32.117038 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-72b13743-764a-48f4-adf3-94c78d8032aa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '24c3e35d2b8f44b191ee643a361cc096'} {{(pid=86656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:09:32.124033 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-72b13743-764a-48f4-adf3-94c78d8032aa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '24c3e35d2b8f44b191ee643a361cc096'} {{(pid=86656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:09:32.124661 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-72b13743-764a-48f4-adf3-94c78d8032aa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '24c3e35d2b8f44b191ee643a361cc096'} {{(pid=86656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:09:32.133401 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-72b13743-764a-48f4-adf3-94c78d8032aa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '24c3e35d2b8f44b191ee643a361cc096'} {{(pid=86656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:09:32.134065 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-72b13743-764a-48f4-adf3-94c78d8032aa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '24c3e35d2b8f44b191ee643a361cc096'} {{(pid=86656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:09:32.138526 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:09:32.154499 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 1452/2915] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Jul 14 11:09:31 2022] DELETE /identity/v3/users/24c3e35d2b8f44b191ee643a361cc096 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 11:09:32.158964 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb812a9d-87e8-42f4-a314-6e046d6e3f79 None None] REQUEST_METHOD: `POST` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:09:32.159445 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb812a9d-87e8-42f4-a314-6e046d6e3f79 None None] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:09:32.159593 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb812a9d-87e8-42f4-a314-6e046d6e3f79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:09:32.176948 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.auth.core [None req-fb812a9d-87e8-42f4-a314-6e046d6e3f79 None None] MFA Rules not processed for user `ae4bcdd8106d4bebbdcae96be33505bc`. Rule list: `[]` (Enabled: `True`). {{(pid=86655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:09:32.179418 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-fb812a9d-87e8-42f4-a314-6e046d6e3f79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:09:32.209971 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:09:32.241784 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 1464/2916] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jul 14 11:09:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:09:32.251401 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b13743-764a-48f4-adf3-94c78d8032aa admin admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:09:32.252841 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-72b13743-764a-48f4-adf3-94c78d8032aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:09:32.309157 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b13743-764a-48f4-adf3-94c78d8032aa admin admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:09:32.312843 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a08ee8-ac51-4a7a-9197-a7eeb9fc5559 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4dddf93691844886982c91fea974385d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59391272ecbe48b0aa736cb43807be1d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:09:32.313429 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a08ee8-ac51-4a7a-9197-a7eeb9fc5559 service neutron] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:09:32.313719 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a08ee8-ac51-4a7a-9197-a7eeb9fc5559 service neutron] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:09:32.313990 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a08ee8-ac51-4a7a-9197-a7eeb9fc5559 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:09:32.323596 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a08ee8-ac51-4a7a-9197-a7eeb9fc5559 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:09:32.325314 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a08ee8-ac51-4a7a-9197-a7eeb9fc5559 service neutron] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:09:32.334666 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 1453/2917] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jul 14 11:09:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 11:09:32.604401 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb812a9d-87e8-42f4-a314-6e046d6e3f79 None None] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:09:32.605854 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-fb812a9d-87e8-42f4-a314-6e046d6e3f79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:09:32.621936 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb812a9d-87e8-42f4-a314-6e046d6e3f79 None None] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:09:32.626811 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05dd464e-6be4-41ad-b46b-c156a309c76e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:09:32.627689 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05dd464e-6be4-41ad-b46b-c156a309c76e admin admin] REQUEST_METHOD: `DELETE` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:09:32.627973 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05dd464e-6be4-41ad-b46b-c156a309c76e admin admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:09:32.628247 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05dd464e-6be4-41ad-b46b-c156a309c76e admin admin] PATH_INFO: `/v3/projects/664f1b38aa4a4b42bf944bb46f92280f` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:09:32.629626 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05dd464e-6be4-41ad-b46b-c156a309c76e admin admin] RBAC: Authorizing `identity:delete_project(project_id=664f1b38aa4a4b42bf944bb46f92280f)` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:09:32.632026 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05dd464e-6be4-41ad-b46b-c156a309c76e admin admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:09:32.679705 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-05dd464e-6be4-41ad-b46b-c156a309c76e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '664f1b38aa4a4b42bf944bb46f92280f', 'request_id': 'req-05dd464e-6be4-41ad-b46b-c156a309c76e'} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:09:32.685209 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-05dd464e-6be4-41ad-b46b-c156a309c76e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '664f1b38aa4a4b42bf944bb46f92280f', 'request_id': 'req-05dd464e-6be4-41ad-b46b-c156a309c76e'} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:09:32.692535 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-05dd464e-6be4-41ad-b46b-c156a309c76e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '664f1b38aa4a4b42bf944bb46f92280f', 'request_id': 'req-05dd464e-6be4-41ad-b46b-c156a309c76e'} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:09:32.704277 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-05dd464e-6be4-41ad-b46b-c156a309c76e admin admin] The token cache is being invalidate because project 664f1b38aa4a4b42bf944bb46f92280f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86655) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 11:09:32.704569 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-05dd464e-6be4-41ad-b46b-c156a309c76e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:09:32.705235 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-05dd464e-6be4-41ad-b46b-c156a309c76e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:09:32.706783 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 1465/2918] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Jul 14 11:09:32 2022] DELETE /identity/v3/projects/664f1b38aa4a4b42bf944bb46f92280f => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:09:32.711716 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a08ee8-ac51-4a7a-9197-a7eeb9fc5559 service neutron] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:09:32.722780 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a08ee8-ac51-4a7a-9197-a7eeb9fc5559 service neutron] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:09:32.778187 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b177e51-4980-49e8-a7ad-0bf3dcff21bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:09:32.779067 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b177e51-4980-49e8-a7ad-0bf3dcff21bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:09:32.779349 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b177e51-4980-49e8-a7ad-0bf3dcff21bf admin admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:09:32.779652 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b177e51-4980-49e8-a7ad-0bf3dcff21bf admin admin] PATH_INFO: `/v3/users/423a51291cdb4ae5b2047b7b511f4791` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:09:32.780875 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b177e51-4980-49e8-a7ad-0bf3dcff21bf admin admin] RBAC: Authorizing `identity:delete_user(user_id=423a51291cdb4ae5b2047b7b511f4791)` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:09:32.782793 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b177e51-4980-49e8-a7ad-0bf3dcff21bf admin admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:09:32.828376 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-9b177e51-4980-49e8-a7ad-0bf3dcff21bf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '423a51291cdb4ae5b2047b7b511f4791'} {{(pid=86656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:09:32.836263 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-9b177e51-4980-49e8-a7ad-0bf3dcff21bf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '423a51291cdb4ae5b2047b7b511f4791'} {{(pid=86656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:09:32.837090 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-9b177e51-4980-49e8-a7ad-0bf3dcff21bf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '423a51291cdb4ae5b2047b7b511f4791'} {{(pid=86656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:09:32.844760 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-9b177e51-4980-49e8-a7ad-0bf3dcff21bf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '423a51291cdb4ae5b2047b7b511f4791'} {{(pid=86656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:09:32.845508 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-9b177e51-4980-49e8-a7ad-0bf3dcff21bf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '423a51291cdb4ae5b2047b7b511f4791'} {{(pid=86656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:09:32.863620 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 1454/2919] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Jul 14 11:09:32 2022] DELETE /identity/v3/users/423a51291cdb4ae5b2047b7b511f4791 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:09:33.131960 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05dd464e-6be4-41ad-b46b-c156a309c76e admin admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:09:33.133598 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-05dd464e-6be4-41ad-b46b-c156a309c76e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:09:33.148756 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05dd464e-6be4-41ad-b46b-c156a309c76e admin admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:09:33.205486 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f170377-fda0-4fd5-b8bd-40907844ba0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:09:33.206350 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f170377-fda0-4fd5-b8bd-40907844ba0e admin admin] REQUEST_METHOD: `DELETE` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:09:33.206634 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f170377-fda0-4fd5-b8bd-40907844ba0e admin admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:09:33.206915 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f170377-fda0-4fd5-b8bd-40907844ba0e admin admin] PATH_INFO: `/v3/projects/c60ee014124b43a9b016b79f08cc8f3f` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:09:33.208089 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f170377-fda0-4fd5-b8bd-40907844ba0e admin admin] RBAC: Authorizing `identity:delete_project(project_id=c60ee014124b43a9b016b79f08cc8f3f)` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:09:33.210031 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f170377-fda0-4fd5-b8bd-40907844ba0e admin admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:09:33.260300 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-6f170377-fda0-4fd5-b8bd-40907844ba0e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c60ee014124b43a9b016b79f08cc8f3f', 'request_id': 'req-6f170377-fda0-4fd5-b8bd-40907844ba0e'} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:09:33.265706 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-6f170377-fda0-4fd5-b8bd-40907844ba0e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c60ee014124b43a9b016b79f08cc8f3f', 'request_id': 'req-6f170377-fda0-4fd5-b8bd-40907844ba0e'} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:09:33.267328 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:09:33.274103 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-6f170377-fda0-4fd5-b8bd-40907844ba0e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c60ee014124b43a9b016b79f08cc8f3f', 'request_id': 'req-6f170377-fda0-4fd5-b8bd-40907844ba0e'} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:09:33.287181 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-6f170377-fda0-4fd5-b8bd-40907844ba0e admin admin] The token cache is being invalidate because project c60ee014124b43a9b016b79f08cc8f3f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86655) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 11:09:33.287629 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-6f170377-fda0-4fd5-b8bd-40907844ba0e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:09:33.288296 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-6f170377-fda0-4fd5-b8bd-40907844ba0e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:09:33.290087 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 1466/2920] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Jul 14 11:09:33 2022] DELETE /identity/v3/projects/c60ee014124b43a9b016b79f08cc8f3f => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:09:33.293819 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b177e51-4980-49e8-a7ad-0bf3dcff21bf admin admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:09:33.295224 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-9b177e51-4980-49e8-a7ad-0bf3dcff21bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:09:33.308420 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b177e51-4980-49e8-a7ad-0bf3dcff21bf admin admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:09:33.311881 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:DELETE=12,keystone:SELECT=87,keystone:INSERT=1 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:09:33.366721 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d965499f-622b-4524-8d7c-239c20a8a13e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:09:33.367600 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d965499f-622b-4524-8d7c-239c20a8a13e admin admin] REQUEST_METHOD: `DELETE` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:09:33.367885 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d965499f-622b-4524-8d7c-239c20a8a13e admin admin] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:09:33.368160 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d965499f-622b-4524-8d7c-239c20a8a13e admin admin] PATH_INFO: `/v3/users/c0608246014243ba9a979212d11389d6` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:09:33.369368 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d965499f-622b-4524-8d7c-239c20a8a13e admin admin] RBAC: Authorizing `identity:delete_user(user_id=c0608246014243ba9a979212d11389d6)` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:09:33.371295 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d965499f-622b-4524-8d7c-239c20a8a13e admin admin] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:09:33.415422 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-d965499f-622b-4524-8d7c-239c20a8a13e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c0608246014243ba9a979212d11389d6'} {{(pid=86656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:09:33.422399 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-d965499f-622b-4524-8d7c-239c20a8a13e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c0608246014243ba9a979212d11389d6'} {{(pid=86656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:09:33.423026 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-d965499f-622b-4524-8d7c-239c20a8a13e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c0608246014243ba9a979212d11389d6'} {{(pid=86656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:09:33.430491 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-d965499f-622b-4524-8d7c-239c20a8a13e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c0608246014243ba9a979212d11389d6'} {{(pid=86656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:09:33.431142 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.notifications [None req-d965499f-622b-4524-8d7c-239c20a8a13e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c0608246014243ba9a979212d11389d6'} {{(pid=86656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:09:33.447973 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 1455/2921] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Jul 14 11:09:33 2022] DELETE /identity/v3/users/c0608246014243ba9a979212d11389d6 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:09:33.715445 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f170377-fda0-4fd5-b8bd-40907844ba0e admin admin] Authenticating user token {{(pid=86655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:09:33.717013 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.fernet_utils [None req-6f170377-fda0-4fd5-b8bd-40907844ba0e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:09:33.730574 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f170377-fda0-4fd5-b8bd-40907844ba0e admin admin] Validating token access rules against request {{(pid=86655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:09:33.788045 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a138233d-6f30-44b9-8b23-a9007d9294bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4bcdd8106d4bebbdcae96be33505bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a2b7c1edcba4e118452f92cb83ff4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:09:33.788963 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a138233d-6f30-44b9-8b23-a9007d9294bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:09:33.789250 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a138233d-6f30-44b9-8b23-a9007d9294bb admin admin] SCRIPT_NAME: `/identity` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:09:33.789545 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a138233d-6f30-44b9-8b23-a9007d9294bb admin admin] PATH_INFO: `/v3/projects/3f3213eb535b4208babd98867255cccb` {{(pid=86655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:09:33.790811 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a138233d-6f30-44b9-8b23-a9007d9294bb admin admin] RBAC: Authorizing `identity:delete_project(project_id=3f3213eb535b4208babd98867255cccb)` {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:09:33.792902 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a138233d-6f30-44b9-8b23-a9007d9294bb admin admin] RBAC: Authorization granted {{(pid=86655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:09:33.838294 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-a138233d-6f30-44b9-8b23-a9007d9294bb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3f3213eb535b4208babd98867255cccb', 'request_id': 'req-a138233d-6f30-44b9-8b23-a9007d9294bb'} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:09:33.843614 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-a138233d-6f30-44b9-8b23-a9007d9294bb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3f3213eb535b4208babd98867255cccb', 'request_id': 'req-a138233d-6f30-44b9-8b23-a9007d9294bb'} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:09:33.851062 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-a138233d-6f30-44b9-8b23-a9007d9294bb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3f3213eb535b4208babd98867255cccb', 'request_id': 'req-a138233d-6f30-44b9-8b23-a9007d9294bb'} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:09:33.862185 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-a138233d-6f30-44b9-8b23-a9007d9294bb admin admin] The token cache is being invalidate because project 3f3213eb535b4208babd98867255cccb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86655) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 11:09:33.862474 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-a138233d-6f30-44b9-8b23-a9007d9294bb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:09:33.863102 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG keystone.notifications [None req-a138233d-6f30-44b9-8b23-a9007d9294bb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:09:33.864690 dv-cinder-846146-7-smb devstack@keystone.service[86655]: [pid: 86655|app: 0|req: 1467/2922] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Jul 14 11:09:33 2022] DELETE /identity/v3/projects/3f3213eb535b4208babd98867255cccb => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:09:43.444394 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=50,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:09:43.859122 dv-cinder-846146-7-smb devstack@keystone.service[86655]: DEBUG dbcounter [-] [86655] Writing DB stats keystone:INSERT=2,keystone:DELETE=8,keystone:SELECT=55 {{(pid=86655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:11:04.703564 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d965499f-622b-4524-8d7c-239c20a8a13e admin admin] Authenticating user token {{(pid=86656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:11:04.704992 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-d965499f-622b-4524-8d7c-239c20a8a13e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:11:04.855790 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d965499f-622b-4524-8d7c-239c20a8a13e admin admin] Validating token access rules against request {{(pid=86656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:11:04.917481 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2d1204-86b9-41ae-ae8c-e27e3bed486f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16846111ee2a42dd99c3052d40980f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59391272ecbe48b0aa736cb43807be1d', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:11:04.918139 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2d1204-86b9-41ae-ae8c-e27e3bed486f service placement] REQUEST_METHOD: `GET` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:11:04.918429 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2d1204-86b9-41ae-ae8c-e27e3bed486f service placement] SCRIPT_NAME: `/identity` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:11:04.918711 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2d1204-86b9-41ae-ae8c-e27e3bed486f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:11:04.920517 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.fernet_utils [None req-8d2d1204-86b9-41ae-ae8c-e27e3bed486f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:11:04.932532 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2d1204-86b9-41ae-ae8c-e27e3bed486f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:11:04.934150 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2d1204-86b9-41ae-ae8c-e27e3bed486f service placement] RBAC: Authorization granted {{(pid=86656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:11:04.944035 dv-cinder-846146-7-smb devstack@keystone.service[86656]: [pid: 86656|app: 0|req: 1456/2923] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jul 14 11:11:04 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 241 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 11:11:14.939779 dv-cinder-846146-7-smb devstack@keystone.service[86656]: DEBUG dbcounter [-] [86656] Writing DB stats keystone:SELECT=89 {{(pid=86656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}